2024-09-16T07:34:35.483 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T07:34:35.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T07:34:35.593 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906875 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/radosbench} email: null first_in_suite: false job_id: '7906875' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd failsafe full ratio: 0.95 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: bluestore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: min_in: 4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 6651 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi003.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPUaWCdcq8q0+18shW3f2pSCjm3eQBK/jW4od/DTjpLTe49Z0KBdDEBHd5gX7rdmOLYKdyhvCxRiXHwoBmi4l0w= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGvi3M8ULAddry+T1ER70TAHrkArsYMjVGV0/TRJY/z5wnh2sG3dc6LJtyCPU5fiskyWThrSlZ9wuTKcH2MXF48= tasks: - install: null - ceph: conf: osd: debug monc: 20 flavor: crimson - thrashosds: ceph_objectstore_tool: false chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - full_sequential: - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_07:15:55 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T07:34:35.593 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-16T07:34:35.594 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-16T07:34:35.594 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T07:34:35.596 INFO:teuthology.task.internal:Checking packages... 2024-09-16T07:34:35.620 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-16T07:34:35.620 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T07:34:35.620 INFO:teuthology.packaging:ref: None 2024-09-16T07:34:35.620 INFO:teuthology.packaging:tag: None 2024-09-16T07:34:35.620 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-16T07:34:35.620 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:34:35.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-16T07:34:35.765 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-16T07:34:35.767 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T07:34:35.774 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T07:34:35.774 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T07:34:35.788 INFO:teuthology.task.internal:Saving configuration 2024-09-16T07:34:35.804 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T07:34:35.811 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T07:34:35.835 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906875', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 07:29:35.871228', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPUaWCdcq8q0+18shW3f2pSCjm3eQBK/jW4od/DTjpLTe49Z0KBdDEBHd5gX7rdmOLYKdyhvCxRiXHwoBmi4l0w='} 2024-09-16T07:34:35.854 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906875', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 07:29:35.872584', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGvi3M8ULAddry+T1ER70TAHrkArsYMjVGV0/TRJY/z5wnh2sG3dc6LJtyCPU5fiskyWThrSlZ9wuTKcH2MXF48='} 2024-09-16T07:34:35.854 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T07:34:35.860 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-16T07:34:35.860 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-16T07:34:35.860 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T07:34:35.919 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7d7a847f40>, signals=[15]) 2024-09-16T07:34:35.919 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T07:34:35.924 INFO:teuthology.task.internal:Opening connections... 2024-09-16T07:34:35.925 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi003.front.sepia.ceph.com 2024-09-16T07:34:35.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:34:36.004 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T07:34:36.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:34:36.081 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T07:34:36.087 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2024-09-16T07:34:36.106 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2024-09-16T07:34:36.106 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-09-16T07:34:36.164 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2024-09-16T07:34:36.165 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2024-09-16T07:34:36.165 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2024-09-16T07:34:36.165 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2024-09-16T07:34:36.165 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2024-09-16T07:34:36.165 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2024-09-16T07:34:36.165 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T07:34:36.165 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2024-09-16T07:34:36.165 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2024-09-16T07:34:36.165 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T07:34:36.165 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2024-09-16T07:34:36.165 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T07:34:36.165 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T07:34:36.166 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T07:34:36.166 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-09-16T07:34:36.190 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-09-16T07:34:36.208 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-09-16T07:34:36.209 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-09-16T07:34:36.266 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-09-16T07:34:36.266 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-09-16T07:34:36.266 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-09-16T07:34:36.266 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-09-16T07:34:36.267 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-09-16T07:34:36.267 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-09-16T07:34:36.267 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T07:34:36.267 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-09-16T07:34:36.267 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-09-16T07:34:36.267 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T07:34:36.267 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-09-16T07:34:36.267 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T07:34:36.267 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T07:34:36.267 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T07:34:36.268 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-09-16T07:34:36.290 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T07:34:36.299 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T07:34:36.304 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T07:34:36.304 DEBUG:teuthology.orchestra.run.smithi003:> test '!' -e /home/ubuntu/cephtest 2024-09-16T07:34:36.307 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-09-16T07:34:36.323 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T07:34:36.330 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T07:34:36.330 DEBUG:teuthology.orchestra.run.smithi003:> test -z $(ls -A /var/lib/ceph) 2024-09-16T07:34:36.365 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-09-16T07:34:36.471 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T07:34:36.526 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T07:34:36.541 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-16T07:34:36.541 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-16T07:34:36.542 DEBUG:teuthology.orchestra.run.smithi003:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T07:34:36.542 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T07:34:36.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:34:36.559 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2024-09-16T07:34:36.560 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:34:36.560 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-16T07:34:36.616 INFO:teuthology.orchestra.run.smithi003.stdout:5.14.0-503.el9.x86_64 2024-09-16T07:34:36.616 INFO:teuthology.task.kernel:Running kernel on smithi003: 5.14.0-503.el9.x86_64 2024-09-16T07:34:36.616 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum install -y kernel 2024-09-16T07:34:36.617 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-503.el9.x86_64 2024-09-16T07:34:36.618 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.14.0-503.el9.x86_64 2024-09-16T07:34:36.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2024-09-16T07:34:38.997 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-16T07:34:39.015 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-16T07:34:42.166 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-16T07:34:44.747 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-16T07:34:46.850 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 6.5 MB 00:00 2024-09-16T07:34:48.309 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - Extras packages 92 kB/s | 19 kB 00:00 2024-09-16T07:34:49.046 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-16T07:34:50.156 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-16T07:34:51.581 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 84 kB/s | 19 kB 00:00 2024-09-16T07:34:52.685 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-16T07:34:54.685 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-16T07:34:56.834 INFO:teuthology.orchestra.run.smithi003.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T07:34:56.834 INFO:teuthology.orchestra.run.smithi003.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T07:34:56.930 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:34:56.932 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:34:56.932 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2024-09-16T07:34:56.932 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:34:56.932 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:34:56.932 INFO:teuthology.orchestra.run.smithi003.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T07:34:56.932 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-16T07:34:56.932 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T07:34:56.932 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T07:34:56.933 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T07:34:56.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:34:56.933 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:34:56.933 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:34:56.933 INFO:teuthology.orchestra.run.smithi003.stdout:Install 4 Packages 2024-09-16T07:34:56.933 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:34:56.934 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 79 M 2024-09-16T07:34:56.934 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 126 M 2024-09-16T07:34:56.934 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:34:57.045 INFO:teuthology.orchestra.run.smithi003.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 250 kB/s | 23 kB 00:00 2024-09-16T07:34:57.437 INFO:teuthology.orchestra.run.smithi003.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-16T07:34:57.846 INFO:teuthology.orchestra.run.smithi003.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 39 MB/s | 35 MB 00:00 2024-09-16T07:34:58.149 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-16T07:34:58.188 INFO:teuthology.orchestra.run.smithi003.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-16T07:34:58.188 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:34:58.188 INFO:teuthology.orchestra.run.smithi003.stdout:Total 63 MB/s | 79 MB 00:01 2024-09-16T07:34:58.892 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:34:59.261 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:34:59.261 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:35:00.164 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T07:35:00.164 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T07:35:00.231 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:35:00.231 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:35:00.268 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:35:00.272 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:35:00.272 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-16T07:35:00.272 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:35:00.272 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:35:00.272 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T07:35:00.272 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-16T07:35:00.272 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T07:35:00.272 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T07:35:00.273 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T07:35:00.273 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:35:00.273 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:35:00.273 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:35:00.273 INFO:teuthology.orchestra.run.smithi134.stdout:Install 4 Packages 2024-09-16T07:35:00.273 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:35:00.273 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 79 M 2024-09-16T07:35:00.274 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 126 M 2024-09-16T07:35:00.274 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:35:00.478 INFO:teuthology.orchestra.run.smithi134.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 220 kB/s | 23 kB 00:00 2024-09-16T07:35:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:35:03.467 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:35:03.565 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:35:04.351 INFO:teuthology.orchestra.run.smithi134.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:03 2024-09-16T07:35:04.834 INFO:teuthology.orchestra.run.smithi134.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 6.6 MB/s | 29 MB 00:04 2024-09-16T07:35:05.876 INFO:teuthology.orchestra.run.smithi134.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.3 MB/s | 35 MB 00:05 2024-09-16T07:35:05.877 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:35:05.877 INFO:teuthology.orchestra.run.smithi134.stdout:Total 14 MB/s | 79 MB 00:05 2024-09-16T07:35:06.366 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:35:06.492 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:35:06.562 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:35:06.913 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:35:06.913 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:35:07.868 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:35:07.868 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:35:10.314 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:35:11.003 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:35:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:35:11.623 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:35:11.701 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:35:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:35:14.040 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:35:16.845 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:35:18.863 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:35:18.907 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:35:23.726 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:35:55.657 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:35:55.698 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:35:56.062 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:35:56.062 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:35:56.062 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:35:56.063 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:35:56.903 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:35:56.903 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:35:56.904 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:35:56.904 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T07:35:56.904 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T07:35:56.904 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T07:35:56.904 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T07:35:56.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:35:56.904 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:35:57.269 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:35:57.361 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:35:57.361 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:35:57.361 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T07:35:57.361 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T07:35:57.361 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T07:35:57.362 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T07:35:57.362 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi003.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T07:35:57.362 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:35:57.420 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:35:57.421 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:35:57.421 DEBUG:teuthology.orchestra.run.smithi003:> sudo rpm -qi grub2-tools 2024-09-16T07:35:57.453 INFO:teuthology.orchestra.run.smithi003.stdout:Name : grub2-tools 2024-09-16T07:35:57.453 INFO:teuthology.orchestra.run.smithi003.stdout:Epoch : 1 2024-09-16T07:35:57.453 INFO:teuthology.orchestra.run.smithi003.stdout:Version : 2.06 2024-09-16T07:35:57.453 INFO:teuthology.orchestra.run.smithi003.stdout:Release : 82.el9 2024-09-16T07:35:57.453 INFO:teuthology.orchestra.run.smithi003.stdout:Architecture: x86_64 2024-09-16T07:35:57.453 INFO:teuthology.orchestra.run.smithi003.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T07:35:57.453 INFO:teuthology.orchestra.run.smithi003.stdout:Group : Unspecified 2024-09-16T07:35:57.454 INFO:teuthology.orchestra.run.smithi003.stdout:Size : 8274670 2024-09-16T07:35:57.454 INFO:teuthology.orchestra.run.smithi003.stdout:License : GPLv3+ 2024-09-16T07:35:57.454 INFO:teuthology.orchestra.run.smithi003.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T07:35:57.454 INFO:teuthology.orchestra.run.smithi003.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T07:35:57.454 INFO:teuthology.orchestra.run.smithi003.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T07:35:57.454 INFO:teuthology.orchestra.run.smithi003.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T07:35:57.454 INFO:teuthology.orchestra.run.smithi003.stdout:Packager : builder@centos.org 2024-09-16T07:35:57.454 INFO:teuthology.orchestra.run.smithi003.stdout:Vendor : CentOS 2024-09-16T07:35:57.454 INFO:teuthology.orchestra.run.smithi003.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T07:35:57.454 INFO:teuthology.orchestra.run.smithi003.stdout:Summary : Support tools for GRUB. 2024-09-16T07:35:57.454 INFO:teuthology.orchestra.run.smithi003.stdout:Description : 2024-09-16T07:35:57.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:35:57.454 INFO:teuthology.orchestra.run.smithi003.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T07:35:57.455 INFO:teuthology.orchestra.run.smithi003.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T07:35:57.455 INFO:teuthology.orchestra.run.smithi003.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T07:35:57.455 INFO:teuthology.orchestra.run.smithi003.stdout:hardware devices. 2024-09-16T07:35:57.455 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:35:57.455 INFO:teuthology.orchestra.run.smithi003.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T07:35:57.456 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T07:35:57.456 INFO:teuthology.task.kernel:Updating grub on smithi003 to boot 5.14.0-505.el9.x86_64 2024-09-16T07:35:57.456 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T07:35:58.151 INFO:teuthology.orchestra.run.smithi003.stderr:Generating grub configuration file ... 2024-09-16T07:35:59.521 INFO:teuthology.orchestra.run.smithi003.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T07:35:59.536 INFO:teuthology.orchestra.run.smithi003.stderr:done 2024-09-16T07:35:59.538 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2024-09-16T07:35:59.553 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.Isrhxrobd5 2024-09-16T07:35:59.553 DEBUG:teuthology.orchestra.run.smithi003:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Isrhxrobd5 2024-09-16T07:35:59.620 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.Isrhxrobd5 2024-09-16T07:35:59.772 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.Isrhxrobd5 is 6KB 2024-09-16T07:35:59.822 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.Isrhxrobd5 2024-09-16T07:35:59.837 DEBUG:teuthology.orchestra.run.smithi003:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T07:35:59.902 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T07:35:59.903 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T07:35:59.903 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T07:35:59.903 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T07:35:59.904 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T07:36:00.051 DEBUG:teuthology.orchestra.run.smithi003:> sudo shutdown -r now 2024-09-16T07:36:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:36:02.385 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:36:02.653 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:36:02.654 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:36:02.654 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:36:02.654 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:36:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:36:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:36:03.487 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:36:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T07:36:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T07:36:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T07:36:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T07:36:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:36:03.488 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:36:03.878 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:36:03.963 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:36:03.964 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:36:03.964 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T07:36:03.964 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T07:36:03.964 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T07:36:03.965 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-16T07:36:03.965 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T07:36:03.965 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:36:04.024 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:36:04.025 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:36:04.025 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2024-09-16T07:36:04.064 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2024-09-16T07:36:04.064 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2024-09-16T07:36:04.064 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.06 2024-09-16T07:36:04.064 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 82.el9 2024-09-16T07:36:04.064 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2024-09-16T07:36:04.064 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T07:36:04.064 INFO:teuthology.orchestra.run.smithi134.stdout:Group : Unspecified 2024-09-16T07:36:04.064 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 8274670 2024-09-16T07:36:04.064 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2024-09-16T07:36:04.064 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T07:36:04.064 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T07:36:04.065 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T07:36:04.065 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T07:36:04.065 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : builder@centos.org 2024-09-16T07:36:04.065 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2024-09-16T07:36:04.065 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T07:36:04.065 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2024-09-16T07:36:04.065 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2024-09-16T07:36:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:36:04.065 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T07:36:04.065 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T07:36:04.065 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T07:36:04.065 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2024-09-16T07:36:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:36:04.066 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T07:36:04.066 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T07:36:04.066 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 5.14.0-505.el9.x86_64 2024-09-16T07:36:04.067 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T07:36:04.690 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-09-16T07:36:06.033 INFO:teuthology.orchestra.run.smithi134.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T07:36:06.059 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-09-16T07:36:06.062 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-16T07:36:06.077 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.gb5wAvu8Kz 2024-09-16T07:36:06.078 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gb5wAvu8Kz 2024-09-16T07:36:06.144 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.gb5wAvu8Kz 2024-09-16T07:36:06.286 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.gb5wAvu8Kz is 6KB 2024-09-16T07:36:06.335 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.gb5wAvu8Kz 2024-09-16T07:36:06.351 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T07:36:06.413 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T07:36:06.414 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T07:36:06.414 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T07:36:06.414 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T07:36:06.415 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T07:36:06.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-09-16T07:36:30.076 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T07:36:30.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-16T07:36:30.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:36:36.593 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-16T07:36:36.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-16T07:36:36.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:37:11.233 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-16T07:37:20.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-16T07:37:20.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:37:30.089 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T07:37:38.621 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-16T07:37:39.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-16T07:37:39.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:37:42.634 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-09-16T07:37:43.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-16T07:37:43.139 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T07:37:43.139 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2024-09-16T07:37:43.154 INFO:teuthology.orchestra.run.smithi003.stdout:5.14.0-505.el9.x86_64 2024-09-16T07:37:43.154 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T07:37:43.154 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T07:37:43.155 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T07:37:44.156 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T07:37:44.156 DEBUG:teuthology.orchestra.run.smithi003:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T07:37:44.231 INFO:teuthology.orchestra.run.smithi003.stdout:ttyS1 2024-09-16T07:37:44.249 DEBUG:teuthology.parallel:result is None 2024-09-16T07:37:50.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-16T07:37:50.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:37:51.008 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-16T07:37:51.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-16T07:37:51.371 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-16T07:37:51.371 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-16T07:37:51.385 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-505.el9.x86_64 2024-09-16T07:37:51.386 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T07:37:51.386 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T07:37:51.386 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T07:37:52.387 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-16T07:37:52.388 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T07:37:52.514 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-09-16T07:37:52.532 DEBUG:teuthology.parallel:result is None 2024-09-16T07:37:52.532 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T07:37:52.539 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T07:37:52.539 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T07:37:52.543 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T07:37:52.560 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T07:37:52.567 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T07:37:52.576 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T07:37:52.576 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T07:37:52.603 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T07:37:52.632 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T07:37:52.638 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T07:37:52.639 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T07:37:52.667 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T07:37:52.693 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:37:52.696 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:37:52.703 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:37:52.708 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:37:52.710 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T07:37:52.717 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T07:37:52.717 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T07:37:52.753 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T07:37:52.779 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T07:37:52.787 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T07:37:52.788 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T07:37:52.822 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T07:37:52.837 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:37:52.922 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:37:52.982 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:37:53.067 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:37:53.109 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:37:53.109 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T07:37:53.176 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:37:53.219 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:37:53.270 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:37:53.354 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:37:53.394 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:37:53.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T07:37:53.458 DEBUG:teuthology.orchestra.run.smithi003:> sudo service rsyslog restart 2024-09-16T07:37:53.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-09-16T07:37:53.510 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T07:37:53.549 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T07:37:54.026 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T07:37:54.034 INFO:teuthology.task.internal:Starting timer... 2024-09-16T07:37:54.034 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T07:37:54.045 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T07:37:54.054 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-16T07:37:54.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo service auditd rotate 2024-09-16T07:37:54.119 INFO:teuthology.orchestra.run.smithi003.stdout:Rotating logs: 2024-09-16T07:37:54.121 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-09-16T07:37:54.228 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-09-16T07:37:54.231 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T07:37:54.231 DEBUG:teuthology.orchestra.run.smithi003:> /usr/sbin/getenforce 2024-09-16T07:37:54.254 INFO:teuthology.orchestra.run.smithi003.stdout:Permissive 2024-09-16T07:37:54.254 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-09-16T07:37:54.303 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-09-16T07:37:54.304 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi003.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2024-09-16T07:37:54.304 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T07:37:54.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:37:54.332 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T07:37:54.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:37:54.393 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T07:37:54.393 DEBUG:teuthology.orchestra.run.smithi003:> sudo /usr/sbin/setenforce permissive 2024-09-16T07:37:54.424 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-09-16T07:37:54.648 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T07:37:54.658 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-16T07:37:54.661 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-16T07:37:54.773 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T07:37:54.787 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T07:37:54.788 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi003.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T07:41:40.887 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi003.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-09-16T07:41:40.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-16T07:41:40.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:41:40.967 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-09-16T07:41:41.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-16T07:41:41.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-16T07:41:41.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:41:41.128 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-16T07:41:41.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-16T07:41:41.204 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T07:41:41.214 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T07:41:41.214 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T07:41:41.215 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:41:41.220 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T07:41:41.220 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:41:41.248 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T07:41:41.265 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T07:41:41.273 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T07:41:41.288 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T07:41:41.292 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: ntpd: command not found 2024-09-16T07:41:41.304 INFO:teuthology.orchestra.run.smithi003.stdout:506 Cannot talk to daemon 2024-09-16T07:41:41.312 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-09-16T07:41:41.319 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T07:41:41.323 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-09-16T07:41:41.334 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T07:41:41.337 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T07:41:41.351 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T07:41:41.393 INFO:teuthology.orchestra.run.smithi003.stderr:bash: line 1: ntpq: command not found 2024-09-16T07:41:41.397 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T07:41:41.397 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2024-09-16T07:41:41.397 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:41:41.397 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:41:41.397 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:41:41.397 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:41:41.406 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-16T07:41:41.410 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T07:41:41.410 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-16T07:41:41.410 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:41:41.410 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:41:41.410 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:41:41.410 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:41:41.410 INFO:teuthology.run_tasks:Running task install... 2024-09-16T07:41:41.418 DEBUG:teuthology.task.install:project ceph 2024-09-16T07:41:41.418 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-16T07:41:41.419 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-16T07:41:41.419 INFO:teuthology.task.install:Using flavor: crimson 2024-09-16T07:41:41.426 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T07:41:41.426 INFO:teuthology.task.install:extra packages: [] 2024-09-16T07:41:41.427 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T07:41:41.427 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:41:41.429 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T07:41:41.430 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:41:41.577 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T07:41:41.577 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T07:41:41.580 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T07:41:41.581 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T07:41:41.688 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T07:41:41.688 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:41:41.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T07:41:41.694 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T07:41:41.694 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:41:41.694 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T07:41:41.715 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T07:41:41.715 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T07:41:41.721 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T07:41:41.721 DEBUG:teuthology.orchestra.run.smithi003:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T07:41:41.781 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T07:41:41.788 DEBUG:teuthology.orchestra.run.smithi003:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T07:41:41.856 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T07:41:41.865 DEBUG:teuthology.orchestra.run.smithi003:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T07:41:41.920 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-09-16T07:41:41.921 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-09-16T07:41:41.930 INFO:teuthology.orchestra.run.smithi003.stdout:check_obsoletes = 1 2024-09-16T07:41:41.932 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum clean all 2024-09-16T07:41:42.147 INFO:teuthology.orchestra.run.smithi134.stdout:45 files removed 2024-09-16T07:41:42.175 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw 2024-09-16T07:41:42.181 INFO:teuthology.orchestra.run.smithi003.stdout:45 files removed 2024-09-16T07:41:42.208 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-radosgw 2024-09-16T07:41:42.749 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 307 kB/s | 88 kB 00:00 2024-09-16T07:41:42.799 INFO:teuthology.orchestra.run.smithi003.stdout:ceph packages for x86_64 305 kB/s | 88 kB 00:00 2024-09-16T07:41:43.041 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-16T07:41:43.083 INFO:teuthology.orchestra.run.smithi003.stdout:ceph noarch packages 102 kB/s | 24 kB 00:00 2024-09-16T07:41:43.316 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 8.7 kB/s | 2.1 kB 00:00 2024-09-16T07:41:43.358 INFO:teuthology.orchestra.run.smithi003.stdout:ceph source packages 8.8 kB/s | 2.1 kB 00:00 2024-09-16T07:41:44.493 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 7.2 MB/s | 8.2 MB 00:01 2024-09-16T07:41:45.216 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-16T07:41:46.260 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-16T07:41:47.193 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-16T07:41:51.619 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-16T07:41:51.643 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-16T07:41:53.052 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 116 kB/s | 19 kB 00:00 2024-09-16T07:41:53.078 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - Extras packages 93 kB/s | 19 kB 00:00 2024-09-16T07:41:54.007 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-16T07:41:54.232 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-16T07:41:59.479 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-16T07:41:59.812 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-16T07:42:01.839 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:42:01.847 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:42:01.847 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-16T07:42:01.847 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:42:01.847 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:42:01.847 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T07:42:01.847 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-09-16T07:42:01.847 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:42:01.847 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T07:42:01.848 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-16T07:42:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T07:42:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T07:42:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T07:42:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T07:42:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T07:42:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T07:42:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T07:42:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T07:42:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T07:42:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T07:42:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T07:42:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T07:42:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T07:42:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T07:42:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T07:42:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T07:42:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T07:42:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T07:42:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T07:42:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T07:42:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T07:42:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T07:42:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T07:42:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T07:42:01.850 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T07:42:01.850 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T07:42:01.850 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T07:42:01.850 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T07:42:01.850 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T07:42:01.850 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-09-16T07:42:01.850 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T07:42:01.850 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:42:01.850 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:42:01.850 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:42:01.850 INFO:teuthology.orchestra.run.smithi134.stdout:Install 31 Packages 2024-09-16T07:42:01.850 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages 2024-09-16T07:42:01.851 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:42:01.851 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 60 M 2024-09-16T07:42:01.851 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:42:02.318 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:42:02.329 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:42:02.329 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-16T07:42:02.329 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:42:02.329 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:42:02.329 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T07:42:02.329 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrading: 2024-09-16T07:42:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:42:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T07:42:02.330 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-16T07:42:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T07:42:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T07:42:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T07:42:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T07:42:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T07:42:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T07:42:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T07:42:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T07:42:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T07:42:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T07:42:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T07:42:02.331 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T07:42:02.331 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T07:42:02.331 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T07:42:02.331 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T07:42:02.331 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T07:42:02.331 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T07:42:02.331 INFO:teuthology.orchestra.run.smithi003.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T07:42:02.331 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T07:42:02.331 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T07:42:02.331 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T07:42:02.331 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T07:42:02.331 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T07:42:02.331 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T07:42:02.332 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T07:42:02.332 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T07:42:02.332 INFO:teuthology.orchestra.run.smithi003.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T07:42:02.332 INFO:teuthology.orchestra.run.smithi003.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T07:42:02.332 INFO:teuthology.orchestra.run.smithi003.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T07:42:02.332 INFO:teuthology.orchestra.run.smithi003.stdout:Installing weak dependencies: 2024-09-16T07:42:02.332 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T07:42:02.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:42:02.332 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:42:02.332 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:42:02.332 INFO:teuthology.orchestra.run.smithi003.stdout:Install 31 Packages 2024-09-16T07:42:02.332 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrade 2 Packages 2024-09-16T07:42:02.332 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:42:02.333 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 60 M 2024-09-16T07:42:02.333 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:42:02.789 INFO:teuthology.orchestra.run.smithi134.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 11 MB/s | 6.1 MB 00:00 2024-09-16T07:42:02.839 INFO:teuthology.orchestra.run.smithi134.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 504 kB/s | 25 kB 00:00 2024-09-16T07:42:02.972 INFO:teuthology.orchestra.run.smithi134.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 5.9 MB/s | 809 kB 00:00 2024-09-16T07:42:03.090 INFO:teuthology.orchestra.run.smithi134.stdout:(4/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 12 MB/s | 10 MB 00:00 2024-09-16T07:42:03.131 INFO:teuthology.orchestra.run.smithi134.stdout:(5/33): libradosstriper1-19.3.0-4879.g81fedcb3. 3.4 MB/s | 558 kB 00:00 2024-09-16T07:42:03.190 INFO:teuthology.orchestra.run.smithi134.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 772 kB/s | 45 kB 00:00 2024-09-16T07:42:03.265 INFO:teuthology.orchestra.run.smithi134.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 1.9 MB/s | 143 kB 00:00 2024-09-16T07:42:03.391 INFO:teuthology.orchestra.run.smithi134.stdout:(8/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 18 MB/s | 5.4 MB 00:00 2024-09-16T07:42:03.415 INFO:teuthology.orchestra.run.smithi134.stdout:(9/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 1.0 MB/s | 160 kB 00:00 2024-09-16T07:42:03.563 INFO:teuthology.orchestra.run.smithi003.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 6.0 MB/s | 6.1 MB 00:01 2024-09-16T07:42:03.605 INFO:teuthology.orchestra.run.smithi003.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 608 kB/s | 25 kB 00:00 2024-09-16T07:42:03.616 INFO:teuthology.orchestra.run.smithi134.stdout:(10/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 14 MB/s | 20 MB 00:01 2024-09-16T07:42:03.641 INFO:teuthology.orchestra.run.smithi134.stdout:(11/33): python3-rados-19.3.0-4879.g81fedcb3.el 1.2 MB/s | 315 kB 00:00 2024-09-16T07:42:03.666 INFO:teuthology.orchestra.run.smithi134.stdout:(12/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 1.9 MB/s | 99 kB 00:00 2024-09-16T07:42:03.688 INFO:teuthology.orchestra.run.smithi003.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 9.5 MB/s | 809 kB 00:00 2024-09-16T07:42:03.691 INFO:teuthology.orchestra.run.smithi134.stdout:(13/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 1.1 MB/s | 302 kB 00:00 2024-09-16T07:42:03.764 INFO:teuthology.orchestra.run.smithi003.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 7.3 MB/s | 558 kB 00:00 2024-09-16T07:42:03.800 INFO:teuthology.orchestra.run.smithi134.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 673 kB/s | 107 kB 00:00 2024-09-16T07:42:03.826 INFO:teuthology.orchestra.run.smithi134.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.0 MB/s | 171 kB 00:00 2024-09-16T07:42:03.851 INFO:teuthology.orchestra.run.smithi134.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-16T07:42:03.876 INFO:teuthology.orchestra.run.smithi134.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-09-16T07:42:03.926 INFO:teuthology.orchestra.run.smithi134.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 846 kB/s | 42 kB 00:00 2024-09-16T07:42:03.960 INFO:teuthology.orchestra.run.smithi134.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-16T07:42:04.002 INFO:teuthology.orchestra.run.smithi134.stdout:(20/33): qatlib-service-24.02.0-1.el9.x86_64.rp 862 kB/s | 36 kB 00:00 2024-09-16T07:42:04.035 INFO:teuthology.orchestra.run.smithi134.stdout:(21/33): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-16T07:42:04.069 INFO:teuthology.orchestra.run.smithi134.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-16T07:42:04.086 INFO:teuthology.orchestra.run.smithi134.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-16T07:42:04.123 INFO:teuthology.orchestra.run.smithi003.stdout:(5/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 6.6 MB/s | 10 MB 00:01 2024-09-16T07:42:04.145 INFO:teuthology.orchestra.run.smithi134.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.0 MB/s | 308 kB 00:00 2024-09-16T07:42:04.161 INFO:teuthology.orchestra.run.smithi134.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 345 kB/s | 26 kB 00:00 2024-09-16T07:42:04.178 INFO:teuthology.orchestra.run.smithi134.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-16T07:42:04.198 INFO:teuthology.orchestra.run.smithi003.stdout:(6/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 12 MB/s | 5.4 MB 00:00 2024-09-16T07:42:04.203 INFO:teuthology.orchestra.run.smithi134.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-16T07:42:04.214 INFO:teuthology.orchestra.run.smithi003.stdout:(7/33): python3-ceph-argparse-19.3.0-4879.g81fe 492 kB/s | 45 kB 00:00 2024-09-16T07:42:04.237 INFO:teuthology.orchestra.run.smithi134.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-16T07:42:04.248 INFO:teuthology.orchestra.run.smithi003.stdout:(8/33): python3-ceph-common-19.3.0-4879.g81fedc 2.8 MB/s | 143 kB 00:00 2024-09-16T07:42:04.271 INFO:teuthology.orchestra.run.smithi134.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-16T07:42:04.274 INFO:teuthology.orchestra.run.smithi003.stdout:(9/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 2.6 MB/s | 160 kB 00:00 2024-09-16T07:42:04.307 INFO:teuthology.orchestra.run.smithi003.stdout:(10/33): python3-rados-19.3.0-4879.g81fedcb3.el 5.2 MB/s | 315 kB 00:00 2024-09-16T07:42:04.341 INFO:teuthology.orchestra.run.smithi003.stdout:(11/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 4.4 MB/s | 302 kB 00:00 2024-09-16T07:42:04.346 INFO:teuthology.orchestra.run.smithi134.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-16T07:42:04.366 INFO:teuthology.orchestra.run.smithi003.stdout:(12/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 1.7 MB/s | 99 kB 00:00 2024-09-16T07:42:04.438 INFO:teuthology.orchestra.run.smithi134.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-16T07:42:04.513 INFO:teuthology.orchestra.run.smithi134.stdout:(32/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 14 MB/s | 3.5 MB 00:00 2024-09-16T07:42:04.575 INFO:teuthology.orchestra.run.smithi003.stdout:(13/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 9.7 MB/s | 20 MB 00:02 2024-09-16T07:42:04.622 INFO:teuthology.orchestra.run.smithi134.stdout:(33/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 14 MB/s | 3.8 MB 00:00 2024-09-16T07:42:04.627 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:42:04.627 INFO:teuthology.orchestra.run.smithi134.stdout:Total 22 MB/s | 60 MB 00:02 2024-09-16T07:42:04.737 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:42:04.773 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:42:04.773 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:42:04.942 INFO:teuthology.orchestra.run.smithi003.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 178 kB/s | 107 kB 00:00 2024-09-16T07:42:05.034 INFO:teuthology.orchestra.run.smithi003.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 256 kB/s | 171 kB 00:00 2024-09-16T07:42:05.059 INFO:teuthology.orchestra.run.smithi003.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 388 kB/s | 45 kB 00:00 2024-09-16T07:42:05.126 INFO:teuthology.orchestra.run.smithi003.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 291 kB/s | 160 kB 00:00 2024-09-16T07:42:05.242 INFO:teuthology.orchestra.run.smithi003.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 363 kB/s | 42 kB 00:00 2024-09-16T07:42:05.351 INFO:teuthology.orchestra.run.smithi003.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.0 MB/s | 292 kB 00:00 2024-09-16T07:42:05.468 INFO:teuthology.orchestra.run.smithi003.stdout:(20/33): qatlib-service-24.02.0-1.el9.x86_64.rp 307 kB/s | 36 kB 00:00 2024-09-16T07:42:05.489 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:42:05.489 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:42:05.527 INFO:teuthology.orchestra.run.smithi003.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 778 kB/s | 221 kB 00:00 2024-09-16T07:42:05.577 INFO:teuthology.orchestra.run.smithi003.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-16T07:42:05.602 INFO:teuthology.orchestra.run.smithi003.stdout:(23/33): librdkafka-1.6.1-102.el9.x86_64.rpm 1.1 MB/s | 662 kB 00:00 2024-09-16T07:42:05.652 INFO:teuthology.orchestra.run.smithi003.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.4 MB/s | 308 kB 00:00 2024-09-16T07:42:05.678 INFO:teuthology.orchestra.run.smithi003.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-16T07:42:05.703 INFO:teuthology.orchestra.run.smithi003.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 284 kB/s | 26 kB 00:00 2024-09-16T07:42:05.720 INFO:teuthology.orchestra.run.smithi003.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-16T07:42:05.757 INFO:teuthology.orchestra.run.smithi003.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-16T07:42:05.804 INFO:teuthology.orchestra.run.smithi003.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-16T07:42:05.871 INFO:teuthology.orchestra.run.smithi003.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-16T07:42:05.946 INFO:teuthology.orchestra.run.smithi003.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-16T07:42:06.154 INFO:teuthology.orchestra.run.smithi003.stdout:(32/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 9.9 MB/s | 3.5 MB 00:00 2024-09-16T07:42:06.213 INFO:teuthology.orchestra.run.smithi003.stdout:(33/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 11 MB/s | 3.8 MB 00:00 2024-09-16T07:42:06.218 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:42:06.218 INFO:teuthology.orchestra.run.smithi003.stdout:Total 16 MB/s | 60 MB 00:03 2024-09-16T07:42:06.336 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:42:06.377 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:42:06.377 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:42:06.991 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:42:07.058 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:42:07.059 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:42:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T07:42:07.565 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:42:07.658 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:42:07.747 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:42:07.775 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:42:07.838 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:42:07.889 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T07:42:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T07:42:07.947 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T07:42:07.969 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:42:08.002 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:42:08.183 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:42:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:42:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T07:42:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T07:42:08.327 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:42:08.415 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T07:42:08.440 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:42:08.528 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:42:08.564 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T07:42:08.598 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:42:08.678 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T07:42:08.721 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T07:42:08.768 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T07:42:08.796 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T07:42:08.825 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T07:42:08.862 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T07:42:09.140 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T07:42:09.190 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:42:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T07:42:09.272 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:42:09.292 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:42:09.346 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:42:09.376 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T07:42:09.392 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:42:09.416 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:42:09.418 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T07:42:09.471 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:42:09.518 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T07:42:09.546 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T07:42:09.571 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T07:42:09.594 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:42:09.616 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:42:09.811 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:42:09.844 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:42:09.879 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T07:42:09.932 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T07:42:09.960 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:42:10.006 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T07:42:10.041 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:42:10.051 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T07:42:10.073 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:42:10.110 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:42:10.163 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:42:10.197 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T07:42:10.225 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T07:42:10.252 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T07:42:10.310 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T07:42:10.340 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T07:42:10.381 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T07:42:10.413 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T07:42:10.451 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T07:42:10.493 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T07:42:10.873 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T07:42:10.921 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:42:11.013 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:42:11.043 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T07:42:11.079 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T07:42:11.694 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T07:42:11.732 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:42:11.805 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:42:11.913 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T07:42:11.942 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T07:42:12.700 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:42:12.731 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:42:13.458 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:42:13.509 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:42:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:42:13.592 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T07:42:13.592 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T07:42:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:42:13.627 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:42:14.486 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:42:14.522 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:42:15.277 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:42:15.317 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:42:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:42:15.416 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T07:42:15.416 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T07:42:15.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:42:15.443 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:42:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:42:24.128 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-09-16T07:42:24.128 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-09-16T07:42:24.128 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-09-16T07:42:24.128 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-09-16T07:42:24.128 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-09-16T07:42:24.128 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-09-16T07:42:24.128 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-09-16T07:42:24.129 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:42:25.233 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:42:25.259 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:42:25.259 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:42:25.259 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T07:42:25.259 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:42:25.259 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:42:25.259 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:42:25.261 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:42:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:42:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:42:26.217 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:42:26.218 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /sys 2024-09-16T07:42:26.218 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /proc 2024-09-16T07:42:26.218 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /mnt 2024-09-16T07:42:26.218 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /var/tmp 2024-09-16T07:42:26.218 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /home 2024-09-16T07:42:26.218 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /root 2024-09-16T07:42:26.218 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /tmp 2024-09-16T07:42:26.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:42:26.687 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:42:26.687 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T07:42:26.687 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:42:26.687 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:42:26.687 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:42:26.687 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T07:42:26.687 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T07:42:26.687 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T07:42:26.687 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T07:42:26.687 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T07:42:26.688 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T07:42:26.688 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T07:42:26.688 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:42:26.688 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T07:42:26.688 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T07:42:26.688 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T07:42:26.688 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T07:42:26.688 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T07:42:26.688 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T07:42:26.688 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T07:42:26.688 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T07:42:26.688 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T07:42:26.689 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T07:42:26.689 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T07:42:26.689 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T07:42:26.689 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T07:42:26.689 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T07:42:26.689 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T07:42:26.689 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T07:42:26.689 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T07:42:26.690 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T07:42:26.690 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T07:42:26.690 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:42:26.690 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T07:42:26.690 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T07:42:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:42:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:42:27.393 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:42:27.393 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T07:42:27.393 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:42:27.394 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:42:27.394 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:42:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:42:27.485 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:42:27.485 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:42:27.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:42:27.650 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:42:27.650 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-09-16T07:42:27.650 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.650 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.651 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:42:27.651 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T07:42:27.651 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.651 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.651 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.651 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.651 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T07:42:27.651 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T07:42:27.651 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T07:42:27.651 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.651 INFO:teuthology.orchestra.run.smithi134.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T07:42:27.651 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T07:42:27.652 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T07:42:27.652 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T07:42:27.652 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.652 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T07:42:27.652 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.652 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T07:42:27.652 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T07:42:27.652 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T07:42:27.652 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.652 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.652 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.652 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T07:42:27.653 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.653 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.653 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:27.653 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T07:42:27.653 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T07:42:27.653 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T07:42:27.653 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T07:42:27.653 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T07:42:27.653 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:42:27.653 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:42:28.003 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-test 2024-09-16T07:42:28.571 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:29 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:42:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:42:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:42:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-16T07:42:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:42:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:42:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T07:42:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-16T07:42:28.717 INFO:teuthology.orchestra.run.smithi134.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T07:42:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T07:42:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T07:42:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T07:42:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T07:42:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T07:42:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T07:42:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T07:42:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:42:28.718 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:42:28.718 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:42:28.718 INFO:teuthology.orchestra.run.smithi134.stdout:Install 9 Packages 2024-09-16T07:42:28.718 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:42:28.718 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 87 M 2024-09-16T07:42:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 797 M 2024-09-16T07:42:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:42:28.799 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:42:28.799 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T07:42:28.800 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:42:28.800 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:42:28.800 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:42:28.800 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T07:42:28.800 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T07:42:28.800 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T07:42:28.800 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T07:42:28.800 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T07:42:28.800 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T07:42:28.800 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T07:42:28.800 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:42:28.800 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T07:42:28.801 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T07:42:28.801 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T07:42:28.801 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T07:42:28.801 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T07:42:28.801 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T07:42:28.801 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T07:42:28.801 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T07:42:28.801 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T07:42:28.801 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T07:42:28.801 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T07:42:28.801 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T07:42:28.801 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T07:42:28.802 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T07:42:28.802 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T07:42:28.802 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T07:42:28.802 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T07:42:28.802 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T07:42:28.802 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T07:42:28.802 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:42:28.802 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T07:42:28.802 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T07:42:29.456 INFO:teuthology.orchestra.run.smithi134.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 678 kB/s | 94 kB 00:00 2024-09-16T07:42:29.548 INFO:teuthology.orchestra.run.smithi134.stdout:(2/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 758 kB/s | 175 kB 00:00 2024-09-16T07:42:29.666 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:42:29.666 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:42:29.667 INFO:teuthology.orchestra.run.smithi003.stdout:Upgraded: 2024-09-16T07:42:29.667 INFO:teuthology.orchestra.run.smithi003.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.667 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.667 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:42:29.667 INFO:teuthology.orchestra.run.smithi003.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T07:42:29.667 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.667 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.667 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.667 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.667 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T07:42:29.667 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T07:42:29.668 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T07:42:29.668 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.668 INFO:teuthology.orchestra.run.smithi003.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T07:42:29.668 INFO:teuthology.orchestra.run.smithi003.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T07:42:29.668 INFO:teuthology.orchestra.run.smithi003.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T07:42:29.668 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T07:42:29.668 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.668 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T07:42:29.668 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.668 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T07:42:29.668 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T07:42:29.668 INFO:teuthology.orchestra.run.smithi003.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T07:42:29.668 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.669 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.669 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.669 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T07:42:29.669 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.669 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.669 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:29.669 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T07:42:29.669 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T07:42:29.669 INFO:teuthology.orchestra.run.smithi003.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T07:42:29.669 INFO:teuthology.orchestra.run.smithi003.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T07:42:29.669 INFO:teuthology.orchestra.run.smithi003.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T07:42:29.669 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:42:29.670 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:42:30.014 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-test 2024-09-16T07:42:30.273 INFO:teuthology.orchestra.run.smithi134.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 252 kB/s | 183 kB 00:00 2024-09-16T07:42:30.381 INFO:teuthology.orchestra.run.smithi134.stdout:(4/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 555 kB/s | 513 kB 00:00 2024-09-16T07:42:30.604 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:31 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:42:30.746 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:42:30.747 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:42:30.748 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-16T07:42:30.748 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:42:30.748 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:42:30.748 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T07:42:30.748 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-16T07:42:30.748 INFO:teuthology.orchestra.run.smithi003.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T07:42:30.748 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T07:42:30.748 INFO:teuthology.orchestra.run.smithi003.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T07:42:30.748 INFO:teuthology.orchestra.run.smithi003.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T07:42:30.748 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T07:42:30.748 INFO:teuthology.orchestra.run.smithi003.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T07:42:30.749 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T07:42:30.749 INFO:teuthology.orchestra.run.smithi003.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T07:42:30.749 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:42:30.749 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:42:30.749 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:42:30.749 INFO:teuthology.orchestra.run.smithi003.stdout:Install 9 Packages 2024-09-16T07:42:30.749 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:42:30.749 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 87 M 2024-09-16T07:42:30.750 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 797 M 2024-09-16T07:42:30.750 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:42:31.122 INFO:teuthology.orchestra.run.smithi003.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 620 kB/s | 94 kB 00:00 2024-09-16T07:42:31.248 INFO:teuthology.orchestra.run.smithi003.stdout:(2/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 631 kB/s | 175 kB 00:00 2024-09-16T07:42:31.290 INFO:teuthology.orchestra.run.smithi003.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.0 MB/s | 513 kB 00:00 2024-09-16T07:42:31.357 INFO:teuthology.orchestra.run.smithi003.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-16T07:42:31.382 INFO:teuthology.orchestra.run.smithi003.stdout:(5/9): libubsan-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 183 kB 00:00 2024-09-16T07:42:31.407 INFO:teuthology.orchestra.run.smithi003.stdout:(6/9): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-16T07:42:31.432 INFO:teuthology.orchestra.run.smithi003.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-16T07:42:31.483 INFO:teuthology.orchestra.run.smithi003.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.6 MB/s | 122 kB 00:00 2024-09-16T07:42:31.806 INFO:teuthology.orchestra.run.smithi134.stdout:(5/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 34 MB/s | 85 MB 00:02 2024-09-16T07:42:31.840 INFO:teuthology.orchestra.run.smithi134.stdout:(6/9): socat-1.7.4.1-6.el9.x86_64.rpm 209 kB/s | 304 kB 00:01 2024-09-16T07:42:31.890 INFO:teuthology.orchestra.run.smithi134.stdout:(7/9): protobuf-3.14.0-13.el9.x86_64.rpm 639 kB/s | 1.0 MB 00:01 2024-09-16T07:42:31.915 INFO:teuthology.orchestra.run.smithi134.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.6 MB/s | 122 kB 00:00 2024-09-16T07:42:32.482 INFO:teuthology.orchestra.run.smithi134.stdout:(9/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 94 kB/s | 64 kB 00:00 2024-09-16T07:42:32.485 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:42:32.486 INFO:teuthology.orchestra.run.smithi134.stdout:Total 23 MB/s | 87 MB 00:03 2024-09-16T07:42:32.568 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:42:32.591 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:42:32.591 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:42:33.204 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:42:33.205 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:42:34.033 INFO:teuthology.orchestra.run.smithi003.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 28 MB/s | 85 MB 00:03 2024-09-16T07:42:34.036 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:42:34.036 INFO:teuthology.orchestra.run.smithi003.stdout:Total 26 MB/s | 87 MB 00:03 2024-09-16T07:42:34.096 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:42:34.123 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:42:34.148 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:42:34.149 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:42:34.167 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T07:42:34.225 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T07:42:34.270 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T07:42:34.297 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T07:42:34.328 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:42:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:42:34.411 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:42:34.453 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T07:42:34.479 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:42:34.800 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:42:34.800 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:42:35.720 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:42:35.789 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T07:42:35.836 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T07:42:35.879 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T07:42:35.905 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T07:42:35.937 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:42:35.961 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:42:36.033 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:42:36.079 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T07:42:36.104 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:42:45.734 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:42:45.809 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:42:48.041 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:42:48.122 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:42:52.064 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:42:52.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T07:42:52.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T07:42:52.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T07:42:52.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T07:42:52.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:42:52.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T07:42:52.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T07:42:52.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T07:42:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T07:42:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:42:52.493 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:42:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T07:42:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T07:42:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T07:42:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T07:42:52.493 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T07:42:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T07:42:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T07:42:52.494 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:42:52.494 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:42:52.832 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph 2024-09-16T07:42:53.400 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:54 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:42:53.535 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:42:53.537 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:42:53.537 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-16T07:42:53.537 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:42:53.537 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:42:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T07:42:53.538 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-16T07:42:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T07:42:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T07:42:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T07:42:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T07:42:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T07:42:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T07:42:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T07:42:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T07:42:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T07:42:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T07:42:53.538 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T07:42:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T07:42:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T07:42:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T07:42:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T07:42:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections 2024-09-16T07:42:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T07:42:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T07:42:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T07:42:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T07:42:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T07:42:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T07:42:53.539 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T07:42:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T07:42:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T07:42:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T07:42:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T07:42:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T07:42:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T07:42:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T07:42:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T07:42:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T07:42:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T07:42:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T07:42:53.540 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T07:42:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T07:42:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T07:42:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:42:53.541 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:42:53.541 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:42:53.541 INFO:teuthology.orchestra.run.smithi134.stdout:Install 37 Packages 2024-09-16T07:42:53.541 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:42:53.541 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 84 M 2024-09-16T07:42:53.542 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 897 M 2024-09-16T07:42:53.542 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:42:54.109 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:42:54.109 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T07:42:54.110 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T07:42:54.110 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T07:42:54.110 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T07:42:54.110 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:42:54.110 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T07:42:54.110 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T07:42:54.110 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T07:42:54.178 INFO:teuthology.orchestra.run.smithi134.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-16T07:42:54.403 INFO:teuthology.orchestra.run.smithi134.stdout:(2/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 6.3 MB/s | 2.2 MB 00:00 2024-09-16T07:42:54.445 INFO:teuthology.orchestra.run.smithi134.stdout:(3/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 4.1 MB/s | 1.6 MB 00:00 2024-09-16T07:42:54.473 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T07:42:54.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:42:54.473 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:42:54.473 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:54.473 INFO:teuthology.orchestra.run.smithi003.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T07:42:54.474 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:42:54.474 INFO:teuthology.orchestra.run.smithi003.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T07:42:54.474 INFO:teuthology.orchestra.run.smithi003.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T07:42:54.474 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T07:42:54.474 INFO:teuthology.orchestra.run.smithi003.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T07:42:54.474 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T07:42:54.474 INFO:teuthology.orchestra.run.smithi003.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T07:42:54.474 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:42:54.474 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:42:54.540 INFO:teuthology.orchestra.run.smithi134.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 3.0 MB/s | 291 kB 00:00 2024-09-16T07:42:54.632 INFO:teuthology.orchestra.run.smithi134.stdout:(5/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86_ 11 MB/s | 5.1 MB 00:00 2024-09-16T07:42:54.824 INFO:teuthology.orchestra.run.smithi134.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 893 kB/s | 253 kB 00:00 2024-09-16T07:42:54.882 INFO:teuthology.orchestra.run.smithi134.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-16T07:42:54.941 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph 2024-09-16T07:42:54.974 INFO:teuthology.orchestra.run.smithi134.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.4 MB/s | 135 kB 00:00 2024-09-16T07:42:55.058 INFO:teuthology.orchestra.run.smithi134.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.5 MB/s | 125 kB 00:00 2024-09-16T07:42:55.108 INFO:teuthology.orchestra.run.smithi134.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.6 MB/s | 1.2 MB 00:00 2024-09-16T07:42:55.242 INFO:teuthology.orchestra.run.smithi134.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-16T07:42:55.292 INFO:teuthology.orchestra.run.smithi134.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-16T07:42:55.317 INFO:teuthology.orchestra.run.smithi134.stdout:(13/37): python3-urllib3-1.26.5-6.el9.noarch.rp 829 kB/s | 215 kB 00:00 2024-09-16T07:42:55.334 INFO:teuthology.orchestra.run.smithi134.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 823 kB/s | 35 kB 00:00 2024-09-16T07:42:55.368 INFO:teuthology.orchestra.run.smithi134.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.5 MB/s | 51 kB 00:00 2024-09-16T07:42:55.402 INFO:teuthology.orchestra.run.smithi134.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-16T07:42:55.427 INFO:teuthology.orchestra.run.smithi134.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 707 kB/s | 77 kB 00:00 2024-09-16T07:42:55.469 INFO:teuthology.orchestra.run.smithi134.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-16T07:42:55.486 INFO:teuthology.orchestra.run.smithi134.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.5 MB/s | 43 kB 00:00 2024-09-16T07:42:55.503 INFO:teuthology.orchestra.run.smithi134.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 221 kB/s | 22 kB 00:00 2024-09-16T07:42:55.523 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:56 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:42:55.536 INFO:teuthology.orchestra.run.smithi134.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-16T07:42:55.562 INFO:teuthology.orchestra.run.smithi134.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 461 kB/s | 11 kB 00:00 2024-09-16T07:42:55.578 INFO:teuthology.orchestra.run.smithi134.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-16T07:42:55.595 INFO:teuthology.orchestra.run.smithi134.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 1.4 MB/s | 23 kB 00:00 2024-09-16T07:42:55.612 INFO:teuthology.orchestra.run.smithi134.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 1.1 MB/s | 19 kB 00:00 2024-09-16T07:42:55.638 INFO:teuthology.orchestra.run.smithi134.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 781 kB/s | 20 kB 00:00 2024-09-16T07:42:55.663 INFO:teuthology.orchestra.run.smithi134.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2024-09-16T07:42:55.666 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:42:55.668 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:42:55.668 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-16T07:42:55.669 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:42:55.669 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:42:55.669 INFO:teuthology.orchestra.run.smithi003.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T07:42:55.669 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-16T07:42:55.669 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T07:42:55.669 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T07:42:55.669 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T07:42:55.669 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T07:42:55.670 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T07:42:55.670 INFO:teuthology.orchestra.run.smithi003.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T07:42:55.670 INFO:teuthology.orchestra.run.smithi003.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T07:42:55.670 INFO:teuthology.orchestra.run.smithi003.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T07:42:55.670 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T07:42:55.670 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T07:42:55.670 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T07:42:55.670 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T07:42:55.670 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T07:42:55.670 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T07:42:55.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T07:42:55.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-collections 2024-09-16T07:42:55.671 INFO:teuthology.orchestra.run.smithi003.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T07:42:55.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T07:42:55.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T07:42:55.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T07:42:55.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T07:42:55.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T07:42:55.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T07:42:55.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T07:42:55.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T07:42:55.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T07:42:55.671 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T07:42:55.672 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T07:42:55.672 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T07:42:55.672 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T07:42:55.672 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T07:42:55.672 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T07:42:55.672 INFO:teuthology.orchestra.run.smithi003.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T07:42:55.672 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T07:42:55.672 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T07:42:55.672 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T07:42:55.672 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T07:42:55.672 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:42:55.672 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:42:55.672 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:42:55.673 INFO:teuthology.orchestra.run.smithi003.stdout:Install 37 Packages 2024-09-16T07:42:55.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:42:55.673 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 84 M 2024-09-16T07:42:55.673 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 897 M 2024-09-16T07:42:55.673 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:42:55.688 INFO:teuthology.orchestra.run.smithi134.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-09-16T07:42:55.713 INFO:teuthology.orchestra.run.smithi134.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-16T07:42:55.739 INFO:teuthology.orchestra.run.smithi134.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 652 kB/s | 16 kB 00:00 2024-09-16T07:42:55.789 INFO:teuthology.orchestra.run.smithi134.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-16T07:42:55.814 INFO:teuthology.orchestra.run.smithi134.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-16T07:42:55.839 INFO:teuthology.orchestra.run.smithi134.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-16T07:42:55.865 INFO:teuthology.orchestra.run.smithi134.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-16T07:42:55.890 INFO:teuthology.orchestra.run.smithi134.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 797 kB/s | 20 kB 00:00 2024-09-16T07:42:55.915 INFO:teuthology.orchestra.run.smithi134.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-16T07:42:56.419 INFO:teuthology.orchestra.run.smithi003.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-16T07:42:56.636 INFO:teuthology.orchestra.run.smithi003.stdout:(2/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 6.3 MB/s | 2.2 MB 00:00 2024-09-16T07:42:56.669 INFO:teuthology.orchestra.run.smithi003.stdout:(3/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 4.2 MB/s | 1.6 MB 00:00 2024-09-16T07:42:56.716 INFO:teuthology.orchestra.run.smithi134.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 30 MB/s | 70 MB 00:02 2024-09-16T07:42:56.720 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:42:56.720 INFO:teuthology.orchestra.run.smithi134.stdout:Total 26 MB/s | 84 MB 00:03 2024-09-16T07:42:56.770 INFO:teuthology.orchestra.run.smithi003.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 2.8 MB/s | 291 kB 00:00 2024-09-16T07:42:56.854 INFO:teuthology.orchestra.run.smithi003.stdout:(5/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86_ 12 MB/s | 5.1 MB 00:00 2024-09-16T07:42:56.872 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:42:56.913 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:42:56.913 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:42:57.020 INFO:teuthology.orchestra.run.smithi003.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-16T07:42:57.096 INFO:teuthology.orchestra.run.smithi003.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-16T07:42:57.179 INFO:teuthology.orchestra.run.smithi003.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.6 MB/s | 135 kB 00:00 2024-09-16T07:42:57.263 INFO:teuthology.orchestra.run.smithi003.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.5 MB/s | 125 kB 00:00 2024-09-16T07:42:57.355 INFO:teuthology.orchestra.run.smithi003.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.4 MB/s | 1.2 MB 00:00 2024-09-16T07:42:57.405 INFO:teuthology.orchestra.run.smithi003.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.5 MB/s | 215 kB 00:00 2024-09-16T07:42:57.489 INFO:teuthology.orchestra.run.smithi003.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-16T07:42:57.530 INFO:teuthology.orchestra.run.smithi003.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 838 kB/s | 35 kB 00:00 2024-09-16T07:42:57.556 INFO:teuthology.orchestra.run.smithi003.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-16T07:42:57.581 INFO:teuthology.orchestra.run.smithi003.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-16T07:42:57.606 INFO:teuthology.orchestra.run.smithi003.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-16T07:42:57.631 INFO:teuthology.orchestra.run.smithi003.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-16T07:42:57.673 INFO:teuthology.orchestra.run.smithi003.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-16T07:42:57.702 INFO:teuthology.orchestra.run.smithi003.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.5 MB/s | 43 kB 00:00 2024-09-16T07:42:57.707 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:42:57.708 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:42:57.727 INFO:teuthology.orchestra.run.smithi003.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2024-09-16T07:42:57.777 INFO:teuthology.orchestra.run.smithi003.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 131 kB/s | 22 kB 00:00 2024-09-16T07:42:57.819 INFO:teuthology.orchestra.run.smithi003.stdout:(22/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.8 MB/s | 358 kB 00:00 2024-09-16T07:42:57.844 INFO:teuthology.orchestra.run.smithi003.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 160 kB/s | 11 kB 00:00 2024-09-16T07:42:57.870 INFO:teuthology.orchestra.run.smithi003.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 364 kB/s | 18 kB 00:00 2024-09-16T07:42:57.895 INFO:teuthology.orchestra.run.smithi003.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 458 kB/s | 23 kB 00:00 2024-09-16T07:42:57.920 INFO:teuthology.orchestra.run.smithi003.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-09-16T07:42:57.946 INFO:teuthology.orchestra.run.smithi003.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-16T07:42:57.971 INFO:teuthology.orchestra.run.smithi003.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-16T07:42:57.996 INFO:teuthology.orchestra.run.smithi003.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-16T07:42:58.021 INFO:teuthology.orchestra.run.smithi003.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 661 kB/s | 16 kB 00:00 2024-09-16T07:42:58.047 INFO:teuthology.orchestra.run.smithi003.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-16T07:42:58.081 INFO:teuthology.orchestra.run.smithi003.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-16T07:42:58.097 INFO:teuthology.orchestra.run.smithi003.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-16T07:42:58.131 INFO:teuthology.orchestra.run.smithi003.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-16T07:42:58.148 INFO:teuthology.orchestra.run.smithi003.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-16T07:42:58.181 INFO:teuthology.orchestra.run.smithi003.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-16T07:42:59.065 INFO:teuthology.orchestra.run.smithi003.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 29 MB/s | 70 MB 00:02 2024-09-16T07:42:59.070 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:42:59.070 INFO:teuthology.orchestra.run.smithi003.stdout:Total 25 MB/s | 84 MB 00:03 2024-09-16T07:42:59.228 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:42:59.273 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:42:59.274 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:42:59.365 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:42:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T07:42:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T07:42:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T07:42:59.557 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T07:42:59.602 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T07:42:59.635 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T07:42:59.727 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T07:42:59.812 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T07:42:59.854 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T07:42:59.889 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T07:42:59.919 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T07:42:59.954 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T07:42:59.987 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T07:43:00.027 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T07:43:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T07:43:00.086 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:43:00.087 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:43:00.104 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T07:43:00.152 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T07:43:00.184 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T07:43:00.256 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T07:43:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T07:43:00.483 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T07:43:00.536 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T07:43:00.575 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T07:43:00.623 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T07:43:00.679 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T07:43:00.876 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T07:43:00.929 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T07:43:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T07:43:01.095 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T07:43:01.147 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T07:43:01.281 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T07:43:01.505 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T07:43:01.532 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:43:01.557 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:43:01.558 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:43:01.558 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T07:43:01.558 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:43:01.558 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:43:01.558 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:01.793 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:43:01.876 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T07:43:01.910 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T07:43:01.937 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T07:43:02.004 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T07:43:02.053 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T07:43:02.086 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T07:43:02.183 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T07:43:02.259 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T07:43:02.305 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T07:43:02.341 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T07:43:02.369 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T07:43:02.404 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T07:43:02.437 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T07:43:02.478 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T07:43:02.522 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T07:43:02.555 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T07:43:02.605 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T07:43:02.644 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T07:43:02.721 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T07:43:02.884 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T07:43:02.971 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T07:43:03.024 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T07:43:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T07:43:03.120 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T07:43:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T07:43:03.380 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T07:43:03.423 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T07:43:03.504 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T07:43:03.594 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T07:43:03.644 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T07:43:03.785 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T07:43:03.993 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T07:43:04.023 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:43:04.052 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:43:04.052 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:43:04.053 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T07:43:04.053 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:43:04.053 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:43:04.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:12.140 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:43:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:43:12.168 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:43:12.168 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T07:43:12.168 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:43:12.168 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:43:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:12.724 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:43:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:43:12.749 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:43:12.749 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T07:43:12.749 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:43:12.749 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:43:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:12.991 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:43:13.018 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:43:13.018 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:43:13.019 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T07:43:13.019 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:43:13.019 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:43:13.019 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:13.081 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:43:15.240 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:43:15.269 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:43:15.269 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:43:15.269 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T07:43:15.269 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:43:15.270 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:43:15.270 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:15.832 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:43:15.858 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:43:15.858 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:43:15.858 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T07:43:15.858 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:43:15.858 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:43:15.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:16.108 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:43:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:43:16.133 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:43:16.133 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T07:43:16.133 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:43:16.133 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:43:16.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:16.199 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:43:19.881 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:43:19.881 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T07:43:19.881 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T07:43:19.881 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T07:43:19.881 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T07:43:19.881 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T07:43:19.881 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T07:43:19.881 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T07:43:19.882 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T07:43:19.882 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T07:43:19.882 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T07:43:19.882 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T07:43:19.882 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T07:43:19.882 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T07:43:19.882 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T07:43:19.882 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T07:43:19.882 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T07:43:19.882 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T07:43:19.882 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T07:43:19.882 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T07:43:19.882 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T07:43:19.883 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T07:43:19.883 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T07:43:19.883 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T07:43:19.883 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T07:43:19.883 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T07:43:19.883 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T07:43:19.883 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T07:43:19.883 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T07:43:19.883 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T07:43:19.883 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T07:43:19.883 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T07:43:19.883 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T07:43:19.883 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T07:43:19.884 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T07:43:19.884 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T07:43:19.884 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T07:43:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T07:43:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:20.821 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:43:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:43:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:43:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:43:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:43:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:43:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T07:43:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T07:43:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T07:43:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T07:43:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T07:43:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T07:43:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T07:43:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T07:43:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T07:43:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T07:43:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T07:43:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T07:43:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T07:43:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T07:43:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T07:43:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T07:43:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T07:43:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T07:43:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T07:43:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T07:43:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T07:43:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T07:43:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T07:43:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T07:43:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T07:43:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T07:43:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T07:43:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T07:43:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T07:43:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T07:43:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T07:43:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:20.826 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:43:21.113 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-base 2024-09-16T07:43:21.683 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:22 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:21.774 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:43:21.816 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:43:21.817 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-16T07:43:21.817 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:43:21.897 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install cephadm 2024-09-16T07:43:22.456 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:23 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:22.587 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:43:22.588 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:22.588 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-16T07:43:22.588 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:22.589 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:43:22.589 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T07:43:22.589 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:22.589 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:43:22.589 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:22.589 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-16T07:43:22.589 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:22.589 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 785 k 2024-09-16T07:43:22.592 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 791 k 2024-09-16T07:43:22.592 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:43:22.882 INFO:teuthology.orchestra.run.smithi134.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 2.6 MB/s | 785 kB 00:00 2024-09-16T07:43:22.883 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:43:22.883 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.6 MB/s | 785 kB 00:00 2024-09-16T07:43:22.883 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:43:22.888 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:43:22.888 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:43:22.894 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:43:22.895 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:43:22.902 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:43:22.902 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T07:43:22.902 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T07:43:22.902 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T07:43:22.902 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T07:43:22.902 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T07:43:22.902 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T07:43:22.902 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T07:43:22.902 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T07:43:22.902 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T07:43:22.902 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T07:43:22.903 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T07:43:22.903 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T07:43:22.903 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T07:43:22.903 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T07:43:22.903 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T07:43:22.903 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T07:43:22.903 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T07:43:22.903 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T07:43:22.903 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T07:43:22.903 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T07:43:22.903 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T07:43:22.903 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T07:43:22.903 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T07:43:22.904 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T07:43:22.904 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T07:43:22.904 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T07:43:22.904 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T07:43:22.905 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T07:43:22.905 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T07:43:22.905 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T07:43:22.905 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T07:43:22.905 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T07:43:22.906 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T07:43:22.906 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T07:43:22.906 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T07:43:22.906 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T07:43:22.967 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:43:23.428 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:43:23.519 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:43:23.871 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:43:23.939 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T07:43:23.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:23.940 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:43:23.940 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:43:23.940 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:43:23.940 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:43:23.940 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:23.940 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:43:23.940 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:43:23.940 INFO:teuthology.orchestra.run.smithi003.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T07:43:23.940 INFO:teuthology.orchestra.run.smithi003.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T07:43:23.940 INFO:teuthology.orchestra.run.smithi003.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T07:43:23.941 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T07:43:23.941 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T07:43:23.941 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T07:43:23.941 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T07:43:23.941 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T07:43:23.941 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T07:43:23.941 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T07:43:23.941 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T07:43:23.941 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T07:43:23.941 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T07:43:23.941 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T07:43:23.941 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T07:43:23.942 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T07:43:23.942 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T07:43:23.942 INFO:teuthology.orchestra.run.smithi003.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T07:43:23.942 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T07:43:23.942 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T07:43:23.942 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T07:43:23.942 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T07:43:23.942 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T07:43:23.942 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T07:43:23.942 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T07:43:23.942 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T07:43:23.942 INFO:teuthology.orchestra.run.smithi003.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T07:43:23.942 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T07:43:23.942 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T07:43:23.943 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T07:43:23.943 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T07:43:23.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:23.943 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:43:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:43:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:24.128 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:43:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:24.128 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:43:24.196 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-base 2024-09-16T07:43:24.371 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T07:43:24.784 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:25 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:24.878 INFO:teuthology.orchestra.run.smithi003.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:43:24.924 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:43:24.925 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-16T07:43:24.925 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:43:24.956 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:25 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:25.000 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install cephadm 2024-09-16T07:43:25.093 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:43:25.093 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:25.094 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-09-16T07:43:25.094 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:25.094 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:43:25.094 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T07:43:25.094 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:25.094 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:43:25.094 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:25.094 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-16T07:43:25.094 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:25.094 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 158 k 2024-09-16T07:43:25.094 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 644 k 2024-09-16T07:43:25.094 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:43:25.304 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 754 kB/s | 158 kB 00:00 2024-09-16T07:43:25.305 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:43:25.305 INFO:teuthology.orchestra.run.smithi134.stdout:Total 749 kB/s | 158 kB 00:00 2024-09-16T07:43:25.305 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:43:25.314 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:43:25.314 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:43:25.372 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:43:25.372 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:43:25.520 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:43:25.588 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:26 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:43:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:43:25.622 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:43:25.622 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T07:43:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:25.726 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:43:25.727 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:25.727 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-16T07:43:25.727 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:25.728 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:43:25.728 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T07:43:25.728 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:25.728 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:43:25.728 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:25.728 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-16T07:43:25.729 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:25.729 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 785 k 2024-09-16T07:43:25.729 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 791 k 2024-09-16T07:43:25.729 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:43:26.593 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:43:26.594 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:26.594 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:43:26.594 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:43:26.594 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:26.594 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:43:26.782 INFO:teuthology.orchestra.run.smithi003.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 745 kB/s | 785 kB 00:01 2024-09-16T07:43:26.783 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:43:26.783 INFO:teuthology.orchestra.run.smithi003.stdout:Total 744 kB/s | 785 kB 00:01 2024-09-16T07:43:26.783 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:43:26.790 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:43:26.790 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:43:26.797 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:43:26.797 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:43:26.825 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr 2024-09-16T07:43:26.878 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:43:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:43:27.402 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:28 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:43:27.495 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:43:27.538 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:43:27.539 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-16T07:43:27.539 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:43:27.627 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T07:43:27.799 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:43:28.061 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:43:28.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:28.062 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:43:28.062 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:28.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:28.062 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:43:28.189 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:29 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:28.270 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T07:43:28.323 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:43:28.324 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-16T07:43:28.324 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:28.324 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:43:28.324 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T07:43:28.325 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-16T07:43:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T07:43:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T07:43:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T07:43:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T07:43:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T07:43:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T07:43:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T07:43:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T07:43:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T07:43:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T07:43:28.325 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:28.326 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:43:28.326 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:28.326 INFO:teuthology.orchestra.run.smithi134.stdout:Install 11 Packages 2024-09-16T07:43:28.326 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:28.326 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 18 M 2024-09-16T07:43:28.327 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 155 M 2024-09-16T07:43:28.327 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:43:28.867 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:29 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:29.006 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:43:29.007 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:29.007 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2024-09-16T07:43:29.007 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:29.007 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:43:29.008 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T07:43:29.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:29.008 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:43:29.008 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:29.008 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-16T07:43:29.008 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:29.008 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 158 k 2024-09-16T07:43:29.008 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 644 k 2024-09-16T07:43:29.008 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:43:29.240 INFO:teuthology.orchestra.run.smithi134.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 229 kB/s | 34 kB 00:00 2024-09-16T07:43:29.254 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 643 kB/s | 158 kB 00:00 2024-09-16T07:43:29.254 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:43:29.255 INFO:teuthology.orchestra.run.smithi003.stdout:Total 639 kB/s | 158 kB 00:00 2024-09-16T07:43:29.255 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:43:29.265 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:43:29.266 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:43:29.328 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:43:29.328 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:43:29.474 INFO:teuthology.orchestra.run.smithi134.stdout:(2/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-09-16T07:43:29.476 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:43:29.564 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:43:29.589 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:43:29.590 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:43:29.590 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T07:43:29.590 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:30.325 INFO:teuthology.orchestra.run.smithi134.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 1.0 MB/s | 863 kB 00:00 2024-09-16T07:43:30.391 INFO:teuthology.orchestra.run.smithi134.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 8.1 MB/s | 548 kB 00:00 2024-09-16T07:43:30.416 INFO:teuthology.orchestra.run.smithi134.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-16T07:43:30.480 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:43:30.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:30.481 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:43:30.481 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:43:30.481 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:30.481 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:43:30.492 INFO:teuthology.orchestra.run.smithi134.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-16T07:43:30.517 INFO:teuthology.orchestra.run.smithi134.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-16T07:43:30.542 INFO:teuthology.orchestra.run.smithi134.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-16T07:43:30.568 INFO:teuthology.orchestra.run.smithi134.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-16T07:43:30.682 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr 2024-09-16T07:43:31.085 INFO:teuthology.orchestra.run.smithi134.stdout:(10/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 7.1 MB/s | 14 MB 00:01 2024-09-16T07:43:31.268 INFO:teuthology.orchestra.run.smithi134.stdout:(11/11): ceph-prometheus-alerts-19.3.0-4879.g81 7.5 kB/s | 16 kB 00:02 2024-09-16T07:43:31.271 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:43:31.272 INFO:teuthology.orchestra.run.smithi134.stdout:Total 6.2 MB/s | 18 MB 00:02 2024-09-16T07:43:31.272 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:32 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:31.305 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:43:31.325 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:43:31.325 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:43:31.367 INFO:teuthology.orchestra.run.smithi003.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:43:31.412 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:43:31.413 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-16T07:43:31.413 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:43:31.484 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T07:43:31.584 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:43:31.584 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:43:32.074 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:33 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:32.149 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:43:32.214 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:43:32.215 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:32.215 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-16T07:43:32.215 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:32.215 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:43:32.215 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T07:43:32.216 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-16T07:43:32.216 INFO:teuthology.orchestra.run.smithi003.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T07:43:32.216 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T07:43:32.216 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T07:43:32.216 INFO:teuthology.orchestra.run.smithi003.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T07:43:32.216 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T07:43:32.216 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T07:43:32.216 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T07:43:32.216 INFO:teuthology.orchestra.run.smithi003.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T07:43:32.217 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T07:43:32.217 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T07:43:32.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:32.217 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:43:32.217 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:32.217 INFO:teuthology.orchestra.run.smithi003.stdout:Install 11 Packages 2024-09-16T07:43:32.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:32.218 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 18 M 2024-09-16T07:43:32.218 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 155 M 2024-09-16T07:43:32.218 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:43:32.232 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T07:43:32.271 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T07:43:32.363 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T07:43:32.496 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T07:43:32.549 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T07:43:32.631 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T07:43:32.684 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T07:43:32.722 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:43:32.754 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T07:43:32.990 INFO:teuthology.orchestra.run.smithi003.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4879.g81f 72 kB/s | 16 kB 00:00 2024-09-16T07:43:33.016 INFO:teuthology.orchestra.run.smithi003.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4879.g81 134 kB/s | 34 kB 00:00 2024-09-16T07:43:33.316 INFO:teuthology.orchestra.run.smithi003.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.8 MB/s | 863 kB 00:00 2024-09-16T07:43:33.366 INFO:teuthology.orchestra.run.smithi003.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-16T07:43:33.391 INFO:teuthology.orchestra.run.smithi003.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-16T07:43:33.466 INFO:teuthology.orchestra.run.smithi003.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-16T07:43:33.492 INFO:teuthology.orchestra.run.smithi003.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-16T07:43:33.517 INFO:teuthology.orchestra.run.smithi003.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-16T07:43:33.542 INFO:teuthology.orchestra.run.smithi003.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 7.5 MB/s | 188 kB 00:00 2024-09-16T07:43:33.793 INFO:teuthology.orchestra.run.smithi003.stdout:(10/11): python3-protobuf-3.14.0-13.el9.noarch. 336 kB/s | 269 kB 00:00 2024-09-16T07:43:34.434 INFO:teuthology.orchestra.run.smithi003.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 8.5 MB/s | 14 MB 00:01 2024-09-16T07:43:34.438 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:43:34.439 INFO:teuthology.orchestra.run.smithi003.stdout:Total 8.2 MB/s | 18 MB 00:02 2024-09-16T07:43:34.473 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:43:34.495 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:43:34.495 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:43:34.772 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:43:34.772 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:43:35.342 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:43:35.418 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T07:43:35.454 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T07:43:35.546 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T07:43:35.688 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T07:43:35.734 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T07:43:35.821 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T07:43:35.869 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T07:43:35.896 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:43:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T07:43:35.921 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T07:43:35.966 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:43:37.905 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:43:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T07:43:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T07:43:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T07:43:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T07:43:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T07:43:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T07:43:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T07:43:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:43:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T07:43:37.907 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T07:43:38.209 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T07:43:38.209 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:38.209 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:43:38.209 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T07:43:38.209 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:38.209 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:38.209 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:38.209 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T07:43:38.209 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T07:43:38.209 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T07:43:38.210 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T07:43:38.210 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T07:43:38.210 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T07:43:38.210 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T07:43:38.210 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:38.210 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:43:38.469 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T07:43:39.034 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:40 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:39.168 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:43:39.169 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-09-16T07:43:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-16T07:43:39.169 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-09-16T07:43:39.169 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:43:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T07:43:39.169 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-16T07:43:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T07:43:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T07:43:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T07:43:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T07:43:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T07:43:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T07:43:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T07:43:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T07:43:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T07:43:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T07:43:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T07:43:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:39.170 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:43:39.170 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-09-16T07:43:39.170 INFO:teuthology.orchestra.run.smithi134.stdout:Install 12 Packages 2024-09-16T07:43:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:39.171 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 38 M 2024-09-16T07:43:39.171 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 212 M 2024-09-16T07:43:39.171 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:43:39.307 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T07:43:39.365 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:43:39.373 INFO:teuthology.orchestra.run.smithi134.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-16T07:43:39.398 INFO:teuthology.orchestra.run.smithi134.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.9 MB/s | 801 kB 00:00 2024-09-16T07:43:39.465 INFO:teuthology.orchestra.run.smithi134.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-09-16T07:43:39.515 INFO:teuthology.orchestra.run.smithi134.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-09-16T07:43:39.557 INFO:teuthology.orchestra.run.smithi134.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 926 kB/s | 38 kB 00:00 2024-09-16T07:43:39.716 INFO:teuthology.orchestra.run.smithi134.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-48 15 MB/s | 7.4 MB 00:00 2024-09-16T07:43:39.924 INFO:teuthology.orchestra.run.smithi134.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.7 MB/s | 3.0 MB 00:00 2024-09-16T07:43:39.949 INFO:teuthology.orchestra.run.smithi134.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.0 MB/s | 245 kB 00:00 2024-09-16T07:43:40.009 INFO:teuthology.orchestra.run.smithi134.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-09-16T07:43:40.367 INFO:teuthology.orchestra.run.smithi134.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 6.1 MB/s | 4.9 MB 00:00 2024-09-16T07:43:40.442 INFO:teuthology.orchestra.run.smithi134.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.9 MB/s | 5.1 MB 00:00 2024-09-16T07:43:40.976 INFO:teuthology.orchestra.run.smithi134.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-16T07:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:43:40.977 INFO:teuthology.orchestra.run.smithi134.stdout:Total 21 MB/s | 38 MB 00:01 2024-09-16T07:43:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:43:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T07:43:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T07:43:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T07:43:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T07:43:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T07:43:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T07:43:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T07:43:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:43:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T07:43:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T07:43:41.333 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:43:41.359 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:43:41.359 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:43:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T07:43:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:41.560 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:43:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T07:43:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T07:43:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T07:43:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T07:43:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T07:43:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T07:43:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T07:43:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T07:43:41.563 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:41.563 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:43:41.803 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:43:41.804 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:43:41.819 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T07:43:42.408 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:43 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:42.549 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:43:42.550 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2024-09-16T07:43:42.550 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-16T07:43:42.550 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2024-09-16T07:43:42.550 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:43:42.550 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T07:43:42.550 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-16T07:43:42.550 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T07:43:42.550 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T07:43:42.550 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T07:43:42.551 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T07:43:42.551 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T07:43:42.551 INFO:teuthology.orchestra.run.smithi003.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T07:43:42.551 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T07:43:42.551 INFO:teuthology.orchestra.run.smithi003.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T07:43:42.551 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T07:43:42.551 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T07:43:42.551 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T07:43:42.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:42.552 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:43:42.552 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2024-09-16T07:43:42.552 INFO:teuthology.orchestra.run.smithi003.stdout:Install 12 Packages 2024-09-16T07:43:42.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:42.552 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 38 M 2024-09-16T07:43:42.553 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 212 M 2024-09-16T07:43:42.553 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:43:42.582 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:43:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T07:43:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:43:42.796 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:43:42.797 INFO:teuthology.orchestra.run.smithi003.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-16T07:43:42.833 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T07:43:42.847 INFO:teuthology.orchestra.run.smithi003.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.6 MB/s | 801 kB 00:00 2024-09-16T07:43:42.889 INFO:teuthology.orchestra.run.smithi003.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-09-16T07:43:42.956 INFO:teuthology.orchestra.run.smithi003.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 273 kB/s | 18 kB 00:00 2024-09-16T07:43:43.016 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T07:43:43.040 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T07:43:43.056 INFO:teuthology.orchestra.run.smithi003.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2024-09-16T07:43:43.076 INFO:teuthology.orchestra.run.smithi003.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 329 kB/s | 38 kB 00:00 2024-09-16T07:43:43.124 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T07:43:43.182 INFO:teuthology.orchestra.run.smithi003.stdout:(7/12): ceph-mgr-diskprediction-local-19.3.0-48 15 MB/s | 7.4 MB 00:00 2024-09-16T07:43:43.425 INFO:teuthology.orchestra.run.smithi003.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-16T07:43:43.425 INFO:teuthology.orchestra.run.smithi003.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 20 MB/s | 4.9 MB 00:00 2024-09-16T07:43:43.425 INFO:teuthology.orchestra.run.smithi003.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-09-16T07:43:43.500 INFO:teuthology.orchestra.run.smithi003.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-16T07:43:43.771 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T07:43:43.825 INFO:teuthology.orchestra.run.smithi003.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-16T07:43:43.826 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:43:43.826 INFO:teuthology.orchestra.run.smithi003.stdout:Total 30 MB/s | 38 MB 00:01 2024-09-16T07:43:43.886 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T07:43:44.190 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:43:44.218 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:43:44.218 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:43:44.676 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:43:44.677 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:43:45.115 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:43:45.602 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:43:45.666 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T07:43:45.715 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:43:45.819 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:43:45.866 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T07:43:46.059 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T07:43:46.098 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T07:43:46.145 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T07:43:46.177 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T07:43:46.180 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:43:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T07:43:46.990 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T07:43:48.305 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:43:48.832 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:43:48.832 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T07:43:48.832 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:43:48.832 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:43:48.832 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T07:43:48.832 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T07:43:48.832 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T07:43:48.832 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T07:43:48.833 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T07:43:48.833 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T07:43:48.833 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:43:48.833 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T07:43:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T07:43:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:49.260 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:43:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T07:43:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T07:43:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T07:43:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T07:43:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T07:43:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T07:43:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T07:43:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T07:43:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T07:43:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T07:43:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T07:43:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:49.262 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:43:49.378 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T07:43:49.405 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:43:49.660 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-rook 2024-09-16T07:43:50.238 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:51 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:50.372 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:43:50.373 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:50.373 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-16T07:43:50.374 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:50.374 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:43:50.374 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T07:43:50.374 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-16T07:43:50.374 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T07:43:50.374 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T07:43:50.374 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T07:43:50.374 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T07:43:50.374 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T07:43:50.374 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T07:43:50.374 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T07:43:50.374 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T07:43:50.374 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T07:43:50.375 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T07:43:50.375 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T07:43:50.375 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T07:43:50.375 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:50.375 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:43:50.375 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:50.375 INFO:teuthology.orchestra.run.smithi134.stdout:Install 13 Packages 2024-09-16T07:43:50.375 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:50.375 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 2.2 M 2024-09-16T07:43:50.376 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 26 M 2024-09-16T07:43:50.376 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:43:50.862 INFO:teuthology.orchestra.run.smithi134.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 183 kB/s | 26 kB 00:00 2024-09-16T07:43:50.887 INFO:teuthology.orchestra.run.smithi134.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 116 kB/s | 19 kB 00:00 2024-09-16T07:43:50.912 INFO:teuthology.orchestra.run.smithi134.stdout:(3/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 259 kB/s | 49 kB 00:00 2024-09-16T07:43:51.029 INFO:teuthology.orchestra.run.smithi134.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-09-16T07:43:51.055 INFO:teuthology.orchestra.run.smithi134.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 949 kB/s | 159 kB 00:00 2024-09-16T07:43:51.088 INFO:teuthology.orchestra.run.smithi134.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 914 kB/s | 54 kB 00:00 2024-09-16T07:43:51.122 INFO:teuthology.orchestra.run.smithi134.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 482 kB/s | 32 kB 00:00 2024-09-16T07:43:51.147 INFO:teuthology.orchestra.run.smithi134.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-16T07:43:51.172 INFO:teuthology.orchestra.run.smithi134.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 172 kB/s | 14 kB 00:00 2024-09-16T07:43:51.206 INFO:teuthology.orchestra.run.smithi134.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-16T07:43:51.231 INFO:teuthology.orchestra.run.smithi134.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-16T07:43:51.256 INFO:teuthology.orchestra.run.smithi134.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-16T07:43:51.298 INFO:teuthology.orchestra.run.smithi134.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-16T07:43:51.301 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:43:51.301 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-09-16T07:43:51.364 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:43:51.379 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:43:51.379 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:43:51.470 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:43:51.470 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:43:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:43:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T07:43:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:43:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:43:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T07:43:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T07:43:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T07:43:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T07:43:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T07:43:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T07:43:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:43:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T07:43:51.976 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:43:52.147 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T07:43:52.200 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T07:43:52.255 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T07:43:52.301 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T07:43:52.342 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T07:43:52.343 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T07:43:52.343 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:52.343 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:43:52.343 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:52.344 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T07:43:52.344 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T07:43:52.344 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T07:43:52.344 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T07:43:52.344 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T07:43:52.344 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T07:43:52.344 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T07:43:52.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T07:43:52.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T07:43:52.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T07:43:52.344 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T07:43:52.344 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:52.344 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:43:52.444 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T07:43:52.555 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T07:43:52.610 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T07:43:52.713 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-rook 2024-09-16T07:43:53.311 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:54 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:53.328 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T07:43:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T07:43:53.416 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T07:43:53.453 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:43:53.454 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:53.454 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-16T07:43:53.455 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:53.455 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:43:53.455 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T07:43:53.455 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-16T07:43:53.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T07:43:53.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T07:43:53.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T07:43:53.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T07:43:53.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T07:43:53.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T07:43:53.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T07:43:53.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T07:43:53.455 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T07:43:53.456 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T07:43:53.456 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T07:43:53.456 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T07:43:53.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:53.456 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:43:53.456 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:53.456 INFO:teuthology.orchestra.run.smithi003.stdout:Install 13 Packages 2024-09-16T07:43:53.456 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:53.457 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 2.2 M 2024-09-16T07:43:53.457 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 26 M 2024-09-16T07:43:53.457 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:43:53.472 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T07:43:53.503 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:43:53.647 INFO:teuthology.orchestra.run.smithi003.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 237 kB/s | 19 kB 00:00 2024-09-16T07:43:53.672 INFO:teuthology.orchestra.run.smithi003.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 242 kB/s | 26 kB 00:00 2024-09-16T07:43:53.730 INFO:teuthology.orchestra.run.smithi003.stdout:(3/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 299 kB/s | 49 kB 00:00 2024-09-16T07:43:53.756 INFO:teuthology.orchestra.run.smithi003.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-16T07:43:53.789 INFO:teuthology.orchestra.run.smithi003.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-16T07:43:53.814 INFO:teuthology.orchestra.run.smithi003.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 918 kB/s | 54 kB 00:00 2024-09-16T07:43:53.865 INFO:teuthology.orchestra.run.smithi003.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 428 kB/s | 32 kB 00:00 2024-09-16T07:43:53.890 INFO:teuthology.orchestra.run.smithi003.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 187 kB/s | 14 kB 00:00 2024-09-16T07:43:53.915 INFO:teuthology.orchestra.run.smithi003.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-16T07:43:53.949 INFO:teuthology.orchestra.run.smithi003.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-16T07:43:53.983 INFO:teuthology.orchestra.run.smithi003.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.8 MB/s | 90 kB 00:00 2024-09-16T07:43:54.008 INFO:teuthology.orchestra.run.smithi003.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 643 kB/s | 59 kB 00:00 2024-09-16T07:43:54.041 INFO:teuthology.orchestra.run.smithi003.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-16T07:43:54.044 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:43:54.044 INFO:teuthology.orchestra.run.smithi003.stdout:Total 3.8 MB/s | 2.2 MB 00:00 2024-09-16T07:43:54.110 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:43:54.126 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:43:54.126 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:43:54.222 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:43:54.223 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:43:54.296 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:43:54.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T07:43:54.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T07:43:54.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T07:43:54.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T07:43:54.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T07:43:54.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T07:43:54.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T07:43:54.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T07:43:54.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T07:43:54.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T07:43:54.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T07:43:54.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T07:43:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T07:43:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:54.621 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:43:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T07:43:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T07:43:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T07:43:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T07:43:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T07:43:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T07:43:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T07:43:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T07:43:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T07:43:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T07:43:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T07:43:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T07:43:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:54.622 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:43:54.858 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:43:54.880 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T07:43:55.033 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T07:43:55.087 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T07:43:55.143 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T07:43:55.178 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T07:43:55.220 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T07:43:55.327 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T07:43:55.438 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T07:43:55.449 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:56 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:55.488 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T07:43:55.584 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:43:55.584 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:55.585 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-16T07:43:55.585 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:55.585 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:43:55.585 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T07:43:55.585 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-16T07:43:55.586 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T07:43:55.586 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T07:43:55.586 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T07:43:55.586 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T07:43:55.586 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T07:43:55.587 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:55.587 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:43:55.587 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:55.587 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2024-09-16T07:43:55.587 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:55.588 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 7.0 M 2024-09-16T07:43:55.588 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 33 M 2024-09-16T07:43:55.589 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:43:55.908 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-09-16T07:43:55.975 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 740 kB/s | 154 kB 00:00 2024-09-16T07:43:56.067 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-16T07:43:56.092 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.9 MB/s | 548 kB 00:00 2024-09-16T07:43:56.117 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 406 kB/s | 58 kB 00:00 2024-09-16T07:43:56.143 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): python3-typing-extensions-4.12.2-2.el9.n 1.0 MB/s | 74 kB 00:00 2024-09-16T07:43:56.146 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:43:56.146 INFO:teuthology.orchestra.run.smithi134.stdout:Total 13 MB/s | 7.0 MB 00:00 2024-09-16T07:43:56.216 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:43:56.227 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:43:56.227 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:43:56.264 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T07:43:56.326 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T07:43:56.327 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:43:56.328 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:43:56.359 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T07:43:56.409 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T07:43:56.436 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:43:56.646 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:43:56.814 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T07:43:56.861 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T07:43:57.210 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:43:57.211 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T07:43:57.211 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T07:43:57.211 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T07:43:57.211 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T07:43:57.211 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T07:43:57.211 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T07:43:57.211 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T07:43:57.211 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T07:43:57.211 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T07:43:57.211 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T07:43:57.211 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T07:43:57.211 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T07:43:57.374 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T07:43:57.457 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T07:43:57.532 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T07:43:57.550 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T07:43:57.550 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:57.550 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:43:57.550 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:57.550 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T07:43:57.550 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T07:43:57.550 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T07:43:57.550 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T07:43:57.550 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T07:43:57.550 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T07:43:57.550 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T07:43:57.551 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T07:43:57.551 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T07:43:57.551 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T07:43:57.551 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T07:43:57.551 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T07:43:57.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:57.551 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:43:57.556 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:43:57.822 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T07:43:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:43:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T07:43:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T07:43:58.309 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T07:43:58.309 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T07:43:58.309 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T07:43:58.413 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:59 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:58.553 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:43:58.554 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:58.554 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-16T07:43:58.554 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:58.554 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:43:58.554 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T07:43:58.554 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-16T07:43:58.554 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T07:43:58.555 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T07:43:58.555 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T07:43:58.555 INFO:teuthology.orchestra.run.smithi003.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T07:43:58.555 INFO:teuthology.orchestra.run.smithi003.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T07:43:58.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:58.555 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:43:58.555 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:43:58.555 INFO:teuthology.orchestra.run.smithi003.stdout:Install 6 Packages 2024-09-16T07:43:58.555 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:43:58.556 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 7.0 M 2024-09-16T07:43:58.556 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 33 M 2024-09-16T07:43:58.556 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:43:58.589 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T07:43:58.589 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:58.589 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:43:58.589 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:43:58.590 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T07:43:58.590 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T07:43:58.590 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T07:43:58.590 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T07:43:58.590 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T07:43:58.590 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:58.590 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:43:58.856 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-fuse 2024-09-16T07:43:58.908 INFO:teuthology.orchestra.run.smithi003.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.9 MB/s | 248 kB 00:00 2024-09-16T07:43:58.992 INFO:teuthology.orchestra.run.smithi003.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.5 MB/s | 548 kB 00:00 2024-09-16T07:43:59.029 INFO:teuthology.orchestra.run.smithi003.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.7 MB/s | 58 kB 00:00 2024-09-16T07:43:59.051 INFO:teuthology.orchestra.run.smithi003.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-16T07:43:59.126 INFO:teuthology.orchestra.run.smithi003.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-16T07:43:59.309 INFO:teuthology.orchestra.run.smithi003.stdout:(6/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 291 kB/s | 154 kB 00:00 2024-09-16T07:43:59.311 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:43:59.311 INFO:teuthology.orchestra.run.smithi003.stdout:Total 9.3 MB/s | 7.0 MB 00:00 2024-09-16T07:43:59.383 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:43:59.395 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:43:59.395 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:43:59.426 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:00 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:43:59.502 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:43:59.502 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:43:59.562 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:43:59.563 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:59.563 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-16T07:43:59.563 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:59.563 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:43:59.563 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T07:43:59.563 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-16T07:43:59.563 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T07:43:59.563 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:59.564 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:43:59.564 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:43:59.564 INFO:teuthology.orchestra.run.smithi134.stdout:Install 2 Packages 2024-09-16T07:43:59.564 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:43:59.564 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 964 k 2024-09-16T07:43:59.564 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 4.1 M 2024-09-16T07:43:59.565 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:43:59.822 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:43:59.961 INFO:teuthology.orchestra.run.smithi134.stdout:(1/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 3.1 MB/s | 884 kB 00:00 2024-09-16T07:43:59.999 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T07:44:00.054 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T07:44:00.369 INFO:teuthology.orchestra.run.smithi134.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 117 kB/s | 80 kB 00:00 2024-09-16T07:44:00.369 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:44:00.370 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.2 MB/s | 964 kB 00:00 2024-09-16T07:44:00.382 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:44:00.406 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:44:00.406 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:44:00.486 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:44:00.487 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:44:00.611 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T07:44:00.674 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:44:00.700 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T07:44:00.793 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T07:44:00.821 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T07:44:00.823 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:44:00.901 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:44:01.587 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:44:01.588 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T07:44:01.588 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T07:44:01.588 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T07:44:01.588 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T07:44:01.588 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T07:44:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:44:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T07:44:01.865 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T07:44:01.865 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:01.865 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:44:01.865 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:44:01.865 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T07:44:01.865 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T07:44:01.865 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T07:44:01.866 INFO:teuthology.orchestra.run.smithi003.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T07:44:01.866 INFO:teuthology.orchestra.run.smithi003.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T07:44:01.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:01.866 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:01.872 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T07:44:01.872 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:01.872 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:44:01.872 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T07:44:01.872 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:01.872 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:44:02.107 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-fuse 2024-09-16T07:44:02.181 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-volume 2024-09-16T07:44:02.696 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:03 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:02.764 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:03 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:02.836 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:44:02.836 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-16T07:44:02.837 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:02.837 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:44:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T07:44:02.837 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-16T07:44:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T07:44:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:02.837 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:44:02.837 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:02.837 INFO:teuthology.orchestra.run.smithi003.stdout:Install 2 Packages 2024-09-16T07:44:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:02.838 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 964 k 2024-09-16T07:44:02.838 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 4.1 M 2024-09-16T07:44:02.838 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:44:02.904 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:44:02.905 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:02.905 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-16T07:44:02.906 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:02.906 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:44:02.906 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T07:44:02.906 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:02.906 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:44:02.906 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:02.906 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-16T07:44:02.906 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:02.906 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 285 k 2024-09-16T07:44:02.906 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 1.3 M 2024-09-16T07:44:02.906 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:44:03.111 INFO:teuthology.orchestra.run.smithi003.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 545 kB/s | 80 kB 00:00 2024-09-16T07:44:03.139 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-16T07:44:03.140 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:44:03.140 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-16T07:44:03.140 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:44:03.149 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:44:03.149 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:44:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:44:03.176 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:44:03.245 INFO:teuthology.orchestra.run.smithi003.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 3.1 MB/s | 884 kB 00:00 2024-09-16T07:44:03.245 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:44:03.246 INFO:teuthology.orchestra.run.smithi003.stdout:Total 2.3 MB/s | 964 kB 00:00 2024-09-16T07:44:03.258 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:44:03.283 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:44:03.284 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:44:03.369 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:44:03.369 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:44:03.400 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:44:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:44:03.499 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:44:03.499 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:44:03.499 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T07:44:03.500 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:03.564 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:44:03.719 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T07:44:03.798 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:44:04.490 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:44:04.490 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T07:44:04.538 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:44:04.538 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:04.538 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:44:04.538 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:44:04.538 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:04.538 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:44:04.773 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T07:44:04.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:04.774 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:44:04.774 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T07:44:04.774 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:04.774 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:04.860 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados-devel 2024-09-16T07:44:05.064 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-volume 2024-09-16T07:44:05.445 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:06 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:05.581 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:44:05.582 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:05.582 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-09-16T07:44:05.582 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:05.582 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:44:05.582 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T07:44:05.582 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:05.582 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:44:05.582 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:05.583 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-16T07:44:05.583 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:05.583 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 125 k 2024-09-16T07:44:05.583 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 445 k 2024-09-16T07:44:05.583 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:44:05.661 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:06 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:05.801 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:44:05.802 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:05.802 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-16T07:44:05.802 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:05.802 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:44:05.802 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T07:44:05.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:05.802 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:44:05.802 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:05.802 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-16T07:44:05.802 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:05.802 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 285 k 2024-09-16T07:44:05.802 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 1.3 M 2024-09-16T07:44:05.802 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:44:05.803 INFO:teuthology.orchestra.run.smithi134.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 569 kB/s | 125 kB 00:00 2024-09-16T07:44:05.803 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:44:05.803 INFO:teuthology.orchestra.run.smithi134.stdout:Total 565 kB/s | 125 kB 00:00 2024-09-16T07:44:05.803 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:44:05.809 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:44:05.809 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:44:05.873 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:44:05.874 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:44:06.029 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:44:06.032 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-16T07:44:06.032 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:44:06.033 INFO:teuthology.orchestra.run.smithi003.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-16T07:44:06.033 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:44:06.042 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:44:06.042 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:44:06.073 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:44:06.074 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:44:06.124 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:06.301 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:44:06.367 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:44:06.384 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:44:06.384 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:44:06.384 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T07:44:06.384 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:06.663 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:06.916 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:44:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:44:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:06.916 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:44:07.181 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs2 2024-09-16T07:44:07.376 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:44:07.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:07.376 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:44:07.376 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:44:07.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:07.376 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:07.661 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librados-devel 2024-09-16T07:44:07.766 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:08 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:07.858 INFO:teuthology.orchestra.run.smithi134.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:44:07.904 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:44:07.905 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-16T07:44:07.905 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:44:07.985 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs-devel 2024-09-16T07:44:08.260 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:09 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:08.399 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:44:08.400 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:08.400 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2024-09-16T07:44:08.400 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:08.400 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:44:08.400 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T07:44:08.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:08.401 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:44:08.401 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:08.401 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-16T07:44:08.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:08.401 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 125 k 2024-09-16T07:44:08.401 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 445 k 2024-09-16T07:44:08.402 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:44:08.555 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:09 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:08.611 INFO:teuthology.orchestra.run.smithi003.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 595 kB/s | 125 kB 00:00 2024-09-16T07:44:08.612 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:44:08.612 INFO:teuthology.orchestra.run.smithi003.stdout:Total 591 kB/s | 125 kB 00:00 2024-09-16T07:44:08.612 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:44:08.618 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:44:08.618 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:44:08.685 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:44:08.686 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:44:08.689 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:44:08.689 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:08.690 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-09-16T07:44:08.690 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:08.690 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:44:08.690 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T07:44:08.690 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:08.690 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:44:08.690 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:08.690 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-16T07:44:08.690 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:08.691 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 32 k 2024-09-16T07:44:08.691 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 142 k 2024-09-16T07:44:08.691 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:44:08.847 INFO:teuthology.orchestra.run.smithi134.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 203 kB/s | 32 kB 00:00 2024-09-16T07:44:08.847 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:44:08.848 INFO:teuthology.orchestra.run.smithi134.stdout:Total 202 kB/s | 32 kB 00:00 2024-09-16T07:44:08.848 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:44:08.850 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:44:08.851 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:44:08.851 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:44:08.870 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:44:08.870 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:44:08.945 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:08.961 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:44:09.068 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:09.382 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:09.667 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:09.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:09.668 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:44:09.668 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:44:09.668 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:09.668 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:09.754 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:09.754 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:09.754 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:44:09.754 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:44:09.754 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:09.754 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:44:09.922 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install libcephfs2 2024-09-16T07:44:09.936 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados2 2024-09-16T07:44:10.504 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:11 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:10.516 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:11 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:10.595 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:44:10.610 INFO:teuthology.orchestra.run.smithi003.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:44:10.638 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:44:10.639 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-16T07:44:10.640 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:44:10.660 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:44:10.661 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-16T07:44:10.661 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:10.719 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librbd1 2024-09-16T07:44:10.743 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install libcephfs-devel 2024-09-16T07:44:11.285 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:12 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:11.339 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:12 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:11.375 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:44:11.418 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:44:11.419 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-16T07:44:11.419 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:44:11.479 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:44:11.480 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:11.480 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2024-09-16T07:44:11.480 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:11.480 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:44:11.480 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T07:44:11.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:11.480 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:44:11.480 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:11.480 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-16T07:44:11.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:11.481 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 32 k 2024-09-16T07:44:11.481 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 142 k 2024-09-16T07:44:11.481 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:44:11.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rados 2024-09-16T07:44:11.689 INFO:teuthology.orchestra.run.smithi003.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 153 kB/s | 32 kB 00:00 2024-09-16T07:44:11.689 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:44:11.689 INFO:teuthology.orchestra.run.smithi003.stdout:Total 152 kB/s | 32 kB 00:00 2024-09-16T07:44:11.690 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:44:11.693 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:44:11.693 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:44:11.707 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:44:11.708 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:44:11.804 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:44:11.922 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:12.062 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:13 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:12.151 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:44:12.195 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-16T07:44:12.196 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:44:12.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rgw 2024-09-16T07:44:12.306 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:12.546 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:12.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:12.546 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:44:12.546 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:44:12.546 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:12.546 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:12.730 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librados2 2024-09-16T07:44:12.845 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:13 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:12.935 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:44:12.978 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:44:12.979 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-16T07:44:12.979 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:44:13.059 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-cephfs 2024-09-16T07:44:13.322 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:14 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:13.415 INFO:teuthology.orchestra.run.smithi003.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:44:13.461 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:44:13.462 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-16T07:44:13.462 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:13.535 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librbd1 2024-09-16T07:44:13.626 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:14 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:13.717 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:44:13.761 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:44:13.762 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-16T07:44:13.762 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:44:13.835 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rbd 2024-09-16T07:44:14.128 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:15 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:14.223 INFO:teuthology.orchestra.run.smithi003.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:44:14.269 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:44:14.270 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-16T07:44:14.270 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:14.340 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rados 2024-09-16T07:44:14.399 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:15 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:14.492 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:44:14.536 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:44:14.537 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-09-16T07:44:14.537 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:44:14.608 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-fuse 2024-09-16T07:44:14.935 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:15 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:15.031 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:44:15.077 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:44:15.078 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-16T07:44:15.078 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:15.150 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rgw 2024-09-16T07:44:15.173 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:16 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:15.307 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:44:15.308 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:15.308 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-16T07:44:15.308 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:15.308 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:44:15.308 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T07:44:15.308 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:15.308 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:44:15.308 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:15.308 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-16T07:44:15.308 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:15.309 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 91 k 2024-09-16T07:44:15.309 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 321 k 2024-09-16T07:44:15.309 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:44:15.500 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 476 kB/s | 91 kB 00:00 2024-09-16T07:44:15.500 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:44:15.501 INFO:teuthology.orchestra.run.smithi134.stdout:Total 473 kB/s | 91 kB 00:00 2024-09-16T07:44:15.501 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:44:15.509 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:44:15.509 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:44:15.573 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:44:15.573 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:44:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:44:15.745 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:16 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:15.815 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:15.838 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:44:15.885 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:44:15.886 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-16T07:44:15.886 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:15.956 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-cephfs 2024-09-16T07:44:16.256 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:16.531 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:44:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:44:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:16.531 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:44:16.551 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:17 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:16.644 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:44:16.691 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:44:16.692 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-16T07:44:16.692 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:16.767 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rbd 2024-09-16T07:44:16.856 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-mirror 2024-09-16T07:44:17.357 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:18 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:17.450 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:44:17.467 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:18 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:17.496 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:44:17.497 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-16T07:44:17.497 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:17.563 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-fuse 2024-09-16T07:44:17.609 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:44:17.609 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-09-16T07:44:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:44:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:44:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:44:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-16T07:44:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 3.5 M 2024-09-16T07:44:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 30 M 2024-09-16T07:44:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:44:17.970 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 9.8 MB/s | 3.5 MB 00:00 2024-09-16T07:44:17.971 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:44:17.972 INFO:teuthology.orchestra.run.smithi134.stdout:Total 9.7 MB/s | 3.5 MB 00:00 2024-09-16T07:44:17.972 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:44:17.983 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:44:17.983 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:44:18.065 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:44:18.067 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:44:18.154 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:19 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:18.294 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:44:18.295 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2024-09-16T07:44:18.295 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:18.295 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:44:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T07:44:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:18.295 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:44:18.295 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:18.295 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-16T07:44:18.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:18.295 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 91 k 2024-09-16T07:44:18.296 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 321 k 2024-09-16T07:44:18.296 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:44:18.483 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 486 kB/s | 91 kB 00:00 2024-09-16T07:44:18.484 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:44:18.484 INFO:teuthology.orchestra.run.smithi003.stdout:Total 482 kB/s | 91 kB 00:00 2024-09-16T07:44:18.484 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:44:18.494 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:44:18.494 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:44:18.561 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:44:18.561 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:44:18.652 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:44:18.712 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:18.713 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:44:18.738 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:18.738 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:44:18.738 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T07:44:18.738 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:44:18.738 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:44:18.738 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:18.825 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:19.231 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:19.499 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:19.500 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:44:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:44:19.500 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:19.500 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:19.877 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-mirror 2024-09-16T07:44:20.008 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:20.009 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:20.009 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:44:20.009 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:44:20.009 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:20.009 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:44:20.307 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-nbd 2024-09-16T07:44:20.491 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:21 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:20.636 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:44:20.637 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:20.637 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2024-09-16T07:44:20.637 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:20.637 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:44:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:44:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:20.638 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:44:20.638 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:20.638 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-16T07:44:20.638 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:20.638 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 3.5 M 2024-09-16T07:44:20.638 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 30 M 2024-09-16T07:44:20.639 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:44:20.884 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:21 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:20.995 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 9.8 MB/s | 3.5 MB 00:00 2024-09-16T07:44:20.995 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:44:20.996 INFO:teuthology.orchestra.run.smithi003.stdout:Total 9.8 MB/s | 3.5 MB 00:00 2024-09-16T07:44:20.996 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:44:21.008 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:44:21.009 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:44:21.018 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-16T07:44:21.019 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:21.019 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-16T07:44:21.020 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:21.020 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-16T07:44:21.020 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T07:44:21.020 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:21.020 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-16T07:44:21.020 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-16T07:44:21.020 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-09-16T07:44:21.020 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:21.020 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 177 k 2024-09-16T07:44:21.021 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 685 k 2024-09-16T07:44:21.021 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-16T07:44:21.097 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:44:21.097 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:44:21.239 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 807 kB/s | 177 kB 00:00 2024-09-16T07:44:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:44:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:Total 801 kB/s | 177 kB 00:00 2024-09-16T07:44:21.240 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-16T07:44:21.250 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-16T07:44:21.250 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-16T07:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-16T07:44:21.319 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-16T07:44:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-16T07:44:21.595 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:21.715 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:44:21.762 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:21.790 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:21.790 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:44:21.790 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T07:44:21.790 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:44:21.791 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:44:21.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:22.024 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:22.311 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:22.311 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:22.311 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-16T07:44:22.311 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:44:22.311 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:22.311 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-16T07:44:22.631 DEBUG:teuthology.parallel:result is None 2024-09-16T07:44:23.062 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:23.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:23.062 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:44:23.062 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:44:23.062 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:23.062 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:23.351 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-nbd 2024-09-16T07:44:23.948 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:02:24 ago on Mon 16 Sep 2024 07:41:59 AM UTC. 2024-09-16T07:44:24.087 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-16T07:44:24.088 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:24.088 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2024-09-16T07:44:24.088 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:24.088 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-16T07:44:24.088 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T07:44:24.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:24.088 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-16T07:44:24.088 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-16T07:44:24.089 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-16T07:44:24.089 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:24.089 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 177 k 2024-09-16T07:44:24.089 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 685 k 2024-09-16T07:44:24.089 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-16T07:44:24.306 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 814 kB/s | 177 kB 00:00 2024-09-16T07:44:24.306 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:44:24.306 INFO:teuthology.orchestra.run.smithi003.stdout:Total 809 kB/s | 177 kB 00:00 2024-09-16T07:44:24.307 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-16T07:44:24.317 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-16T07:44:24.317 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-16T07:44:24.391 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-16T07:44:24.392 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-16T07:44:24.568 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-16T07:44:24.673 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:25.103 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:25.351 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:44:25.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:25.351 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-16T07:44:25.351 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:44:25.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:25.351 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-16T07:44:25.653 DEBUG:teuthology.parallel:result is None 2024-09-16T07:44:25.653 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:44:25.797 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T07:44:25.819 INFO:teuthology.orchestra.run.smithi003.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T07:44:25.820 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T07:44:25.820 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T07:44:25.822 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:44:25.961 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T07:44:25.987 INFO:teuthology.orchestra.run.smithi134.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T07:44:25.987 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T07:44:25.987 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T07:44:25.989 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T07:44:25.990 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:25.990 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T07:44:26.019 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:44:26.019 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T07:44:26.056 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T07:44:26.056 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:26.056 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T07:44:26.087 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T07:44:26.154 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:44:26.154 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T07:44:26.182 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T07:44:26.250 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T07:44:26.250 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:26.250 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T07:44:26.277 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T07:44:26.367 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:44:26.367 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T07:44:26.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T07:44:26.461 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T07:44:26.462 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:26.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T07:44:26.488 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T07:44:26.555 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:44:26.555 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T07:44:26.581 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T07:44:26.646 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T07:44:26.743 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T07:44:26.743 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 777 /var/log/ceph 2024-09-16T07:44:26.746 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-09-16T07:44:26.771 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T07:44:26.772 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T07:44:26.814 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T07:44:26.838 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T07:44:26.838 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T07:44:26.879 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T07:44:26.914 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T07:44:26.914 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T07:44:26.915 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906875', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/radosbench}', 'email': None, 'first_in_suite': False, 'job_id': '7906875', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6651, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi003.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPUaWCdcq8q0+18shW3f2pSCjm3eQBK/jW4od/DTjpLTe49Z0KBdDEBHd5gX7rdmOLYKdyhvCxRiXHwoBmi4l0w=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGvi3M8ULAddry+T1ER70TAHrkArsYMjVGV0/TRJY/z5wnh2sG3dc6LJtyCPU5fiskyWThrSlZ9wuTKcH2MXF48='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'full_sequential': [{'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_07:15:55', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T07:44:26.915 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T07:44:26.948 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T07:44:26.963 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T07:44:27.004 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T07:44:27.028 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:27.029 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T07:44:27.084 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T07:44:27.084 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_1 2024-09-16T07:44:27.140 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T07:44:27.140 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:44:27.140 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-16T07:44:27.140 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:44:27.141 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:44:27.141 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-16 07:44:22.043838620 +0000 2024-09-16T07:44:27.141 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-16 07:41:22.297241371 +0000 2024-09-16T07:44:27.141 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-16 07:41:22.297241371 +0000 2024-09-16T07:44:27.141 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-16 07:41:22.297241371 +0000 2024-09-16T07:44:27.141 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T07:44:27.205 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-16T07:44:27.205 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-16T07:44:27.205 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000193928 s, 2.6 MB/s 2024-09-16T07:44:27.206 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T07:44:27.262 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_2 2024-09-16T07:44:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T07:44:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:44:27.319 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-16T07:44:27.319 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:44:27.320 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:44:27.320 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-16 07:44:22.043838620 +0000 2024-09-16T07:44:27.320 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-16 07:41:22.629237712 +0000 2024-09-16T07:44:27.320 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-16 07:41:22.629237712 +0000 2024-09-16T07:44:27.320 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-16 07:41:22.629237712 +0000 2024-09-16T07:44:27.320 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T07:44:27.383 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-16T07:44:27.384 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-16T07:44:27.384 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000223006 s, 2.3 MB/s 2024-09-16T07:44:27.385 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T07:44:27.442 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_3 2024-09-16T07:44:27.498 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T07:44:27.498 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:44:27.498 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-16T07:44:27.498 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:44:27.498 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:44:27.498 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-16 07:44:22.044838609 +0000 2024-09-16T07:44:27.498 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-16 07:41:22.973233919 +0000 2024-09-16T07:44:27.498 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-16 07:41:22.973233919 +0000 2024-09-16T07:44:27.499 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-16 07:41:22.973233919 +0000 2024-09-16T07:44:27.499 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T07:44:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-16T07:44:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-16T07:44:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000183243 s, 2.8 MB/s 2024-09-16T07:44:27.565 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T07:44:27.621 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_4 2024-09-16T07:44:27.677 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T07:44:27.677 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:44:27.677 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-16T07:44:27.677 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:44:27.677 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:44:27.677 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-16 07:44:22.044838609 +0000 2024-09-16T07:44:27.677 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-16 07:41:23.320230094 +0000 2024-09-16T07:44:27.677 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-16 07:41:23.320230094 +0000 2024-09-16T07:44:27.678 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-16 07:41:23.320230094 +0000 2024-09-16T07:44:27.681 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T07:44:27.741 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-16T07:44:27.741 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-16T07:44:27.741 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000175435 s, 2.9 MB/s 2024-09-16T07:44:27.742 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T07:44:27.799 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T07:44:27.799 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:44:27.799 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T07:44:27.815 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T07:44:27.815 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-09-16T07:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T07:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:44:27.870 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-16T07:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-16 07:44:18.992482090 +0000 2024-09-16T07:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-16 07:41:19.584164492 +0000 2024-09-16T07:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-16 07:41:19.584164492 +0000 2024-09-16T07:44:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-16 07:41:19.584164492 +0000 2024-09-16T07:44:27.871 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T07:44:27.933 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-16T07:44:27.934 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-16T07:44:27.934 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000188304 s, 2.7 MB/s 2024-09-16T07:44:27.935 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T07:44:27.991 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-09-16T07:44:28.047 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T07:44:28.048 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:44:28.048 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-16T07:44:28.048 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:44:28.048 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:44:28.048 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-16 07:44:18.992482090 +0000 2024-09-16T07:44:28.048 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-16 07:41:20.082152416 +0000 2024-09-16T07:44:28.048 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-16 07:41:20.082152416 +0000 2024-09-16T07:44:28.049 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-16 07:41:20.082152416 +0000 2024-09-16T07:44:28.049 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T07:44:28.111 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-16T07:44:28.111 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-16T07:44:28.111 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000215304 s, 2.4 MB/s 2024-09-16T07:44:28.113 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T07:44:28.170 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-09-16T07:44:28.225 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T07:44:28.225 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:44:28.225 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-16T07:44:28.225 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:44:28.225 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:44:28.225 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-16 07:44:18.992482090 +0000 2024-09-16T07:44:28.225 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-16 07:41:20.425144098 +0000 2024-09-16T07:44:28.225 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-16 07:41:20.425144098 +0000 2024-09-16T07:44:28.225 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-16 07:41:20.425144098 +0000 2024-09-16T07:44:28.226 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T07:44:28.288 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-16T07:44:28.288 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-16T07:44:28.289 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000262357 s, 2.0 MB/s 2024-09-16T07:44:28.290 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T07:44:28.349 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-09-16T07:44:28.404 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T07:44:28.404 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:44:28.404 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-16T07:44:28.405 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:44:28.405 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:44:28.405 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-16 07:44:18.993482066 +0000 2024-09-16T07:44:28.405 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-16 07:41:20.787135320 +0000 2024-09-16T07:44:28.405 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-16 07:41:20.787135320 +0000 2024-09-16T07:44:28.405 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-16 07:41:20.787135320 +0000 2024-09-16T07:44:28.405 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T07:44:28.467 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-16T07:44:28.467 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-16T07:44:28.467 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000182741 s, 2.8 MB/s 2024-09-16T07:44:28.469 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T07:44:28.525 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T07:44:28.525 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-16T07:44:28.525 INFO:tasks.ceph:Generating config... 2024-09-16T07:44:28.526 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-16T07:44:28.526 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T07:44:28.527 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-16T07:44:28.527 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-16T07:44:28.527 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T07:44:28.527 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-16T07:44:28.527 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-16T07:44:28.527 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-16T07:44:28.527 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-16T07:44:28.527 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-16T07:44:28.527 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T07:44:28.527 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T07:44:28.527 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-16T07:44:28.527 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-16T07:44:28.528 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-16T07:44:28.528 INFO:tasks.ceph:[osd] log to file = False 2024-09-16T07:44:28.528 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-16T07:44:28.528 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T07:44:28.528 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T07:44:28.528 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T07:44:28.528 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-16T07:44:28.528 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2024-09-16T07:44:28.528 INFO:tasks.ceph:[osd] osd delete sleep = 1 2024-09-16T07:44:28.528 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T07:44:28.529 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-09-16T07:44:28.529 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-16T07:44:28.529 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T07:44:28.529 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-09-16T07:44:28.529 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-09-16T07:44:28.529 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-16T07:44:28.529 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2024-09-16T07:44:28.529 INFO:tasks.ceph:[client.0] debug ms = 1 2024-09-16T07:44:28.529 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-09-16T07:44:28.529 INFO:tasks.ceph:[client.0] debug rados = 20 2024-09-16T07:44:28.529 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-16T07:44:28.530 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-16T07:44:28.530 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-16T07:44:28.530 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-16T07:44:28.530 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-16T07:44:28.530 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-16T07:44:28.530 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-16T07:44:28.530 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2024-09-16T07:44:28.530 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2024-09-16T07:44:28.530 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T07:44:28.530 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T07:44:28.530 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-16T07:44:28.531 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T07:44:28.531 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T07:44:28.531 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T07:44:28.531 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-16T07:44:28.531 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-16T07:44:28.531 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-16T07:44:28.531 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-16T07:44:28.531 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-16T07:44:28.531 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-16T07:44:28.531 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-16T07:44:28.531 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-16T07:44:28.532 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-16T07:44:28.532 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-16T07:44:28.532 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T07:44:28.532 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T07:44:28.605 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T07:44:28.608 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T07:44:28.665 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:44:28.691 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.3')] 2024-09-16T07:44:28.692 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.3', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-16T07:44:28.692 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:28.693 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T07:44:28.748 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.3 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:44:28.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:44:28.842+0000 7f3ad5f43f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:28.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:44:28.842+0000 7f3ad5f43f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:28.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:44:28.843+0000 7f3ad5f43f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:28.843 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:44:28.843 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: generated fsid a7173a3e-ffed-4f8e-a112-99abc87b4a6b 2024-09-16T07:44:28.843 INFO:teuthology.orchestra.run.smithi003.stdout:setting min_mon_release = quincy 2024-09-16T07:44:28.843 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 0 2024-09-16T07:44:28.843 INFO:teuthology.orchestra.run.smithi003.stdout:fsid a7173a3e-ffed-4f8e-a112-99abc87b4a6b 2024-09-16T07:44:28.843 INFO:teuthology.orchestra.run.smithi003.stdout:last_changed 2024-09-16T07:44:28.844325+0000 2024-09-16T07:44:28.843 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-16T07:44:28.844325+0000 2024-09-16T07:44:28.844 INFO:teuthology.orchestra.run.smithi003.stdout:min_mon_release 17 (quincy) 2024-09-16T07:44:28.844 INFO:teuthology.orchestra.run.smithi003.stdout:election_strategy: 1 2024-09-16T07:44:28.844 INFO:teuthology.orchestra.run.smithi003.stdout:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-16T07:44:28.844 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-16T07:44:28.845 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T07:44:28.861 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a7173a3e-ffed-4f8e-a112-99abc87b4a6b... 2024-09-16T07:44:28.862 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T07:44:28.904 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T07:44:28.946 INFO:teuthology.orchestra.run.smithi003.stdout:[global] 2024-09-16T07:44:28.946 INFO:teuthology.orchestra.run.smithi003.stdout: chdir = "" 2024-09-16T07:44:28.946 INFO:teuthology.orchestra.run.smithi003.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T07:44:28.946 INFO:teuthology.orchestra.run.smithi003.stdout: auth supported = cephx 2024-09-16T07:44:28.946 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.946 INFO:teuthology.orchestra.run.smithi003.stdout: filestore xattr use omap = true 2024-09-16T07:44:28.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.947 INFO:teuthology.orchestra.run.smithi003.stdout: mon clock drift allowed = 1.000 2024-09-16T07:44:28.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.947 INFO:teuthology.orchestra.run.smithi003.stdout: osd crush chooseleaf type = 0 2024-09-16T07:44:28.947 INFO:teuthology.orchestra.run.smithi003.stdout: auth debug = true 2024-09-16T07:44:28.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.947 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on old message = true 2024-09-16T07:44:28.947 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on bug = true 2024-09-16T07:44:28.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.947 INFO:teuthology.orchestra.run.smithi003.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T07:44:28.947 INFO:teuthology.orchestra.run.smithi003.stdout: mon pg warn max object skew = 0 2024-09-16T07:44:28.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.947 INFO:teuthology.orchestra.run.smithi003.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T07:44:28.948 INFO:teuthology.orchestra.run.smithi003.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T07:44:28.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.948 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default size = 2 2024-09-16T07:44:28.948 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.948 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow primary affinity = true 2024-09-16T07:44:28.948 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow pg remap = true 2024-09-16T07:44:28.948 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on legacy crush tunables = false 2024-09-16T07:44:28.948 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on crush straw calc version zero = false 2024-09-16T07:44:28.948 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on no sortbitwise = false 2024-09-16T07:44:28.948 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on osd down out interval zero = false 2024-09-16T07:44:28.948 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on too few osds = false 2024-09-16T07:44:28.948 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T07:44:28.948 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T07:44:28.949 INFO:teuthology.orchestra.run.smithi003.stdout: mon_allow_pool_size_one = true 2024-09-16T07:44:28.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.949 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T07:44:28.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.949 INFO:teuthology.orchestra.run.smithi003.stdout: osd default data pool replay window = 5 2024-09-16T07:44:28.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.949 INFO:teuthology.orchestra.run.smithi003.stdout: mon allow pool delete = true 2024-09-16T07:44:28.949 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.949 INFO:teuthology.orchestra.run.smithi003.stdout: mon cluster log file level = debug 2024-09-16T07:44:28.949 INFO:teuthology.orchestra.run.smithi003.stdout: debug asserts on shutdown = true 2024-09-16T07:44:28.949 INFO:teuthology.orchestra.run.smithi003.stdout: mon health detail to clog = false 2024-09-16T07:44:28.949 INFO:teuthology.orchestra.run.smithi003.stdout: mon host = 172.21.15.3 2024-09-16T07:44:28.950 INFO:teuthology.orchestra.run.smithi003.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T07:44:28.950 INFO:teuthology.orchestra.run.smithi003.stdout: ms client mode = crc 2024-09-16T07:44:28.950 INFO:teuthology.orchestra.run.smithi003.stdout: ms cluster mode = crc 2024-09-16T07:44:28.950 INFO:teuthology.orchestra.run.smithi003.stdout: ms mon client mode = crc 2024-09-16T07:44:28.950 INFO:teuthology.orchestra.run.smithi003.stdout: ms mon cluster mode = crc 2024-09-16T07:44:28.950 INFO:teuthology.orchestra.run.smithi003.stdout: ms mon service mode = crc 2024-09-16T07:44:28.950 INFO:teuthology.orchestra.run.smithi003.stdout: ms service mode = crc 2024-09-16T07:44:28.950 INFO:teuthology.orchestra.run.smithi003.stdout: osd_pool_default_min_size = 2 2024-09-16T07:44:28.950 INFO:teuthology.orchestra.run.smithi003.stdout: osd_pool_default_size = 3 2024-09-16T07:44:28.950 INFO:teuthology.orchestra.run.smithi003.stdout: fsid = a7173a3e-ffed-4f8e-a112-99abc87b4a6b 2024-09-16T07:44:28.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.950 INFO:teuthology.orchestra.run.smithi003.stdout:[osd] 2024-09-16T07:44:28.951 INFO:teuthology.orchestra.run.smithi003.stdout: osd journal size = 100 2024-09-16T07:44:28.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.951 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub load threshold = 5.0 2024-09-16T07:44:28.951 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub max interval = 120 2024-09-16T07:44:28.951 INFO:teuthology.orchestra.run.smithi003.stdout: osd mclock profile = high_recovery_ops 2024-09-16T07:44:28.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.951 INFO:teuthology.orchestra.run.smithi003.stdout: osd recover clone overlap = true 2024-09-16T07:44:28.951 INFO:teuthology.orchestra.run.smithi003.stdout: osd recovery max chunk = 1048576 2024-09-16T07:44:28.951 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.951 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug shutdown = true 2024-09-16T07:44:28.951 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug op order = true 2024-09-16T07:44:28.951 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug verify stray on activate = true 2024-09-16T07:44:28.952 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug trim objects = true 2024-09-16T07:44:28.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.952 INFO:teuthology.orchestra.run.smithi003.stdout: osd open classes on start = true 2024-09-16T07:44:28.952 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug pg log writeout = true 2024-09-16T07:44:28.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.952 INFO:teuthology.orchestra.run.smithi003.stdout: osd deep scrub update digest min age = 30 2024-09-16T07:44:28.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.952 INFO:teuthology.orchestra.run.smithi003.stdout: osd map max advance = 10 2024-09-16T07:44:28.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.952 INFO:teuthology.orchestra.run.smithi003.stdout: journal zero on create = true 2024-09-16T07:44:28.952 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.952 INFO:teuthology.orchestra.run.smithi003.stdout: filestore ondisk finisher threads = 3 2024-09-16T07:44:28.952 INFO:teuthology.orchestra.run.smithi003.stdout: filestore apply finisher threads = 3 2024-09-16T07:44:28.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.953 INFO:teuthology.orchestra.run.smithi003.stdout: bdev debug aio = true 2024-09-16T07:44:28.953 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug misdirected ops = true 2024-09-16T07:44:28.953 INFO:teuthology.orchestra.run.smithi003.stdout: debug monc = 20 2024-09-16T07:44:28.953 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore block size = 96636764160 2024-09-16T07:44:28.953 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore compression algorithm = snappy 2024-09-16T07:44:28.953 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore compression mode = aggressive 2024-09-16T07:44:28.953 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore fsck on mount = True 2024-09-16T07:44:28.953 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore rocksdb cf = False 2024-09-16T07:44:28.953 INFO:teuthology.orchestra.run.smithi003.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T07:44:28.953 INFO:teuthology.orchestra.run.smithi003.stdout: crimson osd obc lru size = 10 2024-09-16T07:44:28.953 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluefs = 20 2024-09-16T07:44:28.953 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluestore = 20 2024-09-16T07:44:28.953 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2024-09-16T07:44:28.954 INFO:teuthology.orchestra.run.smithi003.stdout: debug osd = 20 2024-09-16T07:44:28.954 INFO:teuthology.orchestra.run.smithi003.stdout: debug rocksdb = 10 2024-09-16T07:44:28.954 INFO:teuthology.orchestra.run.smithi003.stdout: err to stderr = True 2024-09-16T07:44:28.954 INFO:teuthology.orchestra.run.smithi003.stdout: log flush on exit = True 2024-09-16T07:44:28.954 INFO:teuthology.orchestra.run.smithi003.stdout: log to file = False 2024-09-16T07:44:28.954 INFO:teuthology.orchestra.run.smithi003.stdout: log to stderr = True 2024-09-16T07:44:28.954 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T07:44:28.954 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd full ratio = 0.9 2024-09-16T07:44:28.954 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd nearfull ratio = 0.8 2024-09-16T07:44:28.954 INFO:teuthology.orchestra.run.smithi003.stdout: osd blocked scrub grace period = 3600 2024-09-16T07:44:28.954 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug reject backfill probability = 0.3 2024-09-16T07:44:28.954 INFO:teuthology.orchestra.run.smithi003.stdout: osd delete sleep = 1 2024-09-16T07:44:28.954 INFO:teuthology.orchestra.run.smithi003.stdout: osd failsafe full ratio = 0.95 2024-09-16T07:44:28.955 INFO:teuthology.orchestra.run.smithi003.stdout: osd max backfills = 3 2024-09-16T07:44:28.955 INFO:teuthology.orchestra.run.smithi003.stdout: osd max markdown count = 1000 2024-09-16T07:44:28.955 INFO:teuthology.orchestra.run.smithi003.stdout: osd objectstore = bluestore 2024-09-16T07:44:28.955 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub min interval = 60 2024-09-16T07:44:28.955 INFO:teuthology.orchestra.run.smithi003.stdout: osd shutdown pgref assert = True 2024-09-16T07:44:28.955 INFO:teuthology.orchestra.run.smithi003.stdout: osd snap trim sleep = 2 2024-09-16T07:44:28.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.955 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr] 2024-09-16T07:44:28.955 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2024-09-16T07:44:28.955 INFO:teuthology.orchestra.run.smithi003.stdout: debug mgr = 20 2024-09-16T07:44:28.955 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2024-09-16T07:44:28.955 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2024-09-16T07:44:28.955 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:44:28.955 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:44:28.956 INFO:teuthology.orchestra.run.smithi003.stdout: mgr/telemetry/nag = false 2024-09-16T07:44:28.956 INFO:teuthology.orchestra.run.smithi003.stdout: mgr stats period = 30 2024-09-16T07:44:28.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.956 INFO:teuthology.orchestra.run.smithi003.stdout:[mon] 2024-09-16T07:44:28.956 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2024-09-16T07:44:28.956 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2024-09-16T07:44:28.956 INFO:teuthology.orchestra.run.smithi003.stdout: debug paxos = 20 2024-09-16T07:44:28.956 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2024-09-16T07:44:28.956 INFO:teuthology.orchestra.run.smithi003.stdout: mon data avail warn = 5 2024-09-16T07:44:28.956 INFO:teuthology.orchestra.run.smithi003.stdout: mon mgr mkfs grace = 240 2024-09-16T07:44:28.956 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:44:28.956 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd reporter subtree level = osd 2024-09-16T07:44:28.956 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd prime pg temp = true 2024-09-16T07:44:28.957 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:44:28.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.957 INFO:teuthology.orchestra.run.smithi003.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T07:44:28.957 INFO:teuthology.orchestra.run.smithi003.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T07:44:28.957 INFO:teuthology.orchestra.run.smithi003.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T07:44:28.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.957 INFO:teuthology.orchestra.run.smithi003.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T07:44:28.957 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T07:44:28.957 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T07:44:28.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.957 INFO:teuthology.orchestra.run.smithi003.stdout: # 1m isn't quite enough 2024-09-16T07:44:28.957 INFO:teuthology.orchestra.run.smithi003.stdout: mon_down_mkfs_grace = 2m 2024-09-16T07:44:28.957 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.958 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_filestore_osds = false 2024-09-16T07:44:28.958 INFO:teuthology.orchestra.run.smithi003.stdout: mon min osdmap epochs = 50 2024-09-16T07:44:28.958 INFO:teuthology.orchestra.run.smithi003.stdout: mon osdmap full prune interval = 2 2024-09-16T07:44:28.958 INFO:teuthology.orchestra.run.smithi003.stdout: mon osdmap full prune min = 15 2024-09-16T07:44:28.958 INFO:teuthology.orchestra.run.smithi003.stdout: mon osdmap full prune txsize = 2 2024-09-16T07:44:28.958 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default crimson = True 2024-09-16T07:44:28.958 INFO:teuthology.orchestra.run.smithi003.stdout: paxos service trim min = 10 2024-09-16T07:44:28.958 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:44:28.958 INFO:teuthology.orchestra.run.smithi003.stdout:[client] 2024-09-16T07:44:28.958 INFO:teuthology.orchestra.run.smithi003.stdout: rgw cache enabled = true 2024-09-16T07:44:28.958 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable ops log = true 2024-09-16T07:44:28.958 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable usage log = true 2024-09-16T07:44:28.958 INFO:teuthology.orchestra.run.smithi003.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T07:44:28.958 INFO:teuthology.orchestra.run.smithi003.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T07:44:28.959 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.a] 2024-09-16T07:44:28.959 INFO:teuthology.orchestra.run.smithi003.stdout:[client.0] 2024-09-16T07:44:28.959 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2024-09-16T07:44:28.959 INFO:teuthology.orchestra.run.smithi003.stdout: debug objecter = 20 2024-09-16T07:44:28.959 INFO:teuthology.orchestra.run.smithi003.stdout: debug rados = 20 2024-09-16T07:44:28.959 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.0] 2024-09-16T07:44:28.959 INFO:teuthology.orchestra.run.smithi003.stdout: crimson seastar cpu cores = 0-2 2024-09-16T07:44:28.959 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.1] 2024-09-16T07:44:28.959 INFO:teuthology.orchestra.run.smithi003.stdout: crimson seastar cpu cores = 3-5 2024-09-16T07:44:28.959 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.2] 2024-09-16T07:44:28.959 INFO:teuthology.orchestra.run.smithi003.stdout: crimson seastar cpu cores = 0-2 2024-09-16T07:44:28.959 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.3] 2024-09-16T07:44:28.959 INFO:teuthology.orchestra.run.smithi003.stdout: crimson seastar cpu cores = 3-5 2024-09-16T07:44:28.961 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-09-16T07:44:28.964 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-09-16T07:44:28.965 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T07:44:28.965 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-09-16T07:44:28.965 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.965 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-09-16T07:44:28.965 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.965 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-09-16T07:44:28.965 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.965 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-09-16T07:44:28.965 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-09-16T07:44:28.965 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.965 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-09-16T07:44:28.965 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-09-16T07:44:28.966 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.966 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T07:44:28.966 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-09-16T07:44:28.966 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.966 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T07:44:28.966 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T07:44:28.966 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.966 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-09-16T07:44:28.966 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.966 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-09-16T07:44:28.966 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-09-16T07:44:28.966 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-09-16T07:44:28.966 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-09-16T07:44:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-09-16T07:44:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-09-16T07:44:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-09-16T07:44:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T07:44:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T07:44:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-09-16T07:44:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T07:44:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-09-16T07:44:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-09-16T07:44:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.967 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-09-16T07:44:28.968 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-09-16T07:44:28.968 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-09-16T07:44:28.968 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = 172.21.15.3 2024-09-16T07:44:28.968 INFO:teuthology.orchestra.run.smithi134.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T07:44:28.968 INFO:teuthology.orchestra.run.smithi134.stdout: ms client mode = crc 2024-09-16T07:44:28.968 INFO:teuthology.orchestra.run.smithi134.stdout: ms cluster mode = crc 2024-09-16T07:44:28.968 INFO:teuthology.orchestra.run.smithi134.stdout: ms mon client mode = crc 2024-09-16T07:44:28.968 INFO:teuthology.orchestra.run.smithi134.stdout: ms mon cluster mode = crc 2024-09-16T07:44:28.968 INFO:teuthology.orchestra.run.smithi134.stdout: ms mon service mode = crc 2024-09-16T07:44:28.968 INFO:teuthology.orchestra.run.smithi134.stdout: ms service mode = crc 2024-09-16T07:44:28.968 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_min_size = 2 2024-09-16T07:44:28.968 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_size = 3 2024-09-16T07:44:28.968 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = a7173a3e-ffed-4f8e-a112-99abc87b4a6b 2024-09-16T07:44:28.969 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.969 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-09-16T07:44:28.969 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-09-16T07:44:28.969 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.969 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-09-16T07:44:28.969 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 120 2024-09-16T07:44:28.969 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-09-16T07:44:28.969 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.969 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-09-16T07:44:28.969 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-09-16T07:44:28.969 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.969 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-09-16T07:44:28.969 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-09-16T07:44:28.970 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-09-16T07:44:28.970 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug trim objects = true 2024-09-16T07:44:28.970 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.970 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-09-16T07:44:28.970 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-09-16T07:44:28.970 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.970 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-09-16T07:44:28.970 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.970 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-09-16T07:44:28.970 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.970 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-09-16T07:44:28.970 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.970 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-09-16T07:44:28.971 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-09-16T07:44:28.971 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.971 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-09-16T07:44:28.971 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-09-16T07:44:28.971 INFO:teuthology.orchestra.run.smithi134.stdout: debug monc = 20 2024-09-16T07:44:28.971 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-09-16T07:44:28.971 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore compression algorithm = snappy 2024-09-16T07:44:28.971 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore compression mode = aggressive 2024-09-16T07:44:28.971 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-09-16T07:44:28.971 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore rocksdb cf = False 2024-09-16T07:44:28.971 INFO:teuthology.orchestra.run.smithi134.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T07:44:28.971 INFO:teuthology.orchestra.run.smithi134.stdout: crimson osd obc lru size = 10 2024-09-16T07:44:28.971 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 20 2024-09-16T07:44:28.972 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 20 2024-09-16T07:44:28.972 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-16T07:44:28.972 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-09-16T07:44:28.972 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 10 2024-09-16T07:44:28.972 INFO:teuthology.orchestra.run.smithi134.stdout: err to stderr = True 2024-09-16T07:44:28.972 INFO:teuthology.orchestra.run.smithi134.stdout: log flush on exit = True 2024-09-16T07:44:28.972 INFO:teuthology.orchestra.run.smithi134.stdout: log to file = False 2024-09-16T07:44:28.972 INFO:teuthology.orchestra.run.smithi134.stdout: log to stderr = True 2024-09-16T07:44:28.973 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T07:44:28.973 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-09-16T07:44:28.973 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-09-16T07:44:28.973 INFO:teuthology.orchestra.run.smithi134.stdout: osd blocked scrub grace period = 3600 2024-09-16T07:44:28.973 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug reject backfill probability = 0.3 2024-09-16T07:44:28.973 INFO:teuthology.orchestra.run.smithi134.stdout: osd delete sleep = 1 2024-09-16T07:44:28.973 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-09-16T07:44:28.973 INFO:teuthology.orchestra.run.smithi134.stdout: osd max backfills = 3 2024-09-16T07:44:28.973 INFO:teuthology.orchestra.run.smithi134.stdout: osd max markdown count = 1000 2024-09-16T07:44:28.973 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-09-16T07:44:28.973 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub min interval = 60 2024-09-16T07:44:28.973 INFO:teuthology.orchestra.run.smithi134.stdout: osd shutdown pgref assert = True 2024-09-16T07:44:28.973 INFO:teuthology.orchestra.run.smithi134.stdout: osd snap trim sleep = 2 2024-09-16T07:44:28.973 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.974 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-09-16T07:44:28.974 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-16T07:44:28.974 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-09-16T07:44:28.974 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-16T07:44:28.974 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-16T07:44:28.974 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:44:28.974 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:44:28.974 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-09-16T07:44:28.974 INFO:teuthology.orchestra.run.smithi134.stdout: mgr stats period = 30 2024-09-16T07:44:28.974 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.974 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-09-16T07:44:28.974 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-16T07:44:28.974 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-16T07:44:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-09-16T07:44:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-16T07:44:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-09-16T07:44:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-09-16T07:44:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:44:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-09-16T07:44:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-09-16T07:44:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:44:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T07:44:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T07:44:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T07:44:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.975 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T07:44:28.976 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T07:44:28.976 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T07:44:28.976 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.976 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-09-16T07:44:28.976 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-09-16T07:44:28.976 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.976 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-09-16T07:44:28.976 INFO:teuthology.orchestra.run.smithi134.stdout: mon min osdmap epochs = 50 2024-09-16T07:44:28.976 INFO:teuthology.orchestra.run.smithi134.stdout: mon osdmap full prune interval = 2 2024-09-16T07:44:28.976 INFO:teuthology.orchestra.run.smithi134.stdout: mon osdmap full prune min = 15 2024-09-16T07:44:28.976 INFO:teuthology.orchestra.run.smithi134.stdout: mon osdmap full prune txsize = 2 2024-09-16T07:44:28.976 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default crimson = True 2024-09-16T07:44:28.976 INFO:teuthology.orchestra.run.smithi134.stdout: paxos service trim min = 10 2024-09-16T07:44:28.977 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-16T07:44:28.977 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-09-16T07:44:28.977 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-09-16T07:44:28.977 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-09-16T07:44:28.977 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-09-16T07:44:28.977 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T07:44:28.977 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T07:44:28.977 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-09-16T07:44:28.977 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-16T07:44:28.977 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-16T07:44:28.977 INFO:teuthology.orchestra.run.smithi134.stdout: debug objecter = 20 2024-09-16T07:44:28.977 INFO:teuthology.orchestra.run.smithi134.stdout: debug rados = 20 2024-09-16T07:44:28.977 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2024-09-16T07:44:28.978 INFO:teuthology.orchestra.run.smithi134.stdout: crimson seastar cpu cores = 0-2 2024-09-16T07:44:28.978 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2024-09-16T07:44:28.978 INFO:teuthology.orchestra.run.smithi134.stdout: crimson seastar cpu cores = 3-5 2024-09-16T07:44:28.978 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2024-09-16T07:44:28.978 INFO:teuthology.orchestra.run.smithi134.stdout: crimson seastar cpu cores = 0-2 2024-09-16T07:44:28.978 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2024-09-16T07:44:28.978 INFO:teuthology.orchestra.run.smithi134.stdout: crimson seastar cpu cores = 3-5 2024-09-16T07:44:28.978 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T07:44:28.978 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T07:44:29.068 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T07:44:29.068 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:29.068 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T07:44:29.084 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:29.084 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T07:44:29.140 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi003.front.sepia.ceph.com 2024-09-16T07:44:29.140 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:29.140 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T07:44:29.140 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:44:29.216 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:29.216 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:44:29.272 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T07:44:29.272 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:44:29.272 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T07:44:29.272 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:44:29.307 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:44:29.307 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:44:29.363 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T07:44:29.363 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T07:44:29.364 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T07:44:29.475 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T07:44:29.479 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T07:44:29.479 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T07:44:29.479 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T07:44:29.530 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T07:44:29.543 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T07:44:29.594 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-16T07:44:29.608 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T07:44:29.608 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-16T07:44:29.608 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T07:44:29.633 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T07:44:29.634 INFO:tasks.ceph:role: osd.0 2024-09-16T07:44:29.634 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com 2024-09-16T07:44:29.634 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T07:44:29.707 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:44:29.707 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:44:29.707 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:44:29.707 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:44:29.707 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:44:29.707 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:44:29.707 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:44:29.707 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:44:29.708 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:44:29.708 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:44:30.188 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2024-09-16T07:44:30.190 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2024-09-16T07:44:30.190 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T07:44:30.315 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T07:44:30.347 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T07:44:30.413 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T07:44:30.413 INFO:tasks.ceph:role: osd.1 2024-09-16T07:44:30.413 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com 2024-09-16T07:44:30.413 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T07:44:30.487 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:44:30.487 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:44:30.487 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:44:30.487 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:44:30.487 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:44:30.487 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:44:30.488 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:44:30.488 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:44:30.488 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:44:30.488 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:44:30.950 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2024-09-16T07:44:30.952 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2024-09-16T07:44:30.953 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T07:44:31.042 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T07:44:31.074 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:44:31.386 INFO:teuthology.orchestra.run.smithi003.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:44:31.387 INFO:teuthology.orchestra.run.smithi003.stderr:INFO 2024-09-16 07:44:31,389 seastar - Reactor backend: linux-aio 2024-09-16T07:44:31.403 INFO:teuthology.orchestra.run.smithi003.stderr:==27635==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:44:31.536 INFO:teuthology.orchestra.run.smithi003.stderr:INFO 2024-09-16 07:44:31,537 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:44:31.536 INFO:teuthology.orchestra.run.smithi003.stderr:INFO 2024-09-16 07:44:31,537 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-16T07:44:31.536 INFO:teuthology.orchestra.run.smithi003.stderr:DEBUG 2024-09-16 07:44:31,538 [shard 0:main] seastar - reactor::drain 2024-09-16T07:44:32.092 INFO:teuthology.orchestra.run.smithi003.stderr:----------------------------------------------------- 2024-09-16T07:44:32.092 INFO:teuthology.orchestra.run.smithi003.stderr:Suppressions used: 2024-09-16T07:44:32.092 INFO:teuthology.orchestra.run.smithi003.stderr: count bytes template 2024-09-16T07:44:32.092 INFO:teuthology.orchestra.run.smithi003.stderr: 1 8 MallocExtension::Register 2024-09-16T07:44:32.092 INFO:teuthology.orchestra.run.smithi003.stderr:----------------------------------------------------- 2024-09-16T07:44:32.093 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T07:44:32.150 INFO:teuthology.orchestra.run.smithi003.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:44:32.154 INFO:teuthology.orchestra.run.smithi003.stderr:INFO 2024-09-16 07:44:32,156 seastar - Reactor backend: linux-aio 2024-09-16T07:44:32.164 INFO:teuthology.orchestra.run.smithi003.stderr:==27633==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:44:36.918 INFO:teuthology.orchestra.run.smithi003.stderr:----------------------------------------------------- 2024-09-16T07:44:36.918 INFO:teuthology.orchestra.run.smithi003.stderr:Suppressions used: 2024-09-16T07:44:36.918 INFO:teuthology.orchestra.run.smithi003.stderr: count bytes template 2024-09-16T07:44:36.918 INFO:teuthology.orchestra.run.smithi003.stderr: 1 8 MallocExtension::Register 2024-09-16T07:44:36.918 INFO:teuthology.orchestra.run.smithi003.stderr:----------------------------------------------------- 2024-09-16T07:44:36.918 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T07:44:36.946 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T07:44:36.972 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:44:37.269 INFO:teuthology.orchestra.run.smithi003.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:44:37.270 INFO:teuthology.orchestra.run.smithi003.stderr:INFO 2024-09-16 07:44:37,272 seastar - Reactor backend: linux-aio 2024-09-16T07:44:37.276 INFO:teuthology.orchestra.run.smithi003.stderr:==27821==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:44:37.384 INFO:teuthology.orchestra.run.smithi003.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x381afa6 0x5fdd44c 0x5fdd8fa 0x6038b24 0x5fb8d06 0x5fb8ee0 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:44:37.384 INFO:teuthology.orchestra.run.smithi003.stderr:kernel callstack: 2024-09-16T07:44:37.411 INFO:teuthology.orchestra.run.smithi003.stderr:INFO 2024-09-16 07:44:37,413 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:44:37.411 INFO:teuthology.orchestra.run.smithi003.stderr:INFO 2024-09-16 07:44:37,413 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-16T07:44:37.412 INFO:teuthology.orchestra.run.smithi003.stderr:DEBUG 2024-09-16 07:44:37,414 [shard 0:main] seastar - reactor::drain 2024-09-16T07:44:37.967 INFO:teuthology.orchestra.run.smithi003.stderr:----------------------------------------------------- 2024-09-16T07:44:37.967 INFO:teuthology.orchestra.run.smithi003.stderr:Suppressions used: 2024-09-16T07:44:37.967 INFO:teuthology.orchestra.run.smithi003.stderr: count bytes template 2024-09-16T07:44:37.967 INFO:teuthology.orchestra.run.smithi003.stderr: 1 8 MallocExtension::Register 2024-09-16T07:44:37.967 INFO:teuthology.orchestra.run.smithi003.stderr:----------------------------------------------------- 2024-09-16T07:44:37.967 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T07:44:38.032 INFO:teuthology.orchestra.run.smithi003.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:44:38.036 INFO:teuthology.orchestra.run.smithi003.stderr:INFO 2024-09-16 07:44:38,038 seastar - Reactor backend: linux-aio 2024-09-16T07:44:38.046 INFO:teuthology.orchestra.run.smithi003.stderr:==27819==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:44:38.111 INFO:teuthology.orchestra.run.smithi003.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x8b558 0x10d76c 0xdd31a 0x4b14c 0x5fdbcd4 0x5fdc222 0x5fb92bb 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:44:38.111 INFO:teuthology.orchestra.run.smithi003.stderr:kernel callstack: 2024-09-16T07:44:43.077 INFO:teuthology.orchestra.run.smithi003.stderr:----------------------------------------------------- 2024-09-16T07:44:43.077 INFO:teuthology.orchestra.run.smithi003.stderr:Suppressions used: 2024-09-16T07:44:43.077 INFO:teuthology.orchestra.run.smithi003.stderr: count bytes template 2024-09-16T07:44:43.077 INFO:teuthology.orchestra.run.smithi003.stderr: 1 8 MallocExtension::Register 2024-09-16T07:44:43.078 INFO:teuthology.orchestra.run.smithi003.stderr:----------------------------------------------------- 2024-09-16T07:44:43.078 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T07:44:43.100 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T07:44:43.126 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T07:44:43.157 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T07:44:43.157 INFO:tasks.ceph:role: osd.2 2024-09-16T07:44:43.157 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T07:44:43.158 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T07:44:43.234 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:44:43.234 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:44:43.234 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:44:43.234 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:44:43.234 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:44:43.234 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:44:43.234 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:44:43.234 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:44:43.234 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:44:43.234 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:44:43.747 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-16T07:44:43.750 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-16T07:44:43.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-16T07:44:43.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T07:44:43.900 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T07:44:43.967 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T07:44:43.968 INFO:tasks.ceph:role: osd.3 2024-09-16T07:44:43.968 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T07:44:43.968 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T07:44:44.042 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:44:44.042 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:44:44.042 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:44:44.042 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:44:44.042 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:44:44.042 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:44:44.042 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:44:44.042 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:44:44.042 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:44:44.042 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:44:44.486 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-16T07:44:44.488 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-16T07:44:44.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-16T07:44:44.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T07:44:44.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:44:44.948 INFO:teuthology.orchestra.run.smithi134.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:44:44.949 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-16 07:44:44,950 seastar - Reactor backend: linux-aio 2024-09-16T07:44:44.964 INFO:teuthology.orchestra.run.smithi134.stderr:==27745==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:44:45.092 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-16 07:44:45,094 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:44:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-16 07:44:45,094 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-16T07:44:45.093 INFO:teuthology.orchestra.run.smithi134.stderr:DEBUG 2024-09-16 07:44:45,095 [shard 0:main] seastar - reactor::drain 2024-09-16T07:44:45.626 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-16T07:44:45.627 INFO:teuthology.orchestra.run.smithi134.stderr:Suppressions used: 2024-09-16T07:44:45.627 INFO:teuthology.orchestra.run.smithi134.stderr: count bytes template 2024-09-16T07:44:45.627 INFO:teuthology.orchestra.run.smithi134.stderr: 1 8 MallocExtension::Register 2024-09-16T07:44:45.627 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-16T07:44:45.627 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-16T07:44:45.686 INFO:teuthology.orchestra.run.smithi134.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:44:45.689 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-16 07:44:45,691 seastar - Reactor backend: linux-aio 2024-09-16T07:44:45.699 INFO:teuthology.orchestra.run.smithi134.stderr:==27741==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:44:45.765 INFO:teuthology.orchestra.run.smithi134.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x133cca 0xdd332 0x4ab1c 0x5fe9be6 0x5fe9dfc 0x5fe9fdf 0x5fea2b5 0x60389b3 0x6038bb9 0x5fb8d06 0x5fb923a 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:44:45.765 INFO:teuthology.orchestra.run.smithi134.stderr:kernel callstack: 2024-09-16T07:44:50.411 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-16T07:44:50.411 INFO:teuthology.orchestra.run.smithi134.stderr:Suppressions used: 2024-09-16T07:44:50.411 INFO:teuthology.orchestra.run.smithi134.stderr: count bytes template 2024-09-16T07:44:50.412 INFO:teuthology.orchestra.run.smithi134.stderr: 1 8 MallocExtension::Register 2024-09-16T07:44:50.412 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-16T07:44:50.412 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-16T07:44:50.433 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T07:44:50.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:44:50.746 INFO:teuthology.orchestra.run.smithi134.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:44:50.747 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-16 07:44:50,748 seastar - Reactor backend: linux-aio 2024-09-16T07:44:50.752 INFO:teuthology.orchestra.run.smithi134.stderr:==27932==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:44:50.859 INFO:teuthology.orchestra.run.smithi134.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x156dc 0xdd312 0x4b14c 0x381b234 0x5fdd466 0x5fdd8fa 0x6038b24 0x5fb8d06 0x5fb923a 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:44:50.859 INFO:teuthology.orchestra.run.smithi134.stderr:kernel callstack: 2024-09-16T07:44:50.875 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-16 07:44:50,877 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:44:50.875 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-16 07:44:50,877 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-16T07:44:50.876 INFO:teuthology.orchestra.run.smithi134.stderr:DEBUG 2024-09-16 07:44:50,878 [shard 0:main] seastar - reactor::drain 2024-09-16T07:44:51.386 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-16T07:44:51.386 INFO:teuthology.orchestra.run.smithi134.stderr:Suppressions used: 2024-09-16T07:44:51.387 INFO:teuthology.orchestra.run.smithi134.stderr: count bytes template 2024-09-16T07:44:51.387 INFO:teuthology.orchestra.run.smithi134.stderr: 1 8 MallocExtension::Register 2024-09-16T07:44:51.387 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-16T07:44:51.387 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-16T07:44:51.445 INFO:teuthology.orchestra.run.smithi134.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:44:51.448 INFO:teuthology.orchestra.run.smithi134.stderr:INFO 2024-09-16 07:44:51,450 seastar - Reactor backend: linux-aio 2024-09-16T07:44:51.465 INFO:teuthology.orchestra.run.smithi134.stderr:==27930==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:44:56.650 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-16T07:44:56.651 INFO:teuthology.orchestra.run.smithi134.stderr:Suppressions used: 2024-09-16T07:44:56.651 INFO:teuthology.orchestra.run.smithi134.stderr: count bytes template 2024-09-16T07:44:56.651 INFO:teuthology.orchestra.run.smithi134.stderr: 1 8 MallocExtension::Register 2024-09-16T07:44:56.651 INFO:teuthology.orchestra.run.smithi134.stderr:----------------------------------------------------- 2024-09-16T07:44:56.651 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-16T07:44:56.672 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T07:44:56.697 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T07:44:56.698 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:56.698 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T07:44:56.729 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:56.729 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T07:44:56.798 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:44:56.798 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T07:44:56.823 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:44:56.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T07:44:56.888 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:44:56.888 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T07:44:56.953 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:56.953 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T07:44:56.972 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:44:56.972 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-16T07:44:57.008 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T07:44:57.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T07:44:57.039 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.0] 2024-09-16T07:44:57.039 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQDg4edmmV5GExAACbTgqAexAVn6wHTlFDsNIA== 2024-09-16T07:44:57.040 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.1] 2024-09-16T07:44:57.040 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQDm4edmSeF2DBAArG4w32XzNBv3qD/w9KWXDw== 2024-09-16T07:44:57.040 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.x] 2024-09-16T07:44:57.040 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQDd4edmVbV3HBAAdYxQc/DmaK4Ns83hBxjLEA== 2024-09-16T07:44:57.040 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.2] 2024-09-16T07:44:57.040 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQDt4edmglrlMhAAHOLufR31vweD56X3Y7pSbA== 2024-09-16T07:44:57.041 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.3] 2024-09-16T07:44:57.041 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQDz4edmOmWfJBAAVu45tnq8Y01GZgeUcs4K5A== 2024-09-16T07:44:57.041 INFO:teuthology.orchestra.run.smithi003.stdout:[client.0] 2024-09-16T07:44:57.041 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQDd4edmkqS4HxAAR8hEBRNzum9jwgWXS3G/7A== 2024-09-16T07:44:57.041 INFO:teuthology.orchestra.run.smithi003.stdout:[client.1] 2024-09-16T07:44:57.041 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQDd4edmsFmPIxAAucWTGiIZ+bZx/eQuwVDJcg== 2024-09-16T07:44:57.043 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:44:57.155 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:44:57.221 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T07:44:57.283 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:44:57.346 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:44:57.409 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:44:57.476 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:44:57.541 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T07:44:57.542 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T07:44:57.567 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T07:44:57.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:44:57.689+0000 7f0406d28c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:57.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:44:57.689+0000 7f0406d28c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:57.702 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T07:44:57.727 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:44:57.784 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T07:44:57.784 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T07:44:57.784 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T07:44:57.826 INFO:tasks.ceph.mon.a:Started 2024-09-16T07:44:57.827 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T07:44:57.827 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T07:44:57.827 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T07:44:57.829 INFO:tasks.ceph.mgr.x:Started 2024-09-16T07:44:57.829 DEBUG:tasks.ceph:set 0 configs 2024-09-16T07:44:57.830 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T07:44:57.830 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T07:44:57.910 INFO:tasks.ceph.mon.a.smithi003.stderr:2024-09-16T07:44:57.911+0000 7f25900d9c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:57.911 INFO:tasks.ceph.mon.a.smithi003.stderr:2024-09-16T07:44:57.911+0000 7f25900d9c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:57.911 INFO:tasks.ceph.mon.a.smithi003.stderr:2024-09-16T07:44:57.911+0000 7f25900d9c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:57.933 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-16T07:44:57.934+0000 7fc979e27000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:57.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:44:57.936+0000 7fe9feb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:57.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:44:57.947+0000 7fe9feb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:57.947 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-16T07:44:57.947+0000 7fc979e27000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:57.947 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-16T07:44:57.948+0000 7fc979e27000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:58.020 INFO:teuthology.orchestra.run.smithi003.stderr:adjusted tunables profile to default 2024-09-16T07:44:58.032 INFO:tasks.ceph:check_enable_crimson: True 2024-09-16T07:44:58.032 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-16T07:44:58.032 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-16T07:44:58.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:44:58.138+0000 7f7454711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:58.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:44:58.148+0000 7f7454711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:58.230 INFO:tasks.ceph.mon.a.smithi003.stderr:2024-09-16T07:44:58.231+0000 7f2586df4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-16T07:44:58.230 INFO:tasks.ceph.mon.a.smithi003.stderr:Please be aware that this feature is experimental, untested, 2024-09-16T07:44:58.231 INFO:tasks.ceph.mon.a.smithi003.stderr:unsupported, and may result in data corruption, data loss, 2024-09-16T07:44:58.231 INFO:tasks.ceph.mon.a.smithi003.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-16T07:44:58.231 INFO:tasks.ceph.mon.a.smithi003.stderr:feature with important data. 2024-09-16T07:44:58.231 INFO:tasks.ceph.mon.a.smithi003.stderr: 2024-09-16T07:44:59.036 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T07:44:59.036 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:59.036 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T07:44:59.064 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-16T07:44:59.064 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T07:44:59.132 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:44:59.132 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T07:44:59.157 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-16T07:44:59.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T07:44:59.223 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 92b524c0-1e32-4c56-a983-7be51186e765 0 2024-09-16T07:44:59.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T07:44:59.366+0000 7fcf27088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:59.374 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T07:44:59.375+0000 7fcf27088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:59.453 INFO:teuthology.orchestra.run.smithi134.stdout:0 2024-09-16T07:44:59.464 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 51e5f821-e631-4cc1-8a37-d7b188901edf 1 2024-09-16T07:44:59.573 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T07:44:59.568+0000 7fef84791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:59.576 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T07:44:59.577+0000 7fef84791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:59.654 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-16T07:44:59.666 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 0a8a850b-ad4a-4499-945d-1c2672d0a2cb 2 2024-09-16T07:44:59.775 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T07:44:59.770+0000 7f0191ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:59.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T07:44:59.779+0000 7f0191ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:59.856 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-09-16T07:44:59.869 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new d8f5c79f-4068-4ef9-a125-508f70e18ae3 3 2024-09-16T07:44:59.977 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T07:44:59.971+0000 7fd9bd657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:59.980 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-16T07:44:59.981+0000 7fd9bd657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:00.056 INFO:teuthology.orchestra.run.smithi134.stdout:3 2024-09-16T07:45:00.068 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-16T07:45:00.104 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:45:00.104 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T07:45:00.147 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:45:00.147 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-16T07:45:00.180 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T07:45:00.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T07:45:00.222 INFO:tasks.ceph.osd.1:Started 2024-09-16T07:45:00.223 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-16T07:45:00.252 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T07:45:00.253 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T07:45:00.295 INFO:tasks.ceph.osd.2:Started 2024-09-16T07:45:00.295 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-16T07:45:00.324 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T07:45:00.324 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-16T07:45:00.366 INFO:tasks.ceph.osd.3:Started 2024-09-16T07:45:00.367 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:45:00.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:00.484+0000 7fdffe6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:00.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:00.493+0000 7fdffe6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:00.566 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:00.566 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":7,"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","created":"2024-09-16T07:44:57.934858+0000","modified":"2024-09-16T07:45:00.057112+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T07:45:00.057112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"92b524c0-1e32-4c56-a983-7be51186e765","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"51e5f821-e631-4cc1-8a37-d7b188901edf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0a8a850b-ad4a-4499-945d-1c2672d0a2cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d8f5c79f-4068-4ef9-a125-508f70e18ae3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:45:00.578 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T07:45:00.578 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T07:45:00.982 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T07:45:01.090 INFO:teuthology.misc.health.smithi003.stderr:2024-09-16T07:45:01.086+0000 7f8bd8151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:01.095 INFO:teuthology.misc.health.smithi003.stderr:2024-09-16T07:45:01.096+0000 7f8bd8151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:01.165 INFO:teuthology.misc.health.smithi003.stdout: 2024-09-16T07:45:01.165 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":7,"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","created":"2024-09-16T07:44:57.934858+0000","modified":"2024-09-16T07:45:00.057112+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T07:45:00.057112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"92b524c0-1e32-4c56-a983-7be51186e765","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"51e5f821-e631-4cc1-8a37-d7b188901edf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0a8a850b-ad4a-4499-945d-1c2672d0a2cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d8f5c79f-4068-4ef9-a125-508f70e18ae3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:45:01.175 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-16T07:45:03.289 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-16T07:45:03.290+0000 7fc91753d640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-16T07:45:07.579 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T07:45:07.695 INFO:teuthology.misc.health.smithi003.stderr:2024-09-16T07:45:07.691+0000 7fe6998ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:07.699 INFO:teuthology.misc.health.smithi003.stderr:2024-09-16T07:45:07.700+0000 7fe6998ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:07.901 INFO:teuthology.misc.health.smithi003.stdout: 2024-09-16T07:45:07.901 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":11,"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","created":"2024-09-16T07:44:57.934858+0000","modified":"2024-09-16T07:45:07.355824+0000","last_up_change":"2024-09-16T07:45:05.291607+0000","last_in_change":"2024-09-16T07:45:00.057112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:45:06.304380+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92b524c0-1e32-4c56-a983-7be51186e765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6803","nonce":393843680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":393843680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":393843680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":393843680}]},"public_addr":"172.21.15.3:6803/393843680","cluster_addr":"172.21.15.3:6802/393843680","heartbeat_back_addr":"172.21.15.3:6805/393843680","heartbeat_front_addr":"172.21.15.3:6804/393843680","state":["exists","up"]},{"osd":1,"uuid":"51e5f821-e631-4cc1-8a37-d7b188901edf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":2277929133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6801","nonce":2277929133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6807","nonce":2277929133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2277929133}]},"public_addr":"172.21.15.3:6800/2277929133","cluster_addr":"172.21.15.3:6801/2277929133","heartbeat_back_addr":"172.21.15.3:6807/2277929133","heartbeat_front_addr":"172.21.15.3:6808/2277929133","state":["exists","up"]},{"osd":2,"uuid":"0a8a850b-ad4a-4499-945d-1c2672d0a2cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":1430018171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1430018171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":1430018171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1430018171}]},"public_addr":"172.21.15.134:6803/1430018171","cluster_addr":"172.21.15.134:6802/1430018171","heartbeat_back_addr":"172.21.15.134:6809/1430018171","heartbeat_front_addr":"172.21.15.134:6810/1430018171","state":["exists","up"]},{"osd":3,"uuid":"d8f5c79f-4068-4ef9-a125-508f70e18ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":2457361806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2457361806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2457361806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2457361806}]},"public_addr":"172.21.15.134:6805/2457361806","cluster_addr":"172.21.15.134:6804/2457361806","heartbeat_back_addr":"172.21.15.134:6808/2457361806","heartbeat_front_addr":"172.21.15.134:6807/2457361806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:45:07.913 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-16T07:45:07.913 INFO:tasks.ceph:Creating RBD pool 2024-09-16T07:45:07.913 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T07:45:08.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:08.025+0000 7f7965991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:08.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:08.038+0000 7f7965991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:08.356 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'rbd' created 2024-09-16T07:45:08.380 DEBUG:teuthology.orchestra.run.smithi003:> rbd --cluster ceph pool init rbd 2024-09-16T07:45:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:08.479+0000 7f7774e40ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:08.479+0000 7f7774e40ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:08.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:08.485+0000 7f7774e40ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:11.421 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T07:45:11.422 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-16T07:45:11.423 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T07:45:11.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:11.536+0000 7fafcab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:11.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:11.546+0000 7fafcab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:11.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-16T07:45:11.757 INFO:tasks.ceph_manager:config epoch is 1 2024-09-16T07:45:11.757 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T07:45:11.757 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T07:45:11.758 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T07:45:11.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:11.868+0000 7fb9b2ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:11.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:11.876+0000 7fb9b2ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:12.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:12.134 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":139471361},{"type":"v1","addr":"172.21.15.134:6801","nonce":139471361}]},"active_addr":"172.21.15.134:6801/139471361","active_change":"2024-09-16T07:45:02.282404+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1445867678}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":3894533222}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1695064296}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":1264844727}]}]} 2024-09-16T07:45:12.136 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T07:45:12.136 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T07:45:12.137 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:45:12.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:12.246+0000 7fc933f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:12.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:12.255+0000 7fc933f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:12.454 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:12.454 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":15,"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","created":"2024-09-16T07:44:57.934858+0000","modified":"2024-09-16T07:45:11.375946+0000","last_up_change":"2024-09-16T07:45:05.291607+0000","last_in_change":"2024-09-16T07:45:00.057112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:45:06.304380+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:45:08.254361+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92b524c0-1e32-4c56-a983-7be51186e765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6803","nonce":393843680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":393843680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":393843680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":393843680}]},"public_addr":"172.21.15.3:6803/393843680","cluster_addr":"172.21.15.3:6802/393843680","heartbeat_back_addr":"172.21.15.3:6805/393843680","heartbeat_front_addr":"172.21.15.3:6804/393843680","state":["exists","up"]},{"osd":1,"uuid":"51e5f821-e631-4cc1-8a37-d7b188901edf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":2277929133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6801","nonce":2277929133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6807","nonce":2277929133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2277929133}]},"public_addr":"172.21.15.3:6800/2277929133","cluster_addr":"172.21.15.3:6801/2277929133","heartbeat_back_addr":"172.21.15.3:6807/2277929133","heartbeat_front_addr":"172.21.15.3:6808/2277929133","state":["exists","up"]},{"osd":2,"uuid":"0a8a850b-ad4a-4499-945d-1c2672d0a2cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":1430018171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1430018171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":1430018171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1430018171}]},"public_addr":"172.21.15.134:6803/1430018171","cluster_addr":"172.21.15.134:6802/1430018171","heartbeat_back_addr":"172.21.15.134:6809/1430018171","heartbeat_front_addr":"172.21.15.134:6810/1430018171","state":["exists","up"]},{"osd":3,"uuid":"d8f5c79f-4068-4ef9-a125-508f70e18ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":2457361806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2457361806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2457361806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2457361806}]},"public_addr":"172.21.15.134:6805/2457361806","cluster_addr":"172.21.15.134:6804/2457361806","heartbeat_back_addr":"172.21.15.134:6808/2457361806","heartbeat_front_addr":"172.21.15.134:6807/2457361806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:45:12.467 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T07:45:12.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:45:12.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:12.577+0000 7f285f2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:12.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:12.586+0000 7f285f2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:12.782 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:12.783 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":15,"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","created":"2024-09-16T07:44:57.934858+0000","modified":"2024-09-16T07:45:11.375946+0000","last_up_change":"2024-09-16T07:45:05.291607+0000","last_in_change":"2024-09-16T07:45:00.057112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:45:06.304380+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:45:08.254361+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92b524c0-1e32-4c56-a983-7be51186e765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6803","nonce":393843680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":393843680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":393843680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":393843680}]},"public_addr":"172.21.15.3:6803/393843680","cluster_addr":"172.21.15.3:6802/393843680","heartbeat_back_addr":"172.21.15.3:6805/393843680","heartbeat_front_addr":"172.21.15.3:6804/393843680","state":["exists","up"]},{"osd":1,"uuid":"51e5f821-e631-4cc1-8a37-d7b188901edf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":2277929133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6801","nonce":2277929133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6807","nonce":2277929133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2277929133}]},"public_addr":"172.21.15.3:6800/2277929133","cluster_addr":"172.21.15.3:6801/2277929133","heartbeat_back_addr":"172.21.15.3:6807/2277929133","heartbeat_front_addr":"172.21.15.3:6808/2277929133","state":["exists","up"]},{"osd":2,"uuid":"0a8a850b-ad4a-4499-945d-1c2672d0a2cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":1430018171}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1430018171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":1430018171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1430018171}]},"public_addr":"172.21.15.134:6803/1430018171","cluster_addr":"172.21.15.134:6802/1430018171","heartbeat_back_addr":"172.21.15.134:6809/1430018171","heartbeat_front_addr":"172.21.15.134:6810/1430018171","state":["exists","up"]},{"osd":3,"uuid":"d8f5c79f-4068-4ef9-a125-508f70e18ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":2457361806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2457361806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2457361806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2457361806}]},"public_addr":"172.21.15.134:6805/2457361806","cluster_addr":"172.21.15.134:6804/2457361806","heartbeat_back_addr":"172.21.15.134:6808/2457361806","heartbeat_front_addr":"172.21.15.134:6807/2457361806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:45:12.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T07:45:12.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T07:45:12.797 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T07:45:12.797 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T07:45:12.924 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:12.919+0000 7ff7c3791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:12.924 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:12.919+0000 7f4716b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:12.924 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:12.919+0000 7fd024f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:12.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:12.920+0000 7f11b4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:12.931+0000 7f4716b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:12.931+0000 7fd024f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:12.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:12.931+0000 7ff7c3791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:12.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:12.935+0000 7f11b4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:12.964 INFO:teuthology.orchestra.run.smithi003.stdout:38654705671 2024-09-16T07:45:12.965 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T07:45:12.970 INFO:teuthology.orchestra.run.smithi003.stdout:38654705671 2024-09-16T07:45:12.970 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T07:45:12.976 INFO:teuthology.orchestra.run.smithi003.stdout:38654705671 2024-09-16T07:45:12.976 INFO:teuthology.orchestra.run.smithi003.stdout:38654705671 2024-09-16T07:45:12.977 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T07:45:12.977 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T07:45:13.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:13.079+0000 7f7dc5d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:13.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:13.091+0000 7f7dc5d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:13.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:13.135+0000 7f0841511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:13.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:13.136+0000 7f2523f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:13.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:13.139+0000 7f7dbdb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:13.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:13.147+0000 7f2523f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:13.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:13.147+0000 7f0841511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:13.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:13.151+0000 7f7dbdb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:13.305 INFO:teuthology.orchestra.run.smithi003.stdout:38654705671 2024-09-16T07:45:13.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2024-09-16T07:45:13.320 DEBUG:teuthology.parallel:result is None 2024-09-16T07:45:13.358 INFO:teuthology.orchestra.run.smithi003.stdout:38654705671 2024-09-16T07:45:13.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.3 2024-09-16T07:45:13.372 DEBUG:teuthology.parallel:result is None 2024-09-16T07:45:13.376 INFO:teuthology.orchestra.run.smithi003.stdout:38654705671 2024-09-16T07:45:13.384 INFO:teuthology.orchestra.run.smithi003.stdout:38654705671 2024-09-16T07:45:13.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-09-16T07:45:13.390 DEBUG:teuthology.parallel:result is None 2024-09-16T07:45:13.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-09-16T07:45:13.398 DEBUG:teuthology.parallel:result is None 2024-09-16T07:45:13.398 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:45:13.398 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:13.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:13.548+0000 7f4bfb26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:13.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:13.557+0000 7f4bfb26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:13.751 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:13.751 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:45:13.764 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T07:45:12.959551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108032,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379328,"statfs":{"total":386547056640,"available":386436431872,"internally_reserved":0,"allocated":704512,"data_stored":1906173,"data_compressed":90123,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396744+0000","last_change":"2024-09-16T07:45:11.399603+0000","last_active":"2024-09-16T07:45:11.396744+0000","last_peered":"2024-09-16T07:45:11.396744+0000","last_clean":"2024-09-16T07:45:11.396744+0000","last_became_active":"2024-09-16T07:45:09.463398+0000","last_became_peered":"2024-09-16T07:45:09.463398+0000","last_unstale":"2024-09-16T07:45:11.396744+0000","last_undegraded":"2024-09-16T07:45:11.396744+0000","last_fullsized":"2024-09-16T07:45:11.396744+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:11.396269+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.398355+0000","last_change":"2024-09-16T07:45:11.401508+0000","last_active":"2024-09-16T07:45:11.398355+0000","last_peered":"2024-09-16T07:45:11.398355+0000","last_clean":"2024-09-16T07:45:11.398355+0000","last_became_active":"2024-09-16T07:45:09.435575+0000","last_became_peered":"2024-09-16T07:45:09.435575+0000","last_unstale":"2024-09-16T07:45:11.398355+0000","last_undegraded":"2024-09-16T07:45:11.398355+0000","last_fullsized":"2024-09-16T07:45:11.398355+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:11.396333+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:11.397414+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.392752+0000","last_change":"2024-09-16T07:45:11.395908+0000","last_active":"2024-09-16T07:45:11.392752+0000","last_peered":"2024-09-16T07:45:11.392752+0000","last_clean":"2024-09-16T07:45:11.392752+0000","last_became_active":"2024-09-16T07:45:09.435810+0000","last_became_peered":"2024-09-16T07:45:09.435810+0000","last_unstale":"2024-09-16T07:45:11.392752+0000","last_undegraded":"2024-09-16T07:45:11.392752+0000","last_fullsized":"2024-09-16T07:45:11.392752+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:11.400765+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396937+0000","last_change":"2024-09-16T07:45:11.400212+0000","last_active":"2024-09-16T07:45:11.396937+0000","last_peered":"2024-09-16T07:45:11.396937+0000","last_clean":"2024-09-16T07:45:11.396937+0000","last_became_active":"2024-09-16T07:45:09.452060+0000","last_became_peered":"2024-09-16T07:45:09.452060+0000","last_unstale":"2024-09-16T07:45:11.396937+0000","last_undegraded":"2024-09-16T07:45:11.396937+0000","last_fullsized":"2024-09-16T07:45:11.396937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.395156+0000","last_change":"2024-09-16T07:45:07.405679+0000","last_active":"2024-09-16T07:45:11.395156+0000","last_peered":"2024-09-16T07:45:11.395156+0000","last_clean":"2024-09-16T07:45:11.395156+0000","last_became_active":"2024-09-16T07:45:07.398279+0000","last_became_peered":"2024-09-16T07:45:07.398279+0000","last_unstale":"2024-09-16T07:45:11.395156+0000","last_undegraded":"2024-09-16T07:45:11.395156+0000","last_fullsized":"2024-09-16T07:45:11.395156+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27016,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344824,"statfs":{"total":96636764160,"available":96609099776,"internally_reserved":0,"allocated":188416,"data_stored":624121,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":33772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:13.765 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:13.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:13.875+0000 7f2f9f511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:13.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:13.884+0000 7f2f9f511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:14.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:14.079 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:45:14.092 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T07:45:12.959551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108032,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379328,"statfs":{"total":386547056640,"available":386436431872,"internally_reserved":0,"allocated":704512,"data_stored":1906173,"data_compressed":90123,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396744+0000","last_change":"2024-09-16T07:45:11.399603+0000","last_active":"2024-09-16T07:45:11.396744+0000","last_peered":"2024-09-16T07:45:11.396744+0000","last_clean":"2024-09-16T07:45:11.396744+0000","last_became_active":"2024-09-16T07:45:09.463398+0000","last_became_peered":"2024-09-16T07:45:09.463398+0000","last_unstale":"2024-09-16T07:45:11.396744+0000","last_undegraded":"2024-09-16T07:45:11.396744+0000","last_fullsized":"2024-09-16T07:45:11.396744+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:11.396269+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.398355+0000","last_change":"2024-09-16T07:45:11.401508+0000","last_active":"2024-09-16T07:45:11.398355+0000","last_peered":"2024-09-16T07:45:11.398355+0000","last_clean":"2024-09-16T07:45:11.398355+0000","last_became_active":"2024-09-16T07:45:09.435575+0000","last_became_peered":"2024-09-16T07:45:09.435575+0000","last_unstale":"2024-09-16T07:45:11.398355+0000","last_undegraded":"2024-09-16T07:45:11.398355+0000","last_fullsized":"2024-09-16T07:45:11.398355+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:11.396333+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:11.397414+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.392752+0000","last_change":"2024-09-16T07:45:11.395908+0000","last_active":"2024-09-16T07:45:11.392752+0000","last_peered":"2024-09-16T07:45:11.392752+0000","last_clean":"2024-09-16T07:45:11.392752+0000","last_became_active":"2024-09-16T07:45:09.435810+0000","last_became_peered":"2024-09-16T07:45:09.435810+0000","last_unstale":"2024-09-16T07:45:11.392752+0000","last_undegraded":"2024-09-16T07:45:11.392752+0000","last_fullsized":"2024-09-16T07:45:11.392752+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:11.400765+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396937+0000","last_change":"2024-09-16T07:45:11.400212+0000","last_active":"2024-09-16T07:45:11.396937+0000","last_peered":"2024-09-16T07:45:11.396937+0000","last_clean":"2024-09-16T07:45:11.396937+0000","last_became_active":"2024-09-16T07:45:09.452060+0000","last_became_peered":"2024-09-16T07:45:09.452060+0000","last_unstale":"2024-09-16T07:45:11.396937+0000","last_undegraded":"2024-09-16T07:45:11.396937+0000","last_fullsized":"2024-09-16T07:45:11.396937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.395156+0000","last_change":"2024-09-16T07:45:07.405679+0000","last_active":"2024-09-16T07:45:11.395156+0000","last_peered":"2024-09-16T07:45:11.395156+0000","last_clean":"2024-09-16T07:45:11.395156+0000","last_became_active":"2024-09-16T07:45:07.398279+0000","last_became_peered":"2024-09-16T07:45:07.398279+0000","last_unstale":"2024-09-16T07:45:11.395156+0000","last_undegraded":"2024-09-16T07:45:11.395156+0000","last_fullsized":"2024-09-16T07:45:11.395156+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27016,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344824,"statfs":{"total":96636764160,"available":96609099776,"internally_reserved":0,"allocated":188416,"data_stored":624121,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":33772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:14.092 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:45:14.093 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T07:45:14.093 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T07:45:14.093 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T07:45:14.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:14.202+0000 7f8531991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:14.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:14.210+0000 7f8531991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:14.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:14.442 INFO:teuthology.orchestra.run.smithi003.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T07:45:14.455 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T07:45:14.456 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-16T07:45:14.467 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-16T07:45:14.467 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}} 2024-09-16T07:45:14.467 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-16T07:45:14.467 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-16T07:45:14.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:14.576+0000 7fe203ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:14.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:14.588+0000 7fe203ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:14.803 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-16T07:45:14.803 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:45:14.804 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:14.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:14.914+0000 7f6f3bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:14.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:14.923+0000 7f6f3bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:15.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:15.121 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:45:15.134 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-16T07:45:14.287380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108032,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379328,"statfs":{"total":386547056640,"available":386436431872,"internally_reserved":0,"allocated":704512,"data_stored":1906173,"data_compressed":90123,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.327829"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396744+0000","last_change":"2024-09-16T07:45:11.399603+0000","last_active":"2024-09-16T07:45:11.396744+0000","last_peered":"2024-09-16T07:45:11.396744+0000","last_clean":"2024-09-16T07:45:11.396744+0000","last_became_active":"2024-09-16T07:45:09.463398+0000","last_became_peered":"2024-09-16T07:45:09.463398+0000","last_unstale":"2024-09-16T07:45:11.396744+0000","last_undegraded":"2024-09-16T07:45:11.396744+0000","last_fullsized":"2024-09-16T07:45:11.396744+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:11.396269+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.398355+0000","last_change":"2024-09-16T07:45:11.401508+0000","last_active":"2024-09-16T07:45:11.398355+0000","last_peered":"2024-09-16T07:45:11.398355+0000","last_clean":"2024-09-16T07:45:11.398355+0000","last_became_active":"2024-09-16T07:45:09.435575+0000","last_became_peered":"2024-09-16T07:45:09.435575+0000","last_unstale":"2024-09-16T07:45:11.398355+0000","last_undegraded":"2024-09-16T07:45:11.398355+0000","last_fullsized":"2024-09-16T07:45:11.398355+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:11.396333+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:11.397414+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.392752+0000","last_change":"2024-09-16T07:45:11.395908+0000","last_active":"2024-09-16T07:45:11.392752+0000","last_peered":"2024-09-16T07:45:11.392752+0000","last_clean":"2024-09-16T07:45:11.392752+0000","last_became_active":"2024-09-16T07:45:09.435810+0000","last_became_peered":"2024-09-16T07:45:09.435810+0000","last_unstale":"2024-09-16T07:45:11.392752+0000","last_undegraded":"2024-09-16T07:45:11.392752+0000","last_fullsized":"2024-09-16T07:45:11.392752+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:11.400765+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396937+0000","last_change":"2024-09-16T07:45:11.400212+0000","last_active":"2024-09-16T07:45:11.396937+0000","last_peered":"2024-09-16T07:45:11.396937+0000","last_clean":"2024-09-16T07:45:11.396937+0000","last_became_active":"2024-09-16T07:45:09.452060+0000","last_became_peered":"2024-09-16T07:45:09.452060+0000","last_unstale":"2024-09-16T07:45:11.396937+0000","last_undegraded":"2024-09-16T07:45:11.396937+0000","last_fullsized":"2024-09-16T07:45:11.396937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.395156+0000","last_change":"2024-09-16T07:45:07.405679+0000","last_active":"2024-09-16T07:45:11.395156+0000","last_peered":"2024-09-16T07:45:11.395156+0000","last_clean":"2024-09-16T07:45:11.395156+0000","last_became_active":"2024-09-16T07:45:07.398279+0000","last_became_peered":"2024-09-16T07:45:07.398279+0000","last_unstale":"2024-09-16T07:45:11.395156+0000","last_undegraded":"2024-09-16T07:45:11.395156+0000","last_fullsized":"2024-09-16T07:45:11.395156+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27016,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344824,"statfs":{"total":96636764160,"available":96609099776,"internally_reserved":0,"allocated":188416,"data_stored":624121,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":33772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:15.135 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:15.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:15.245+0000 7f4af78fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:15.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:15.254+0000 7f4af78fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:15.452 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:15.452 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:45:15.465 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-16T07:45:14.287380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108032,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379328,"statfs":{"total":386547056640,"available":386436431872,"internally_reserved":0,"allocated":704512,"data_stored":1906173,"data_compressed":90123,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.327829"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396744+0000","last_change":"2024-09-16T07:45:11.399603+0000","last_active":"2024-09-16T07:45:11.396744+0000","last_peered":"2024-09-16T07:45:11.396744+0000","last_clean":"2024-09-16T07:45:11.396744+0000","last_became_active":"2024-09-16T07:45:09.463398+0000","last_became_peered":"2024-09-16T07:45:09.463398+0000","last_unstale":"2024-09-16T07:45:11.396744+0000","last_undegraded":"2024-09-16T07:45:11.396744+0000","last_fullsized":"2024-09-16T07:45:11.396744+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:11.396269+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.398355+0000","last_change":"2024-09-16T07:45:11.401508+0000","last_active":"2024-09-16T07:45:11.398355+0000","last_peered":"2024-09-16T07:45:11.398355+0000","last_clean":"2024-09-16T07:45:11.398355+0000","last_became_active":"2024-09-16T07:45:09.435575+0000","last_became_peered":"2024-09-16T07:45:09.435575+0000","last_unstale":"2024-09-16T07:45:11.398355+0000","last_undegraded":"2024-09-16T07:45:11.398355+0000","last_fullsized":"2024-09-16T07:45:11.398355+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:11.396333+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:11.397414+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.392752+0000","last_change":"2024-09-16T07:45:11.395908+0000","last_active":"2024-09-16T07:45:11.392752+0000","last_peered":"2024-09-16T07:45:11.392752+0000","last_clean":"2024-09-16T07:45:11.392752+0000","last_became_active":"2024-09-16T07:45:09.435810+0000","last_became_peered":"2024-09-16T07:45:09.435810+0000","last_unstale":"2024-09-16T07:45:11.392752+0000","last_undegraded":"2024-09-16T07:45:11.392752+0000","last_fullsized":"2024-09-16T07:45:11.392752+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:11.400765+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396937+0000","last_change":"2024-09-16T07:45:11.400212+0000","last_active":"2024-09-16T07:45:11.396937+0000","last_peered":"2024-09-16T07:45:11.396937+0000","last_clean":"2024-09-16T07:45:11.396937+0000","last_became_active":"2024-09-16T07:45:09.452060+0000","last_became_peered":"2024-09-16T07:45:09.452060+0000","last_unstale":"2024-09-16T07:45:11.396937+0000","last_undegraded":"2024-09-16T07:45:11.396937+0000","last_fullsized":"2024-09-16T07:45:11.396937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.395156+0000","last_change":"2024-09-16T07:45:07.405679+0000","last_active":"2024-09-16T07:45:11.395156+0000","last_peered":"2024-09-16T07:45:11.395156+0000","last_clean":"2024-09-16T07:45:11.395156+0000","last_became_active":"2024-09-16T07:45:07.398279+0000","last_became_peered":"2024-09-16T07:45:07.398279+0000","last_unstale":"2024-09-16T07:45:11.395156+0000","last_undegraded":"2024-09-16T07:45:11.395156+0000","last_fullsized":"2024-09-16T07:45:11.395156+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27016,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344824,"statfs":{"total":96636764160,"available":96609099776,"internally_reserved":0,"allocated":188416,"data_stored":624121,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":33772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:15.466 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:45:15.466 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-16T07:45:15.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:15.575+0000 7f2c48751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:15.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:15.584+0000 7f2c48751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:15.780 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 15 2024-09-16T07:45:15.780 INFO:teuthology.orchestra.run.smithi003.stdout:fsid a7173a3e-ffed-4f8e-a112-99abc87b4a6b 2024-09-16T07:45:15.780 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-16T07:44:57.934858+0000 2024-09-16T07:45:15.780 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-16T07:45:11.375946+0000 2024-09-16T07:45:15.780 INFO:teuthology.orchestra.run.smithi003.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-16T07:45:15.780 INFO:teuthology.orchestra.run.smithi003.stdout:crush_version 3 2024-09-16T07:45:15.780 INFO:teuthology.orchestra.run.smithi003.stdout:full_ratio 0.95 2024-09-16T07:45:15.780 INFO:teuthology.orchestra.run.smithi003.stdout:backfillfull_ratio 0.9 2024-09-16T07:45:15.780 INFO:teuthology.orchestra.run.smithi003.stdout:nearfull_ratio 0.85 2024-09-16T07:45:15.780 INFO:teuthology.orchestra.run.smithi003.stdout:require_min_compat_client luminous 2024-09-16T07:45:15.781 INFO:teuthology.orchestra.run.smithi003.stdout:min_compat_client jewel 2024-09-16T07:45:15.781 INFO:teuthology.orchestra.run.smithi003.stdout:require_osd_release squid 2024-09-16T07:45:15.781 INFO:teuthology.orchestra.run.smithi003.stdout:stretch_mode_enabled false 2024-09-16T07:45:15.781 INFO:teuthology.orchestra.run.smithi003.stdout:allow_crimson=true 2024-09-16T07:45:15.781 INFO:teuthology.orchestra.run.smithi003.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool,nopgchange,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2024-09-16T07:45:15.781 INFO:teuthology.orchestra.run.smithi003.stdout:pool 2 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,nopgchange,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 1.50 2024-09-16T07:45:15.781 INFO:teuthology.orchestra.run.smithi003.stdout: removed_snaps_queue [2~1] 2024-09-16T07:45:15.781 INFO:teuthology.orchestra.run.smithi003.stdout:max_osd 4 2024-09-16T07:45:15.781 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 up in weight 1 up_from 9 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.3:6803/393843680 v2:172.21.15.3:6802/393843680 exists,up 92b524c0-1e32-4c56-a983-7be51186e765 2024-09-16T07:45:15.781 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 up in weight 1 up_from 9 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.3:6800/2277929133 v2:172.21.15.3:6801/2277929133 exists,up 51e5f821-e631-4cc1-8a37-d7b188901edf 2024-09-16T07:45:15.781 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 up in weight 1 up_from 9 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.134:6803/1430018171 v2:172.21.15.134:6802/1430018171 exists,up 0a8a850b-ad4a-4499-945d-1c2672d0a2cb 2024-09-16T07:45:15.781 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 up in weight 1 up_from 9 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.134:6805/2457361806 v2:172.21.15.134:6804/2457361806 exists,up d8f5c79f-4068-4ef9-a125-508f70e18ae3 2024-09-16T07:45:15.793 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.3:6803/393843680 v2:172.21.15.3:6802/393843680 exists,up 92b524c0-1e32-4c56-a983-7be51186e765', 'osd.1 up in weight 1 up_from 9 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.3:6800/2277929133 v2:172.21.15.3:6801/2277929133 exists,up 51e5f821-e631-4cc1-8a37-d7b188901edf', 'osd.2 up in weight 1 up_from 9 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.134:6803/1430018171 v2:172.21.15.134:6802/1430018171 exists,up 0a8a850b-ad4a-4499-945d-1c2672d0a2cb', 'osd.3 up in weight 1 up_from 9 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.134:6805/2457361806 v2:172.21.15.134:6804/2457361806 exists,up d8f5c79f-4068-4ef9-a125-508f70e18ae3'] 2024-09-16T07:45:15.793 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-16T07:45:15.903 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T07:45:15.903 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mon.a", 2024-09-16T07:45:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster": "ceph", 2024-09-16T07:45:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-16T07:45:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: "admin_socket_mode": "", 2024-09-16T07:45:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-16T07:45:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_client_required": "cephx, none", 2024-09-16T07:45:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_cluster_required": "cephx", 2024-09-16T07:45:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_debug": "true", 2024-09-16T07:45:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-16T07:45:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-16T07:45:15.904 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_service_required": "cephx", 2024-09-16T07:45:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-16T07:45:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: "auth_supported": "cephx", 2024-09-16T07:45:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_aio": "true", 2024-09-16T07:45:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-16T07:45:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_aio_poll_ms": "250", 2024-09-16T07:45:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_aio_reap_max": "16", 2024-09-16T07:45:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_async_discard_threads": "0", 2024-09-16T07:45:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_block_size": "4096", 2024-09-16T07:45:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_debug_aio": "false", 2024-09-16T07:45:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-16T07:45:15.905 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-16T07:45:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_debug_inflight_ios": "false", 2024-09-16T07:45:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_enable_discard": "false", 2024-09-16T07:45:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_flock_retry": "3", 2024-09-16T07:45:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-16T07:45:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_inject_crash": "0", 2024-09-16T07:45:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-16T07:45:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_ioring": "false", 2024-09-16T07:45:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_ioring_hipri": "false", 2024-09-16T07:45:15.906 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-16T07:45:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-16T07:45:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-16T07:45:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-16T07:45:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-16T07:45:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-16T07:45:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: "bdev_type": "", 2024-09-16T07:45:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_alloc_size": "1048576", 2024-09-16T07:45:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_allocator": "hybrid", 2024-09-16T07:45:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_buffered_io": "true", 2024-09-16T07:45:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_check_for_zeros": "false", 2024-09-16T07:45:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-16T07:45:15.907 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-16T07:45:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_compact_log_sync": "false", 2024-09-16T07:45:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-16T07:45:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-16T07:45:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-16T07:45:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-16T07:45:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_max_log_runway": "4194304", 2024-09-16T07:45:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_max_prefetch": "1048576", 2024-09-16T07:45:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_min_flush_size": "524288", 2024-09-16T07:45:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_min_log_runway": "1048576", 2024-09-16T07:45:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_replay_recovery": "false", 2024-09-16T07:45:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-16T07:45:15.908 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-16T07:45:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_sync_write": "false", 2024-09-16T07:45:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-16T07:45:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-16T07:45:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-16T07:45:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_allocation_from_file": "true", 2024-09-16T07:45:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_allocator": "hybrid", 2024-09-16T07:45:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_async_db_compaction": "true", 2024-09-16T07:45:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-16T07:45:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-16T07:45:15.909 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-16T07:45:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-16T07:45:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_bdev_label_multi": "true", 2024-09-16T07:45:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-16T07:45:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-16T07:45:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-16T07:45:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-16T07:45:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-16T07:45:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_block_create": "true", 2024-09-16T07:45:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_block_db_create": "false", 2024-09-16T07:45:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_block_db_path": "", 2024-09-16T07:45:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_block_db_size": "0", 2024-09-16T07:45:15.910 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_block_path": "", 2024-09-16T07:45:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_block_preallocate_file": "false", 2024-09-16T07:45:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_block_size": "107374182400", 2024-09-16T07:45:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_block_wal_create": "false", 2024-09-16T07:45:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_block_wal_path": "", 2024-09-16T07:45:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_block_wal_size": "100663296", 2024-09-16T07:45:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_bluefs": "true", 2024-09-16T07:45:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-16T07:45:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-16T07:45:15.911 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-16T07:45:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-16T07:45:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-16T07:45:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T07:45:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T07:45:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-16T07:45:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T07:45:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_autotune": "true", 2024-09-16T07:45:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-16T07:45:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-16T07:45:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-16T07:45:15.912 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-16T07:45:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_size": "0", 2024-09-16T07:45:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-16T07:45:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-16T07:45:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-16T07:45:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-16T07:45:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_type": "2q", 2024-09-16T07:45:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-16T07:45:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_clone_cow": "true", 2024-09-16T07:45:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-16T07:45:15.913 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-16T07:45:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-16T07:45:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-16T07:45:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-16T07:45:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-16T07:45:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-16T07:45:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_compression_mode": "none", 2024-09-16T07:45:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-16T07:45:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_csum_type": "crc32c", 2024-09-16T07:45:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-16T07:45:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-16T07:45:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_freelist": "false", 2024-09-16T07:45:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-16T07:45:15.914 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-16T07:45:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-16T07:45:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-16T07:45:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-16T07:45:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-16T07:45:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-16T07:45:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-16T07:45:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-16T07:45:15.915 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-16T07:45:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-16T07:45:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-16T07:45:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_small_allocations": "0", 2024-09-16T07:45:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-16T07:45:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_default_buffered_read": "true", 2024-09-16T07:45:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_default_buffered_write": "false", 2024-09-16T07:45:15.916 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-16T07:45:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-16T07:45:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-16T07:45:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-16T07:45:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-16T07:45:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-16T07:45:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-16T07:45:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-16T07:45:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-16T07:45:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fail_eio": "false", 2024-09-16T07:45:15.917 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-16T07:45:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-16T07:45:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-16T07:45:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-16T07:45:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-16T07:45:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-16T07:45:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_on_mount": "false", 2024-09-16T07:45:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-16T07:45:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_on_umount": "false", 2024-09-16T07:45:15.918 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-16T07:45:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-16T07:45:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-16T07:45:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-16T07:45:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-16T07:45:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-16T07:45:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-16T07:45:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-16T07:45:15.919 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_ignore_data_csum": "false", 2024-09-16T07:45:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-16T07:45:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-16T07:45:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-16T07:45:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-16T07:45:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_log_op_age": "5.000000", 2024-09-16T07:45:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_max_alloc_size": "0", 2024-09-16T07:45:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_max_blob_size": "0", 2024-09-16T07:45:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-16T07:45:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-16T07:45:15.920 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-16T07:45:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_max_deferred_txc": "32", 2024-09-16T07:45:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_min_alloc_size": "0", 2024-09-16T07:45:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-16T07:45:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-16T07:45:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_nid_prealloc": "1024", 2024-09-16T07:45:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-16T07:45:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-16T07:45:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-16T07:45:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-16T07:45:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_retry_disk_reads": "3", 2024-09-16T07:45:15.921 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_rocksdb_cf": "true", 2024-09-16T07:45:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-16T07:45:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-16T07:45:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-16T07:45:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-16T07:45:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-16T07:45:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-16T07:45:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-16T07:45:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-16T07:45:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_spdk_mem": "512", 2024-09-16T07:45:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-16T07:45:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-16T07:45:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-16T07:45:15.922 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-16T07:45:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-16T07:45:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-16T07:45:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-16T07:45:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_tracing": "false", 2024-09-16T07:45:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-16T07:45:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-16T07:45:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-16T07:45:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-16T07:45:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-16T07:45:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-16T07:45:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-16T07:45:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-16T07:45:15.923 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-16T07:45:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_write_v2": "false", 2024-09-16T07:45:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_write_v2_random": "false", 2024-09-16T07:45:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_zero_block_detection": "false", 2024-09-16T07:45:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-16T07:45:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-16T07:45:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-16T07:45:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-16T07:45:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-16T07:45:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-16T07:45:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-16T07:45:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-16T07:45:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-16T07:45:15.924 INFO:teuthology.orchestra.run.smithi003.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-16T07:45:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-16T07:45:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-16T07:45:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-16T07:45:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-16T07:45:15.925 INFO:teuthology.orchestra.run.smithi003.stdout: "cephx_cluster_require_signatures": "false", 2024-09-16T07:45:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: "cephx_cluster_require_version": "2", 2024-09-16T07:45:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: "cephx_require_signatures": "false", 2024-09-16T07:45:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: "cephx_require_version": "2", 2024-09-16T07:45:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: "cephx_service_require_signatures": "false", 2024-09-16T07:45:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: "cephx_service_require_version": "2", 2024-09-16T07:45:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: "cephx_sign_messages": "true", 2024-09-16T07:45:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: "chdir": "", 2024-09-16T07:45:15.926 INFO:teuthology.orchestra.run.smithi003.stdout: "client_acl_type": "", 2024-09-16T07:45:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: "client_asio_thread_count": "2", 2024-09-16T07:45:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: "client_cache_mid": "0.750000", 2024-09-16T07:45:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: "client_cache_size": "16384", 2024-09-16T07:45:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: "client_caps_release_delay": "5", 2024-09-16T07:45:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: "client_check_pool_perm": "true", 2024-09-16T07:45:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-16T07:45:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: "client_debug_force_sync_read": "false", 2024-09-16T07:45:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: "client_debug_getattr_caps": "false", 2024-09-16T07:45:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: "client_debug_inject_features": "", 2024-09-16T07:45:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: "client_debug_inject_tick_delay": "0", 2024-09-16T07:45:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-16T07:45:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: "client_die_on_failed_remount": "false", 2024-09-16T07:45:15.927 INFO:teuthology.orchestra.run.smithi003.stdout: "client_dirsize_rbytes": "true", 2024-09-16T07:45:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: "client_force_lazyio": "false", 2024-09-16T07:45:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: "client_fs": "", 2024-09-16T07:45:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-16T07:45:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: "client_inject_release_failure": "false", 2024-09-16T07:45:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: "client_max_inline_size": "4096", 2024-09-16T07:45:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-16T07:45:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: "client_mds_namespace": "", 2024-09-16T07:45:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: "client_metadata": "", 2024-09-16T07:45:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: "client_mount_gid": "-1", 2024-09-16T07:45:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: "client_mount_timeout": "300", 2024-09-16T07:45:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: "client_mount_uid": "-1", 2024-09-16T07:45:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: "client_mountpoint": "/", 2024-09-16T07:45:15.928 INFO:teuthology.orchestra.run.smithi003.stdout: "client_notify_timeout": "10", 2024-09-16T07:45:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: "client_oc": "true", 2024-09-16T07:45:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: "client_oc_max_dirty": "104857600", 2024-09-16T07:45:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-16T07:45:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: "client_oc_max_objects": "1000", 2024-09-16T07:45:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: "client_oc_size": "209715200", 2024-09-16T07:45:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: "client_oc_target_dirty": "8388608", 2024-09-16T07:45:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: "client_permissions": "true", 2024-09-16T07:45:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: "client_quota": "true", 2024-09-16T07:45:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: "client_quota_df": "true", 2024-09-16T07:45:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: "client_readahead_max_bytes": "0", 2024-09-16T07:45:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: "client_readahead_max_periods": "4", 2024-09-16T07:45:15.929 INFO:teuthology.orchestra.run.smithi003.stdout: "client_readahead_min": "131072", 2024-09-16T07:45:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: "client_reconnect_stale": "false", 2024-09-16T07:45:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: "client_shutdown_timeout": "30", 2024-09-16T07:45:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: "client_snapdir": ".snap", 2024-09-16T07:45:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: "client_tick_interval": "1", 2024-09-16T07:45:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: "client_trace": "", 2024-09-16T07:45:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: "client_try_dentry_invalidate": "false", 2024-09-16T07:45:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: "client_use_faked_inos": "false", 2024-09-16T07:45:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: "client_use_random_mds": "false", 2024-09-16T07:45:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: "clog_to_graylog": "false", 2024-09-16T07:45:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-16T07:45:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: "clog_to_graylog_port": "12201", 2024-09-16T07:45:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: "clog_to_monitors": "default=true", 2024-09-16T07:45:15.930 INFO:teuthology.orchestra.run.smithi003.stdout: "clog_to_syslog": "false", 2024-09-16T07:45:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-16T07:45:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: "clog_to_syslog_level": "info", 2024-09-16T07:45:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_addr": "-", 2024-09-16T07:45:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_network": "", 2024-09-16T07:45:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_network_interface": "", 2024-09-16T07:45:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: "compressor_zlib_isal": "false", 2024-09-16T07:45:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: "compressor_zlib_level": "5", 2024-09-16T07:45:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: "compressor_zlib_winsize": "-15", 2024-09-16T07:45:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: "compressor_zstd_level": "1", 2024-09-16T07:45:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-16T07:45:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-16T07:45:15.931 INFO:teuthology.orchestra.run.smithi003.stdout: "crimson_alien_op_num_threads": "6", 2024-09-16T07:45:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-16T07:45:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-16T07:45:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-16T07:45:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: "crimson_osd_stat_interval": "0", 2024-09-16T07:45:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: "crimson_seastar_cpu_cores": "", 2024-09-16T07:45:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: "crimson_seastar_num_threads": "0", 2024-09-16T07:45:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location": "", 2024-09-16T07:45:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location_hook": "", 2024-09-16T07:45:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_location_hook_timeout": "10", 2024-09-16T07:45:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: "daemonize": "false", 2024-09-16T07:45:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: "daos_pool": "tank", 2024-09-16T07:45:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-16T07:45:15.932 INFO:teuthology.orchestra.run.smithi003.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-16T07:45:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-16T07:45:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_alienstore": "0/5", 2024-09-16T07:45:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_allow_any_pool_priority": "false", 2024-09-16T07:45:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_asok": "1/5", 2024-09-16T07:45:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_asok_assert_abort": "false", 2024-09-16T07:45:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_asserts_on_shutdown": "true", 2024-09-16T07:45:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_auth": "20/20", 2024-09-16T07:45:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_bdev": "1/3", 2024-09-16T07:45:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_bluefs": "1/5", 2024-09-16T07:45:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_bluestore": "1/5", 2024-09-16T07:45:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_buffer": "0/1", 2024-09-16T07:45:15.933 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_ceph_dedup": "0/5", 2024-09-16T07:45:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_ceph_exporter": "1/5", 2024-09-16T07:45:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_cephfs_mirror": "0/5", 2024-09-16T07:45:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_cephsqlite": "0/5", 2024-09-16T07:45:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_client": "0/5", 2024-09-16T07:45:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_compressor": "1/5", 2024-09-16T07:45:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_context": "0/1", 2024-09-16T07:45:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_crimson_interrupt": "0/5", 2024-09-16T07:45:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_crush": "1/1", 2024-09-16T07:45:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_crypto": "1/5", 2024-09-16T07:45:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_cyanstore": "0/5", 2024-09-16T07:45:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_deliberately_leak_memory": "false", 2024-09-16T07:45:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_disable_randomized_ping": "false", 2024-09-16T07:45:15.934 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_dpdk": "1/5", 2024-09-16T07:45:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_eventtrace": "1/5", 2024-09-16T07:45:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_filer": "0/1", 2024-09-16T07:45:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_filestore": "1/3", 2024-09-16T07:45:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_finisher": "1/1", 2024-09-16T07:45:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_fuse": "1/5", 2024-09-16T07:45:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_heartbeat_testing_span": "0", 2024-09-16T07:45:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_heartbeatmap": "1/5", 2024-09-16T07:45:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-16T07:45:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_javaclient": "1/5", 2024-09-16T07:45:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_journal": "1/3", 2024-09-16T07:45:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_journaler": "0/5", 2024-09-16T07:45:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_kstore": "1/5", 2024-09-16T07:45:15.935 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_lockdep": "0/1", 2024-09-16T07:45:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_mclock": "1/5", 2024-09-16T07:45:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_mds": "1/5", 2024-09-16T07:45:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_mds_balancer": "1/5", 2024-09-16T07:45:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_mds_locker": "1/5", 2024-09-16T07:45:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_mds_log": "1/5", 2024-09-16T07:45:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_mds_log_expire": "1/5", 2024-09-16T07:45:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_mds_migrator": "1/5", 2024-09-16T07:45:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_mds_quiesce": "3/5", 2024-09-16T07:45:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_memstore": "1/5", 2024-09-16T07:45:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_mgr": "2/5", 2024-09-16T07:45:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_mgrc": "1/5", 2024-09-16T07:45:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_mon": "20/20", 2024-09-16T07:45:15.936 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_monc": "0/10", 2024-09-16T07:45:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_ms": "1/1", 2024-09-16T07:45:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_none": "0/5", 2024-09-16T07:45:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_objclass": "0/5", 2024-09-16T07:45:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_objectcacher": "0/5", 2024-09-16T07:45:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_objecter": "0/1", 2024-09-16T07:45:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_optracker": "0/5", 2024-09-16T07:45:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_osd": "1/5", 2024-09-16T07:45:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_paxos": "20/20", 2024-09-16T07:45:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_perfcounter": "1/5", 2024-09-16T07:45:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_prioritycache": "1/5", 2024-09-16T07:45:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_rados": "0/5", 2024-09-16T07:45:15.937 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_rbd": "0/5", 2024-09-16T07:45:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_rbd_mirror": "0/5", 2024-09-16T07:45:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_rbd_pwl": "0/5", 2024-09-16T07:45:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_rbd_replay": "0/5", 2024-09-16T07:45:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_refs": "0/0", 2024-09-16T07:45:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_reserver": "1/1", 2024-09-16T07:45:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_rgw": "1/5", 2024-09-16T07:45:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_rgw_access": "1/5", 2024-09-16T07:45:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_rgw_datacache": "1/5", 2024-09-16T07:45:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_rgw_dbstore": "1/5", 2024-09-16T07:45:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_rgw_flight": "1/5", 2024-09-16T07:45:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-16T07:45:15.938 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_rgw_notification": "1/5", 2024-09-16T07:45:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_rgw_sync": "1/5", 2024-09-16T07:45:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_rocksdb": "4/5", 2024-09-16T07:45:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_seastore": "0/5", 2024-09-16T07:45:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_seastore_backref": "0/5", 2024-09-16T07:45:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_seastore_cache": "0/5", 2024-09-16T07:45:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_seastore_cleaner": "0/5", 2024-09-16T07:45:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_seastore_device": "0/5", 2024-09-16T07:45:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_seastore_epm": "0/5", 2024-09-16T07:45:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-16T07:45:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_seastore_journal": "0/5", 2024-09-16T07:45:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_seastore_lba": "0/5", 2024-09-16T07:45:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_seastore_odata": "0/5", 2024-09-16T07:45:15.939 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_seastore_omap": "0/5", 2024-09-16T07:45:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_seastore_onode": "0/5", 2024-09-16T07:45:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_seastore_t": "0/5", 2024-09-16T07:45:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_seastore_tm": "0/5", 2024-09-16T07:45:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_striper": "0/1", 2024-09-16T07:45:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_test": "0/5", 2024-09-16T07:45:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_throttle": "1/1", 2024-09-16T07:45:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_timer": "0/1", 2024-09-16T07:45:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_tp": "0/5", 2024-09-16T07:45:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: "debug_trace": "1/5", 2024-09-16T07:45:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-16T07:45:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: "device_failure_prediction_mode": "none", 2024-09-16T07:45:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2024-09-16T07:45:15.940 INFO:teuthology.orchestra.run.smithi003.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-16T07:45:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: "err_to_graylog": "false", 2024-09-16T07:45:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: "err_to_journald": "false", 2024-09-16T07:45:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: "err_to_stderr": "true", 2024-09-16T07:45:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: "err_to_syslog": "false", 2024-09-16T07:45:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: "event_tracing": "false", 2024-09-16T07:45:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: "exporter_addr": "0.0.0.0", 2024-09-16T07:45:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: "exporter_cert_file": "", 2024-09-16T07:45:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: "exporter_http_port": "9926", 2024-09-16T07:45:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: "exporter_key_file": "", 2024-09-16T07:45:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: "exporter_prio_limit": "5", 2024-09-16T07:45:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-16T07:45:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: "exporter_sort_metrics": "true", 2024-09-16T07:45:15.941 INFO:teuthology.orchestra.run.smithi003.stdout: "exporter_stats_period": "5", 2024-09-16T07:45:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: "fake_statfs_for_testing": "0", 2024-09-16T07:45:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: "fatal_signal_handlers": "true", 2024-09-16T07:45:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: "filer_max_purge_ops": "10", 2024-09-16T07:45:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: "filer_max_truncate_ops": "128", 2024-09-16T07:45:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_apply_finisher_threads": "1", 2024-09-16T07:45:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_blackhole": "false", 2024-09-16T07:45:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_btrfs_clone_range": "true", 2024-09-16T07:45:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_btrfs_snap": "true", 2024-09-16T07:45:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_caller_concurrency": "10", 2024-09-16T07:45:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_collect_device_partition_information": "true", 2024-09-16T07:45:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_commit_timeout": "600.000000", 2024-09-16T07:45:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_debug_inject_read_err": "false", 2024-09-16T07:45:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_debug_omap_check": "false", 2024-09-16T07:45:15.942 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_debug_verify_split": "false", 2024-09-16T07:45:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_dump_file": "", 2024-09-16T07:45:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-16T07:45:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-16T07:45:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_fadvise": "true", 2024-09-16T07:45:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_fail_eio": "true", 2024-09-16T07:45:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_fd_cache_shards": "16", 2024-09-16T07:45:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_fd_cache_size": "128", 2024-09-16T07:45:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_fiemap": "false", 2024-09-16T07:45:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_fiemap_threshold": "4096", 2024-09-16T07:45:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-16T07:45:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-16T07:45:15.943 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_inject_stall": "0", 2024-09-16T07:45:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_journal_parallel": "false", 2024-09-16T07:45:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_journal_trailing": "false", 2024-09-16T07:45:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_journal_writeahead": "false", 2024-09-16T07:45:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_kill_at": "0", 2024-09-16T07:45:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-16T07:45:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-16T07:45:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-16T07:45:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-16T07:45:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-16T07:45:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_max_inline_xattrs": "0", 2024-09-16T07:45:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-16T07:45:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-16T07:45:15.944 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-16T07:45:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-16T07:45:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_max_xattr_value_size": "0", 2024-09-16T07:45:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-16T07:45:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-16T07:45:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-16T07:45:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_merge_threshold": "-10", 2024-09-16T07:45:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-16T07:45:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_odsync_write": "false", 2024-09-16T07:45:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_omap_backend": "rocksdb", 2024-09-16T07:45:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_omap_backend_path": "", 2024-09-16T07:45:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-16T07:45:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-16T07:45:15.945 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-16T07:45:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_op_thread_timeout": "60", 2024-09-16T07:45:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_op_threads": "2", 2024-09-16T07:45:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_punch_hole": "false", 2024-09-16T07:45:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-16T07:45:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-16T07:45:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-16T07:45:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-16T07:45:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-16T07:45:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-16T07:45:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-16T07:45:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-16T07:45:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-16T07:45:15.946 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_queue_max_ops": "50", 2024-09-16T07:45:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-16T07:45:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_seek_data_hole": "false", 2024-09-16T07:45:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_sloppy_crc": "false", 2024-09-16T07:45:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-16T07:45:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_splice": "false", 2024-09-16T07:45:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_split_multiple": "2", 2024-09-16T07:45:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_split_rand_factor": "20", 2024-09-16T07:45:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_update_to": "1000", 2024-09-16T07:45:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-16T07:45:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-16T07:45:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-16T07:45:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-16T07:45:15.947 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-16T07:45:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-16T07:45:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_wbthrottle_enable": "true", 2024-09-16T07:45:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-16T07:45:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-16T07:45:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-16T07:45:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-16T07:45:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-16T07:45:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-16T07:45:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_xfs_extsize": "false", 2024-09-16T07:45:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: "filestore_zfs_snap": "false", 2024-09-16T07:45:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: "fio_dir": "/tmp/fio", 2024-09-16T07:45:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: "fsid": "a7173a3e-ffed-4f8e-a112-99abc87b4a6b", 2024-09-16T07:45:15.948 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_allow_other": "true", 2024-09-16T07:45:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_atomic_o_trunc": "true", 2024-09-16T07:45:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_big_writes": "true", 2024-09-16T07:45:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_debug": "false", 2024-09-16T07:45:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_default_permissions": "false", 2024-09-16T07:45:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_disable_pagecache": "false", 2024-09-16T07:45:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_max_write": "0", 2024-09-16T07:45:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_multithreaded": "true", 2024-09-16T07:45:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_require_active_mds": "true", 2024-09-16T07:45:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_set_user_groups": "true", 2024-09-16T07:45:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_splice_move": "true", 2024-09-16T07:45:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_splice_read": "true", 2024-09-16T07:45:15.949 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_splice_write": "true", 2024-09-16T07:45:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-16T07:45:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: "fuse_use_invalidate_cb": "true", 2024-09-16T07:45:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-16T07:45:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: "gss_target_name": "ceph", 2024-09-16T07:45:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: "heartbeat_file": "", 2024-09-16T07:45:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: "heartbeat_inject_failure": "0", 2024-09-16T07:45:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: "heartbeat_interval": "5", 2024-09-16T07:45:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: "host": "smithi003", 2024-09-16T07:45:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-16T07:45:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-16T07:45:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-16T07:45:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-16T07:45:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-16T07:45:15.950 INFO:teuthology.orchestra.run.smithi003.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-16T07:45:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-16T07:45:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-16T07:45:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-16T07:45:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-16T07:45:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-16T07:45:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-16T07:45:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-16T07:45:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: "inject_early_sigterm": "false", 2024-09-16T07:45:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: "jaeger_agent_port": "6799", 2024-09-16T07:45:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: "jaeger_tracing_enable": "false", 2024-09-16T07:45:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_aio": "true", 2024-09-16T07:45:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_align_min_size": "65536", 2024-09-16T07:45:15.951 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_block_align": "true", 2024-09-16T07:45:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_block_size": "4096", 2024-09-16T07:45:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_dio": "true", 2024-09-16T07:45:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_discard": "false", 2024-09-16T07:45:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_force_aio": "false", 2024-09-16T07:45:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_ignore_corruption": "false", 2024-09-16T07:45:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_max_write_bytes": "10485760", 2024-09-16T07:45:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_max_write_entries": "100", 2024-09-16T07:45:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_replay_from": "0", 2024-09-16T07:45:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-16T07:45:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-16T07:45:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-16T07:45:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-16T07:45:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_write_header_frequency": "0", 2024-09-16T07:45:15.952 INFO:teuthology.orchestra.run.smithi003.stdout: "journal_zero_on_create": "false", 2024-09-16T07:45:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: "journaler_prefetch_periods": "10", 2024-09-16T07:45:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: "journaler_prezero_periods": "5", 2024-09-16T07:45:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: "journaler_write_head_interval": "15", 2024-09-16T07:45:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: "key": "", 2024-09-16T07:45:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: "keyfile": "", 2024-09-16T07:45:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-16T07:45:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: "kstore_backend": "rocksdb", 2024-09-16T07:45:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: "kstore_default_stripe_size": "65536", 2024-09-16T07:45:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: "kstore_fsck_on_mount": "false", 2024-09-16T07:45:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-16T07:45:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: "kstore_max_bytes": "67108864", 2024-09-16T07:45:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: "kstore_max_ops": "512", 2024-09-16T07:45:15.953 INFO:teuthology.orchestra.run.smithi003.stdout: "kstore_nid_prealloc": "1024", 2024-09-16T07:45:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: "kstore_onode_map_size": "1024", 2024-09-16T07:45:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-16T07:45:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: "kstore_sync_submit_transaction": "false", 2024-09-16T07:45:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: "kstore_sync_transaction": "false", 2024-09-16T07:45:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: "librados_thread_count": "2", 2024-09-16T07:45:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: "lockdep": "false", 2024-09-16T07:45:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: "lockdep_force_backtrace": "false", 2024-09-16T07:45:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: "log_coarse_timestamps": "true", 2024-09-16T07:45:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-16T07:45:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: "log_flush_on_exit": "false", 2024-09-16T07:45:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: "log_graylog_host": "127.0.0.1", 2024-09-16T07:45:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: "log_graylog_port": "12201", 2024-09-16T07:45:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: "log_max_new": "1000", 2024-09-16T07:45:15.954 INFO:teuthology.orchestra.run.smithi003.stdout: "log_max_recent": "10000", 2024-09-16T07:45:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: "log_stderr_prefix": "", 2024-09-16T07:45:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: "log_stop_at_utilization": "0.970000", 2024-09-16T07:45:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": "true", 2024-09-16T07:45:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_graylog": "false", 2024-09-16T07:45:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_journald": "false", 2024-09-16T07:45:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_stderr": "false", 2024-09-16T07:45:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_syslog": "false", 2024-09-16T07:45:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: "max_rotating_auth_attempts": "10", 2024-09-16T07:45:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-16T07:45:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_action_on_write_error": "1", 2024-09-16T07:45:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_alternate_name_max": "8192", 2024-09-16T07:45:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_asio_thread_count": "2", 2024-09-16T07:45:15.955 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_export_pin": "true", 2024-09-16T07:45:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_fragment_dirs": "true", 2024-09-16T07:45:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-16T07:45:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_fragment_interval": "5", 2024-09-16T07:45:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-16T07:45:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-16T07:45:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_interval": "10", 2024-09-16T07:45:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_max": "-1", 2024-09-16T07:45:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_max_until": "-1", 2024-09-16T07:45:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_merge_size": "50", 2024-09-16T07:45:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_midchunk": "0.300000", 2024-09-16T07:45:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-16T07:45:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_min_start": "0.200000", 2024-09-16T07:45:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_minchunk": "0.001000", 2024-09-16T07:45:15.956 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_mode": "0", 2024-09-16T07:45:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_need_max": "1.200000", 2024-09-16T07:45:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_need_min": "0.800000", 2024-09-16T07:45:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_overload_epochs": "2", 2024-09-16T07:45:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-16T07:45:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-16T07:45:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_split_bits": "3", 2024-09-16T07:45:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-16T07:45:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_split_size": "10000", 2024-09-16T07:45:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-16T07:45:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_target_decay": "10.000000", 2024-09-16T07:45:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-16T07:45:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_beacon_grace": "15.000000", 2024-09-16T07:45:15.957 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_beacon_interval": "4.000000", 2024-09-16T07:45:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-16T07:45:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-16T07:45:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cache_mid": "0.700000", 2024-09-16T07:45:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-16T07:45:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cache_quiesce_delay": "0", 2024-09-16T07:45:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-16T07:45:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-16T07:45:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-16T07:45:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cache_release_free_interval": "10", 2024-09-16T07:45:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cache_reservation": "0.050000", 2024-09-16T07:45:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-16T07:45:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cache_trim_interval": "1", 2024-09-16T07:45:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cache_trim_threshold": "262144", 2024-09-16T07:45:15.958 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-16T07:45:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-16T07:45:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-16T07:45:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_client_prealloc_inos": "1000", 2024-09-16T07:45:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-16T07:45:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_connect_bootstrapping": "false", 2024-09-16T07:45:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_damage_table_max_entries": "10000", 2024-09-16T07:45:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-16T07:45:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_debug_auth_pins": "false", 2024-09-16T07:45:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_debug_frag": "false", 2024-09-16T07:45:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_debug_scatterstat": "false", 2024-09-16T07:45:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_debug_subtrees": "false", 2024-09-16T07:45:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_decay_halflife": "5.000000", 2024-09-16T07:45:15.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_default_dir_hash": "2", 2024-09-16T07:45:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_defer_session_stale": "true", 2024-09-16T07:45:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_deny_all_reconnect": "false", 2024-09-16T07:45:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_dir_keys_per_op": "16384", 2024-09-16T07:45:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_dir_max_commit_size": "10", 2024-09-16T07:45:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_dir_max_entries": "0", 2024-09-16T07:45:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_dir_prefetch": "true", 2024-09-16T07:45:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-16T07:45:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-16T07:45:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_dump_cache_on_map": "false", 2024-09-16T07:45:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-16T07:45:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-16T07:45:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_early_reply": "true", 2024-09-16T07:45:15.960 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_enable_op_tracker": "true", 2024-09-16T07:45:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_enforce_unique_name": "true", 2024-09-16T07:45:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-16T07:45:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-16T07:45:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_export_ephemeral_random": "true", 2024-09-16T07:45:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-16T07:45:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-16T07:45:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-16T07:45:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-16T07:45:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-16T07:45:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-16T07:45:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-16T07:45:15.961 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-16T07:45:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_health_summarize_threshold": "10", 2024-09-16T07:45:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-16T07:45:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-16T07:45:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_inject_health_dummy": "false", 2024-09-16T07:45:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-16T07:45:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_inject_migrator_session_race": "false", 2024-09-16T07:45:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-16T07:45:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-16T07:45:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-16T07:45:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_join_fs": "", 2024-09-16T07:45:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_journal_format": "1", 2024-09-16T07:45:15.962 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-16T07:45:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_kill_create_at": "0", 2024-09-16T07:45:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_kill_dirfrag_at": "0", 2024-09-16T07:45:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_kill_export_at": "0", 2024-09-16T07:45:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_kill_import_at": "0", 2024-09-16T07:45:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_kill_journal_at": "0", 2024-09-16T07:45:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_kill_journal_expire_at": "0", 2024-09-16T07:45:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_kill_journal_replay_at": "0", 2024-09-16T07:45:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_kill_link_at": "0", 2024-09-16T07:45:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_kill_mdstable_at": "0", 2024-09-16T07:45:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_kill_openc_at": "0", 2024-09-16T07:45:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_kill_rename_at": "0", 2024-09-16T07:45:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_kill_shutdown_at": "0", 2024-09-16T07:45:15.963 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log_event_large_threshold": "524288", 2024-09-16T07:45:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log_events_per_segment": "1024", 2024-09-16T07:45:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-16T07:45:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log_max_events": "-1", 2024-09-16T07:45:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log_max_segments": "128", 2024-09-16T07:45:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log_pause": "false", 2024-09-16T07:45:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log_segment_size": "0", 2024-09-16T07:45:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-16T07:45:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-16T07:45:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-16T07:45:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log_trim_threshold": "128", 2024-09-16T07:45:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-16T07:45:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log_warn_factor": "2.000000", 2024-09-16T07:45:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_max_caps_per_client": "1048576", 2024-09-16T07:45:15.964 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_max_completed_flushes": "100000", 2024-09-16T07:45:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_max_completed_requests": "100000", 2024-09-16T07:45:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_max_export_size": "20971520", 2024-09-16T07:45:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_max_file_recover": "32", 2024-09-16T07:45:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_max_purge_files": "64", 2024-09-16T07:45:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_max_purge_ops": "8192", 2024-09-16T07:45:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-16T07:45:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-16T07:45:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_max_snaps_per_dir": "100", 2024-09-16T07:45:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_metrics_update_interval": "2", 2024-09-16T07:45:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_min_caps_per_client": "100", 2024-09-16T07:45:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_min_caps_working_set": "10000", 2024-09-16T07:45:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-16T07:45:15.965 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_numa_node": "-1", 2024-09-16T07:45:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-16T07:45:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_op_complaint_time": "30.000000", 2024-09-16T07:45:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_op_history_duration": "600", 2024-09-16T07:45:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_op_history_size": "20", 2024-09-16T07:45:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_op_history_slow_op_size": "20", 2024-09-16T07:45:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-16T07:45:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_op_log_threshold": "5", 2024-09-16T07:45:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_ping_grace": "15", 2024-09-16T07:45:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_ping_interval": "5", 2024-09-16T07:45:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-16T07:45:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-16T07:45:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_recall_max_caps": "30000", 2024-09-16T07:45:15.966 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-16T07:45:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-16T07:45:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-16T07:45:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_recall_warning_threshold": "262144", 2024-09-16T07:45:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-16T07:45:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_replay_interval": "1.000000", 2024-09-16T07:45:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-16T07:45:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-16T07:45:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_root_ino_gid": "0", 2024-09-16T07:45:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_root_ino_uid": "0", 2024-09-16T07:45:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-16T07:45:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_scrub_stats_review_period": "1", 2024-09-16T07:45:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-16T07:45:15.967 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-16T07:45:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-16T07:45:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-16T07:45:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-16T07:45:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-16T07:45:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-16T07:45:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-16T07:45:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-16T07:45:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-16T07:45:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-16T07:45:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_shutdown_check": "0", 2024-09-16T07:45:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_skip_ino": "0", 2024-09-16T07:45:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-16T07:45:15.968 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_snap_max_uid": "4294967294", 2024-09-16T07:45:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_snap_min_uid": "0", 2024-09-16T07:45:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_snap_rstat": "false", 2024-09-16T07:45:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_standby_replay_damaged": "false", 2024-09-16T07:45:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_symlink_recovery": "true", 2024-09-16T07:45:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-16T07:45:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_thrash_exports": "0", 2024-09-16T07:45:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_thrash_fragments": "0", 2024-09-16T07:45:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_tick_interval": "5.000000", 2024-09-16T07:45:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_valgrind_exit": "false", 2024-09-16T07:45:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_verify_backtrace": "1", 2024-09-16T07:45:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_verify_scatter": "false", 2024-09-16T07:45:15.969 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-16T07:45:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_wipe_sessions": "false", 2024-09-16T07:45:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: "mempool_debug": "false", 2024-09-16T07:45:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-16T07:45:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: "memstore_device_bytes": "1073741824", 2024-09-16T07:45:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: "memstore_page_set": "false", 2024-09-16T07:45:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: "memstore_page_size": "65536", 2024-09-16T07:45:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_client_bytes": "134217728", 2024-09-16T07:45:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_client_messages": "512", 2024-09-16T07:45:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-16T07:45:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-16T07:45:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-16T07:45:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-16T07:45:15.970 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_disabled_modules": "", 2024-09-16T07:45:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_enable_op_tracker": "true", 2024-09-16T07:45:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-16T07:45:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_max_pg_creating": "1024", 2024-09-16T07:45:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_max_pg_num_change": "128", 2024-09-16T07:45:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_mds_bytes": "134217728", 2024-09-16T07:45:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_mds_messages": "128", 2024-09-16T07:45:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-16T07:45:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_mon_bytes": "134217728", 2024-09-16T07:45:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_mon_messages": "128", 2024-09-16T07:45:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-16T07:45:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-16T07:45:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_op_history_duration": "600", 2024-09-16T07:45:15.971 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_op_history_size": "20", 2024-09-16T07:45:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-16T07:45:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-16T07:45:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_op_log_threshold": "5", 2024-09-16T07:45:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_osd_bytes": "536870912", 2024-09-16T07:45:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_osd_messages": "8192", 2024-09-16T07:45:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_pool": "true", 2024-09-16T07:45:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-16T07:45:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_standby_modules": "true", 2024-09-16T07:45:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_stats_period": "5", 2024-09-16T07:45:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_stats_threshold": "5", 2024-09-16T07:45:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_tick_period": "2", 2024-09-16T07:45:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-16T07:45:15.972 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-16T07:45:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_allow_pool_delete": "true", 2024-09-16T07:45:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_allow_pool_size_one": "true", 2024-09-16T07:45:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_auth_validate_all_caps": "true", 2024-09-16T07:45:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-16T07:45:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-16T07:45:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_client_bytes": "104857600", 2024-09-16T07:45:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_client_directed_command_retry": "2", 2024-09-16T07:45:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-16T07:45:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-16T07:45:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-16T07:45:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-16T07:45:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_client_hunt_parallel": "3", 2024-09-16T07:45:15.973 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_client_log_interval": "1.000000", 2024-09-16T07:45:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-16T07:45:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_client_ping_interval": "10.000000", 2024-09-16T07:45:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-16T07:45:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_client_target_rank": "-1", 2024-09-16T07:45:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-16T07:45:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-16T07:45:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-16T07:45:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_cluster_log_level": "debug", 2024-09-16T07:45:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_cluster_log_to_file": "true", 2024-09-16T07:45:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-16T07:45:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-16T07:45:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-16T07:45:15.974 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_cluster_log_to_journald": "false", 2024-09-16T07:45:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-16T07:45:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-16T07:45:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-16T07:45:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_compact_on_bootstrap": "false", 2024-09-16T07:45:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_compact_on_start": "false", 2024-09-16T07:45:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_compact_on_trim": "true", 2024-09-16T07:45:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-16T07:45:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-16T07:45:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-16T07:45:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_cpu_threads": "4", 2024-09-16T07:45:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_crush_min_required_version": "hammer", 2024-09-16T07:45:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_daemon_bytes": "419430400", 2024-09-16T07:45:15.975 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-16T07:45:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_data_avail_crit": "5", 2024-09-16T07:45:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_data_avail_warn": "5", 2024-09-16T07:45:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_data_size_warn": "16106127360", 2024-09-16T07:45:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-16T07:45:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-16T07:45:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_debug_dump_json": "false", 2024-09-16T07:45:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-16T07:45:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_debug_dump_transactions": "false", 2024-09-16T07:45:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_debug_extra_checks": "false", 2024-09-16T07:45:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-16T07:45:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-16T07:45:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_debug_no_require_reef": "false", 2024-09-16T07:45:15.976 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_debug_no_require_squid": "false", 2024-09-16T07:45:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-16T07:45:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-16T07:45:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-16T07:45:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_down_mkfs_grace": "120", 2024-09-16T07:45:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_down_uptime_grace": "60", 2024-09-16T07:45:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_election_default_strategy": "1", 2024-09-16T07:45:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_election_timeout": "5.000000", 2024-09-16T07:45:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-16T07:45:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_elector_ping_divisor": "2", 2024-09-16T07:45:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-16T07:45:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_enable_op_tracker": "true", 2024-09-16T07:45:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_fake_pool_delete": "false", 2024-09-16T07:45:15.977 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_force_quorum_join": "false", 2024-09-16T07:45:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-16T07:45:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_globalid_prealloc": "10000", 2024-09-16T07:45:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_health_detail_to_clog": "false", 2024-09-16T07:45:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_health_log_update_period": "5", 2024-09-16T07:45:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_health_max_detail": "50", 2024-09-16T07:45:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_health_to_clog": "true", 2024-09-16T07:45:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_health_to_clog_interval": "600", 2024-09-16T07:45:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-16T07:45:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_host": "172.21.15.3", 2024-09-16T07:45:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_host_override": "", 2024-09-16T07:45:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_initial_members": "", 2024-09-16T07:45:15.978 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-16T07:45:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-16T07:45:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-16T07:45:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-16T07:45:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-16T07:45:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_lease": "5.000000", 2024-09-16T07:45:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-16T07:45:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-16T07:45:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_log_full_interval": "50", 2024-09-16T07:45:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_log_max": "10000", 2024-09-16T07:45:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_log_max_summary": "50", 2024-09-16T07:45:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-16T07:45:15.979 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_max_log_epochs": "500", 2024-09-16T07:45:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-16T07:45:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-16T07:45:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-16T07:45:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_max_osd": "10000", 2024-09-16T07:45:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_max_pg_per_osd": "10000", 2024-09-16T07:45:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_max_pool_pg_num": "65536", 2024-09-16T07:45:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-16T07:45:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-16T07:45:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_mds_force_trim_to": "0", 2024-09-16T07:45:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_mds_skip_sanity": "false", 2024-09-16T07:45:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_memory_autotune": "true", 2024-09-16T07:45:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_memory_target": "2147483648", 2024-09-16T07:45:15.980 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_mgr_beacon_grace": "30", 2024-09-16T07:45:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-16T07:45:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_mgr_digest_period": "5", 2024-09-16T07:45:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_mgr_inactive_grace": "60", 2024-09-16T07:45:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-16T07:45:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-16T07:45:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_min_osdmap_epochs": "50", 2024-09-16T07:45:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-16T07:45:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-16T07:45:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_op_complaint_time": "30", 2024-09-16T07:45:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_op_history_duration": "600", 2024-09-16T07:45:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_op_history_size": "20", 2024-09-16T07:45:15.981 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_op_history_slow_op_size": "20", 2024-09-16T07:45:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-16T07:45:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_op_log_threshold": "5", 2024-09-16T07:45:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-16T07:45:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-16T07:45:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-16T07:45:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_auto_mark_in": "false", 2024-09-16T07:45:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-16T07:45:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-16T07:45:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-16T07:45:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_cache_size": "500", 2024-09-16T07:45:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-16T07:45:15.982 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-16T07:45:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-16T07:45:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_down_out_interval": "600", 2024-09-16T07:45:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-16T07:45:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-16T07:45:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_force_trim_to": "0", 2024-09-16T07:45:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-16T07:45:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-16T07:45:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-16T07:45:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-16T07:45:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-16T07:45:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-16T07:45:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-16T07:45:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_min_down_reporters": "2", 2024-09-16T07:45:15.983 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-16T07:45:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-16T07:45:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-16T07:45:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-16T07:45:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-16T07:45:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-16T07:45:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_report_timeout": "900", 2024-09-16T07:45:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-16T07:45:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-16T07:45:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-16T07:45:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-16T07:45:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-16T07:45:15.984 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osdmap_full_prune_interval": "2", 2024-09-16T07:45:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osdmap_full_prune_min": "15", 2024-09-16T07:45:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_osdmap_full_prune_txsize": "2", 2024-09-16T07:45:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-16T07:45:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_pg_stuck_threshold": "60", 2024-09-16T07:45:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-16T07:45:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-16T07:45:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-16T07:45:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-16T07:45:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-16T07:45:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-16T07:45:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_probe_timeout": "2.000000", 2024-09-16T07:45:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_reweight_max_change": "0.050000", 2024-09-16T07:45:15.985 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_reweight_max_osds": "4", 2024-09-16T07:45:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-16T07:45:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-16T07:45:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-16T07:45:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-16T07:45:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-16T07:45:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_scrub_interval": "86400", 2024-09-16T07:45:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_scrub_max_keys": "100", 2024-09-16T07:45:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_scrub_timeout": "300", 2024-09-16T07:45:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_session_timeout": "300", 2024-09-16T07:45:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_smart_report_timeout": "5", 2024-09-16T07:45:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_stat_smooth_intervals": "6", 2024-09-16T07:45:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-16T07:45:15.986 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_stretch_pool_min_size": "2", 2024-09-16T07:45:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_stretch_pool_size": "4", 2024-09-16T07:45:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-16T07:45:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-16T07:45:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_sync_debug": "false", 2024-09-16T07:45:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-16T07:45:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-16T07:45:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_sync_provider_kill_at": "0", 2024-09-16T07:45:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_sync_requester_kill_at": "0", 2024-09-16T07:45:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_sync_timeout": "60.000000", 2024-09-16T07:45:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_target_pg_per_osd": "100", 2024-09-16T07:45:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_tick_interval": "5", 2024-09-16T07:45:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_timecheck_interval": "300.000000", 2024-09-16T07:45:15.987 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-16T07:45:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_use_min_delay_socket": "false", 2024-09-16T07:45:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_older_version_delay": "604800", 2024-09-16T07:45:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-16T07:45:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-16T07:45:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-16T07:45:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-16T07:45:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-16T07:45:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-16T07:45:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-16T07:45:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_misplaced": "false", 2024-09-16T07:45:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-16T07:45:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_older_version": "true", 2024-09-16T07:45:15.988 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-16T07:45:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-16T07:45:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-16T07:45:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-16T07:45:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-16T07:45:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-16T07:45:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-16T07:45:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-16T07:45:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-16T07:45:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: "monmap": "", 2024-09-16T07:45:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-16T07:45:15.989 INFO:teuthology.orchestra.run.smithi003.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-16T07:45:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-16T07:45:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-16T07:45:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-16T07:45:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-16T07:45:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: "motr_tracing_enabled": "false", 2024-09-16T07:45:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_op_threads": "3", 2024-09-16T07:45:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-16T07:45:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_cm": "false", 2024-09-16T07:45:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_device_name": "", 2024-09-16T07:45:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_dscp": "96", 2024-09-16T07:45:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-16T07:45:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-16T07:45:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_local_gid": "", 2024-09-16T07:45:15.990 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-16T07:45:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_port_num": "1", 2024-09-16T07:45:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-16T07:45:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-16T07:45:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-16T07:45:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-16T07:45:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_sl": "3", 2024-09-16T07:45:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_support_srq": "true", 2024-09-16T07:45:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_rdma_type": "ib", 2024-09-16T07:45:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_async_reap_threshold": "5", 2024-09-16T07:45:15.991 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_bind_before_connect": "false", 2024-09-16T07:45:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_bind_ipv4": "true", 2024-09-16T07:45:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_bind_ipv6": "false", 2024-09-16T07:45:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_bind_msgr1": "true", 2024-09-16T07:45:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_bind_msgr2": "true", 2024-09-16T07:45:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_bind_port_max": "7568", 2024-09-16T07:45:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_bind_port_min": "6800", 2024-09-16T07:45:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-16T07:45:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_bind_retry_count": "3", 2024-09-16T07:45:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_bind_retry_delay": "5", 2024-09-16T07:45:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_blackhole_client": "false", 2024-09-16T07:45:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_blackhole_mds": "false", 2024-09-16T07:45:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_blackhole_mgr": "false", 2024-09-16T07:45:15.992 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_blackhole_mon": "false", 2024-09-16T07:45:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_blackhole_osd": "false", 2024-09-16T07:45:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_client_mode": "crc", 2024-09-16T07:45:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-16T07:45:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_cluster_mode": "crc", 2024-09-16T07:45:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_cluster_type": "", 2024-09-16T07:45:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_compress_secure": "false", 2024-09-16T07:45:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_connection_idle_timeout": "900", 2024-09-16T07:45:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_connection_ready_timeout": "10", 2024-09-16T07:45:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_crc_data": "true", 2024-09-16T07:45:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_crc_header": "true", 2024-09-16T07:45:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_die_on_bad_msg": "false", 2024-09-16T07:45:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_die_on_bug": "true", 2024-09-16T07:45:15.993 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_die_on_old_message": "true", 2024-09-16T07:45:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_die_on_skipped_message": "false", 2024-09-16T07:45:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-16T07:45:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-16T07:45:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_coremask": "0xF", 2024-09-16T07:45:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-16T07:45:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-16T07:45:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_enable_tso": "true", 2024-09-16T07:45:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-16T07:45:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-16T07:45:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_hugepages": "", 2024-09-16T07:45:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-16T07:45:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-16T07:45:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_lro": "true", 2024-09-16T07:45:15.994 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_memory_channel": "4", 2024-09-16T07:45:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-16T07:45:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_pmd": "", 2024-09-16T07:45:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_port_id": "0", 2024-09-16T07:45:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-16T07:45:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-16T07:45:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_dump_on_send": "false", 2024-09-16T07:45:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_initial_backoff": "0.200000", 2024-09-16T07:45:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_inject_delay_max": "1.000000", 2024-09-16T07:45:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-16T07:45:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_inject_delay_type": "", 2024-09-16T07:45:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-16T07:45:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_inject_network_congestion": "0", 2024-09-16T07:45:15.995 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_inject_socket_failures": "0", 2024-09-16T07:45:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_learn_addr_from_peer": "true", 2024-09-16T07:45:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_max_accept_failures": "4", 2024-09-16T07:45:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_max_backoff": "15.000000", 2024-09-16T07:45:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_mon_client_mode": "crc", 2024-09-16T07:45:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_mon_cluster_mode": "crc", 2024-09-16T07:45:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_mon_service_mode": "crc", 2024-09-16T07:45:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_osd_compress_min_size": "1024", 2024-09-16T07:45:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_osd_compress_mode": "none", 2024-09-16T07:45:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-16T07:45:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-16T07:45:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_pq_min_cost": "65536", 2024-09-16T07:45:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_public_type": "", 2024-09-16T07:45:15.996 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_service_mode": "crc", 2024-09-16T07:45:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_tcp_listen_backlog": "512", 2024-09-16T07:45:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_tcp_nodelay": "true", 2024-09-16T07:45:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-16T07:45:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_tcp_rcvbuf": "0", 2024-09-16T07:45:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-16T07:45:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "ms_type": "async+posix", 2024-09-16T07:45:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "no_config_file": "false", 2024-09-16T07:45:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-16T07:45:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-16T07:45:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "objecter_completion_locks_per_session": "32", 2024-09-16T07:45:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-16T07:45:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-16T07:45:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "objecter_inflight_ops": "1024", 2024-09-16T07:45:15.997 INFO:teuthology.orchestra.run.smithi003.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-16T07:45:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-16T07:45:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: "objecter_tick_interval": "5.000000", 2024-09-16T07:45:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: "objecter_timeout": "10.000000", 2024-09-16T07:45:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: "objectstore_blackhole": "false", 2024-09-16T07:45:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-16T07:45:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: "openssl_engine_opts": "", 2024-09-16T07:45:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_agent_delay_time": "5.000000", 2024-09-16T07:45:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_agent_hist_halflife": "1000", 2024-09-16T07:45:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_agent_max_low_ops": "2", 2024-09-16T07:45:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_agent_max_ops": "4", 2024-09-16T07:45:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-16T07:45:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-16T07:45:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_agent_slop": "0.020000", 2024-09-16T07:45:15.998 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-16T07:45:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-16T07:45:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_asio_thread_count": "2", 2024-09-16T07:45:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_async_recovery_min_cost": "100", 2024-09-16T07:45:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-16T07:45:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-16T07:45:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_backfill_scan_max": "512", 2024-09-16T07:45:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_backfill_scan_min": "64", 2024-09-16T07:45:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_backoff_on_degraded": "false", 2024-09-16T07:45:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_backoff_on_peering": "false", 2024-09-16T07:45:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_backoff_on_unfound": "true", 2024-09-16T07:45:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_beacon_report_interval": "300", 2024-09-16T07:45:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_bench_duration": "30", 2024-09-16T07:45:15.999 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-16T07:45:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_bench_max_block_size": "67108864", 2024-09-16T07:45:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-16T07:45:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_blkin_trace_all": "false", 2024-09-16T07:45:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-16T07:45:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-16T07:45:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-16T07:45:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-16T07:45:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_check_for_log_corruption": "false", 2024-09-16T07:45:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-16T07:45:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-16T07:45:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-16T07:45:16.000 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-16T07:45:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_class_update_on_start": "true", 2024-09-16T07:45:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_client_message_cap": "256", 2024-09-16T07:45:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_client_message_size_cap": "524288000", 2024-09-16T07:45:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_client_op_priority": "63", 2024-09-16T07:45:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_client_watch_timeout": "30", 2024-09-16T07:45:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_command_max_records": "256", 2024-09-16T07:45:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_compact_on_start": "false", 2024-09-16T07:45:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-16T07:45:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-16T07:45:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-16T07:45:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_crush_update_on_start": "true", 2024-09-16T07:45:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_crush_update_weight_set": "true", 2024-09-16T07:45:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-16T07:45:16.001 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-16T07:45:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-16T07:45:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-16T07:45:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-16T07:45:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_feed_pullee": "-1", 2024-09-16T07:45:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-16T07:45:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-16T07:45:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-16T07:45:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_misdirected_ops": "false", 2024-09-16T07:45:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_no_acting_change": "false", 2024-09-16T07:45:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_no_purge_strays": "false", 2024-09-16T07:45:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_op_order": "false", 2024-09-16T07:45:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-16T07:45:16.002 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-16T07:45:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-16T07:45:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-16T07:45:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_shutdown": "false", 2024-09-16T07:45:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-16T07:45:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-16T07:45:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_trim_objects": "false", 2024-09-16T07:45:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-16T07:45:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-16T07:45:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_verify_snaps": "false", 2024-09-16T07:45:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-16T07:45:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-16T07:45:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_deep_scrub_keys": "1024", 2024-09-16T07:45:16.003 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-16T07:45:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-16T07:45:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-16T07:45:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_deep_scrub_stride": "524288", 2024-09-16T07:45:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-16T07:45:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-16T07:45:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_default_notify_timeout": "30", 2024-09-16T07:45:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_delete_sleep": "0.000000", 2024-09-16T07:45:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-16T07:45:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-16T07:45:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-16T07:45:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_discard_disconnected_ops": "true", 2024-09-16T07:45:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_ec_partial_reads": "true", 2024-09-16T07:45:16.004 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_enable_op_tracker": "true", 2024-09-16T07:45:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-16T07:45:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-16T07:45:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-16T07:45:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-16T07:45:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_fast_info": "true", 2024-09-16T07:45:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_fast_shutdown": "true", 2024-09-16T07:45:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-16T07:45:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-16T07:45:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-16T07:45:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-16T07:45:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-16T07:45:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_function_tracing": "false", 2024-09-16T07:45:16.005 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_heartbeat_grace": "20", 2024-09-16T07:45:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_heartbeat_interval": "6", 2024-09-16T07:45:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-16T07:45:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_heartbeat_min_peers": "10", 2024-09-16T07:45:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_heartbeat_min_size": "2000", 2024-09-16T07:45:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_heartbeat_stale": "600", 2024-09-16T07:45:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-16T07:45:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_hit_set_max_size": "100000", 2024-09-16T07:45:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_hit_set_min_size": "1000", 2024-09-16T07:45:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-16T07:45:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-16T07:45:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-16T07:45:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-16T07:45:16.006 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-16T07:45:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-16T07:45:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_journal_size": "5120", 2024-09-16T07:45:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_kill_backfill_at": "0", 2024-09-16T07:45:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-16T07:45:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_map_cache_size": "50", 2024-09-16T07:45:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_map_dedup": "true", 2024-09-16T07:45:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_map_message_max": "40", 2024-09-16T07:45:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-16T07:45:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_map_share_max_epochs": "40", 2024-09-16T07:45:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_attr_name_len": "100", 2024-09-16T07:45:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_attr_size": "0", 2024-09-16T07:45:16.007 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_backfills": "1", 2024-09-16T07:45:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_markdown_count": "5", 2024-09-16T07:45:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_markdown_period": "600", 2024-09-16T07:45:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_object_name_len": "2048", 2024-09-16T07:45:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_object_namespace_len": "256", 2024-09-16T07:45:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_object_size": "134217728", 2024-09-16T07:45:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-16T07:45:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-16T07:45:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_pg_blocked_by": "16", 2024-09-16T07:45:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_pg_log_entries": "10000", 2024-09-16T07:45:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-16T07:45:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_pgls": "1024", 2024-09-16T07:45:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_push_cost": "8388608", 2024-09-16T07:45:16.008 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_push_objects": "10", 2024-09-16T07:45:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_scrubs": "3", 2024-09-16T07:45:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-16T07:45:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_trimming_pgs": "2", 2024-09-16T07:45:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_write_op_reply_len": "64", 2024-09-16T07:45:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_max_write_size": "90", 2024-09-16T07:45:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-16T07:45:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-16T07:45:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-16T07:45:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-16T07:45:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-16T07:45:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-16T07:45:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-16T07:45:16.009 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-16T07:45:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_profile": "balanced", 2024-09-16T07:45:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-16T07:45:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-16T07:45:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-16T07:45:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-16T07:45:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-16T07:45:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-16T07:45:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-16T07:45:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-16T07:45:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-16T07:45:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-16T07:45:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-16T07:45:16.010 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_memory_base": "805306368", 2024-09-16T07:45:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_memory_cache_min": "134217728", 2024-09-16T07:45:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-16T07:45:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-16T07:45:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_memory_target": "4294967296", 2024-09-16T07:45:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_memory_target_autotune": "false", 2024-09-16T07:45:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-16T07:45:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_min_pg_log_entries": "250", 2024-09-16T07:45:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_min_recovery_priority": "0", 2024-09-16T07:45:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-16T07:45:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-16T07:45:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mon_report_interval": "5", 2024-09-16T07:45:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-16T07:45:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-16T07:45:16.011 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_num_cache_shards": "32", 2024-09-16T07:45:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_num_op_tracker_shard": "32", 2024-09-16T07:45:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_numa_auto_affinity": "true", 2024-09-16T07:45:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_numa_node": "-1", 2024-09-16T07:45:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_numa_prefer_iface": "true", 2024-09-16T07:45:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-16T07:45:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_objecter_finishers": "1", 2024-09-16T07:45:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_objectstore": "bluestore", 2024-09-16T07:45:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_objectstore_fuse": "false", 2024-09-16T07:45:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-16T07:45:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_objectstore_tracing": "false", 2024-09-16T07:45:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_complaint_time": "30.000000", 2024-09-16T07:45:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_history_duration": "600", 2024-09-16T07:45:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_history_size": "20", 2024-09-16T07:45:16.012 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_history_slow_op_size": "20", 2024-09-16T07:45:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-16T07:45:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_log_threshold": "5", 2024-09-16T07:45:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_num_shards": "0", 2024-09-16T07:45:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_num_shards_hdd": "5", 2024-09-16T07:45:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_num_shards_ssd": "8", 2024-09-16T07:45:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-16T07:45:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-16T07:45:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-16T07:45:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-16T07:45:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_pq_min_cost": "65536", 2024-09-16T07:45:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-16T07:45:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_queue_cut_off": "high", 2024-09-16T07:45:16.013 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-16T07:45:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_op_thread_timeout": "15", 2024-09-16T07:45:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_open_classes_on_start": "true", 2024-09-16T07:45:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_os_flags": "0", 2024-09-16T07:45:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_peering_op_priority": "255", 2024-09-16T07:45:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pg_delete_cost": "1048576", 2024-09-16T07:45:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pg_delete_priority": "5", 2024-09-16T07:45:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-16T07:45:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-16T07:45:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-16T07:45:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pg_log_trim_max": "10000", 2024-09-16T07:45:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pg_log_trim_min": "100", 2024-09-16T07:45:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-16T07:45:16.014 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-16T07:45:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-16T07:45:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-16T07:45:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-16T07:45:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-16T07:45:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-16T07:45:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-16T07:45:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-16T07:45:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-16T07:45:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_crimson": "true", 2024-09-16T07:45:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-16T07:45:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-16T07:45:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-16T07:45:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-16T07:45:16.015 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-16T07:45:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-16T07:45:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-16T07:45:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-16T07:45:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_flags": "0", 2024-09-16T07:45:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-16T07:45:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_min_size": "2", 2024-09-16T07:45:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-16T07:45:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_pg_num": "32", 2024-09-16T07:45:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_pgp_num": "0", 2024-09-16T07:45:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-16T07:45:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_read_ratio": "70", 2024-09-16T07:45:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_size": "3", 2024-09-16T07:45:16.016 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_default_type": "replicated", 2024-09-16T07:45:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-16T07:45:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-16T07:45:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_push_per_object_cost": "1000", 2024-09-16T07:45:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-16T07:45:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recover_clone_overlap": "true", 2024-09-16T07:45:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-16T07:45:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_cost": "20971520", 2024-09-16T07:45:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-16T07:45:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_max_active": "0", 2024-09-16T07:45:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-16T07:45:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-16T07:45:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-16T07:45:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-16T07:45:16.017 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_max_single_start": "1", 2024-09-16T07:45:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_op_priority": "3", 2024-09-16T07:45:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-16T07:45:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_priority": "5", 2024-09-16T07:45:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-16T07:45:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_sleep": "0.000000", 2024-09-16T07:45:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-16T07:45:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-16T07:45:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-16T07:45:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_repair_during_recovery": "false", 2024-09-16T07:45:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_requested_scrub_priority": "120", 2024-09-16T07:45:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-16T07:45:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-16T07:45:16.018 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_auto_repair": "false", 2024-09-16T07:45:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-16T07:45:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-16T07:45:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_begin_hour": "0", 2024-09-16T07:45:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_begin_week_day": "0", 2024-09-16T07:45:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_chunk_max": "25", 2024-09-16T07:45:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_chunk_min": "5", 2024-09-16T07:45:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_cost": "52428800", 2024-09-16T07:45:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-16T07:45:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_during_recovery": "false", 2024-09-16T07:45:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_end_hour": "0", 2024-09-16T07:45:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_end_week_day": "0", 2024-09-16T07:45:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_event_cost": "4096", 2024-09-16T07:45:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-16T07:45:16.019 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-16T07:45:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_invalid_stats": "true", 2024-09-16T07:45:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-16T07:45:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-16T07:45:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_max_preemptions": "5", 2024-09-16T07:45:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-16T07:45:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_priority": "5", 2024-09-16T07:45:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-16T07:45:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_retry_delay": "30", 2024-09-16T07:45:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-16T07:45:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-16T07:45:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_retry_trimming": "10", 2024-09-16T07:45:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_scrub_sleep": "0.000000", 2024-09-16T07:45:16.020 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-16T07:45:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-16T07:45:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-16T07:45:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-16T07:45:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_skip_data_digest": "false", 2024-09-16T07:45:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_smart_report_timeout": "5", 2024-09-16T07:45:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_snap_trim_cost": "1048576", 2024-09-16T07:45:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_snap_trim_priority": "5", 2024-09-16T07:45:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-16T07:45:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-16T07:45:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-16T07:45:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-16T07:45:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-16T07:45:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-16T07:45:16.021 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-16T07:45:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_target_transaction_size": "30", 2024-09-16T07:45:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-16T07:45:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-16T07:45:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-16T07:45:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-16T07:45:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-16T07:45:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-16T07:45:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-16T07:45:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-16T07:45:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-16T07:45:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-16T07:45:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_tracing": "false", 2024-09-16T07:45:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_use_stale_snap": "false", 2024-09-16T07:45:16.022 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-16T07:45:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: "osdc_blkin_trace_all": "false", 2024-09-16T07:45:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: "paxos_kill_at": "0", 2024-09-16T07:45:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: "paxos_max_join_drift": "10", 2024-09-16T07:45:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: "paxos_min": "500", 2024-09-16T07:45:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: "paxos_min_wait": "0.050000", 2024-09-16T07:45:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: "paxos_propose_interval": "1.000000", 2024-09-16T07:45:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: "paxos_service_trim_max": "500", 2024-09-16T07:45:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-16T07:45:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: "paxos_service_trim_min": "10", 2024-09-16T07:45:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: "paxos_stash_full_interval": "25", 2024-09-16T07:45:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: "paxos_trim_max": "500", 2024-09-16T07:45:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: "paxos_trim_min": "250", 2024-09-16T07:45:16.023 INFO:teuthology.orchestra.run.smithi003.stdout: "perf": "true", 2024-09-16T07:45:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-16T07:45:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-16T07:45:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-16T07:45:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addr": "-", 2024-09-16T07:45:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: "public_addrv": "", 2024-09-16T07:45:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: "public_bind_addr": "-", 2024-09-16T07:45:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: "public_network": "", 2024-09-16T07:45:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: "public_network_interface": "", 2024-09-16T07:45:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: "qat_compressor_busy_polling": "false", 2024-09-16T07:45:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: "qat_compressor_enabled": "false", 2024-09-16T07:45:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: "qat_compressor_session_max_number": "256", 2024-09-16T07:45:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: "rados_mon_op_timeout": "0", 2024-09-16T07:45:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: "rados_osd_op_timeout": "0", 2024-09-16T07:45:16.024 INFO:teuthology.orchestra.run.smithi003.stdout: "rados_tracing": "false", 2024-09-16T07:45:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_atime_update_interval": "60", 2024-09-16T07:45:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-16T07:45:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_balance_parent_reads": "false", 2024-09-16T07:45:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_balance_snap_reads": "false", 2024-09-16T07:45:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_blkin_trace_all": "false", 2024-09-16T07:45:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-16T07:45:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-16T07:45:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_cache": "true", 2024-09-16T07:45:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-16T07:45:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-16T07:45:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-16T07:45:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-16T07:45:16.025 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_cache_policy": "writearound", 2024-09-16T07:45:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_cache_size": "33554432", 2024-09-16T07:45:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-16T07:45:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-16T07:45:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_clone_copy_on_read": "false", 2024-09-16T07:45:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_compression_hint": "none", 2024-09-16T07:45:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_concurrent_management_ops": "10", 2024-09-16T07:45:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-16T07:45:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_default_clone_format": "auto", 2024-09-16T07:45:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_default_data_pool": "", 2024-09-16T07:45:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_default_features": "61", 2024-09-16T07:45:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_default_format": "2", 2024-09-16T07:45:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_default_map_options": "", 2024-09-16T07:45:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_default_order": "22", 2024-09-16T07:45:16.026 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_default_pool": "rbd", 2024-09-16T07:45:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-16T07:45:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_default_stripe_count": "0", 2024-09-16T07:45:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_default_stripe_unit": "0", 2024-09-16T07:45:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-16T07:45:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-16T07:45:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-16T07:45:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_enable_alloc_hint": "true", 2024-09-16T07:45:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-16T07:45:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_io_scheduler": "simple", 2024-09-16T07:45:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-16T07:45:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-16T07:45:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-16T07:45:16.027 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-16T07:45:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-16T07:45:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-16T07:45:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-16T07:45:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-16T07:45:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-16T07:45:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_journal_order": "24", 2024-09-16T07:45:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_journal_pool": "", 2024-09-16T07:45:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_journal_splay_width": "4", 2024-09-16T07:45:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_localize_parent_reads": "false", 2024-09-16T07:45:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_localize_snap_reads": "false", 2024-09-16T07:45:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-16T07:45:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-16T07:45:16.028 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-16T07:45:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-16T07:45:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-16T07:45:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-16T07:45:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-16T07:45:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-16T07:45:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-16T07:45:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-16T07:45:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-16T07:45:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-16T07:45:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-16T07:45:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-16T07:45:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-16T07:45:16.029 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-16T07:45:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-16T07:45:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-16T07:45:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-16T07:45:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-16T07:45:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-16T07:45:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-16T07:45:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-16T07:45:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-16T07:45:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-16T07:45:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-16T07:45:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-16T07:45:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-16T07:45:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-16T07:45:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-16T07:45:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-16T07:45:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_mtime_update_interval": "60", 2024-09-16T07:45:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_non_blocking_aio": "true", 2024-09-16T07:45:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_op_thread_timeout": "60", 2024-09-16T07:45:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_op_threads": "1", 2024-09-16T07:45:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_parent_cache_enabled": "false", 2024-09-16T07:45:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-16T07:45:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-16T07:45:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-16T07:45:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_plugins": "", 2024-09-16T07:45:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_bps_burst": "0", 2024-09-16T07:45:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-16T07:45:16.031 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_bps_limit": "0", 2024-09-16T07:45:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_exclude_ops": "0", 2024-09-16T07:45:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_iops_burst": "0", 2024-09-16T07:45:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-16T07:45:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_iops_limit": "0", 2024-09-16T07:45:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-16T07:45:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-16T07:45:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-16T07:45:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-16T07:45:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-16T07:45:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-16T07:45:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-16T07:45:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-16T07:45:16.032 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-16T07:45:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-16T07:45:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-16T07:45:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-16T07:45:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-16T07:45:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-16T07:45:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_read_from_replica_policy": "default", 2024-09-16T07:45:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-16T07:45:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-16T07:45:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-16T07:45:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-16T07:45:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_skip_partial_discard": "true", 2024-09-16T07:45:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-16T07:45:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_tracing": "false", 2024-09-16T07:45:16.033 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_validate_names": "true", 2024-09-16T07:45:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_validate_pool": "true", 2024-09-16T07:45:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "restapi_base_url": "", 2024-09-16T07:45:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "restapi_log_level": "", 2024-09-16T07:45:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-16T07:45:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-16T07:45:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_acl_grants_max_num": "100", 2024-09-16T07:45:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_admin_entry": "admin", 2024-09-16T07:45:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-16T07:45:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_asio_assert_yielding": "false", 2024-09-16T07:45:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_backend_store": "rados", 2024-09-16T07:45:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_barbican_url": "", 2024-09-16T07:45:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_beast_enable_async": "true", 2024-09-16T07:45:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_bucket_counters_cache": "false", 2024-09-16T07:45:16.034 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-16T07:45:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-16T07:45:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-16T07:45:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-16T07:45:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-16T07:45:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-16T07:45:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-16T07:45:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-16T07:45:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_cache_enabled": "true", 2024-09-16T07:45:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_cache_expiry_interval": "900", 2024-09-16T07:45:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_cache_lru_size": "25000", 2024-09-16T07:45:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_config_store": "rados", 2024-09-16T07:45:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_content_length_compat": "false", 2024-09-16T07:45:16.035 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_copy_obj_progress": "true", 2024-09-16T07:45:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-16T07:45:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_cors_rules_max_num": "100", 2024-09-16T07:45:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_cross_domain_policy": "", 2024-09-16T07:45:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-16T07:45:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_kmip_addr": "", 2024-09-16T07:45:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-16T07:45:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-16T07:45:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-16T07:45:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-16T07:45:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_kmip_password": "", 2024-09-16T07:45:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-16T07:45:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_kmip_username": "", 2024-09-16T07:45:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_require_ssl": "true", 2024-09-16T07:45:16.036 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-16T07:45:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-16T07:45:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-16T07:45:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-16T07:45:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-16T07:45:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-16T07:45:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-16T07:45:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-16T07:45:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-16T07:45:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-16T07:45:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-16T07:45:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-16T07:45:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-16T07:45:16.037 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-16T07:45:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-16T07:45:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_vault_addr": "", 2024-09-16T07:45:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_vault_auth": "token", 2024-09-16T07:45:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_vault_namespace": "", 2024-09-16T07:45:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_vault_prefix": "", 2024-09-16T07:45:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-16T07:45:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-16T07:45:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-16T07:45:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-16T07:45:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_vault_token_file": "", 2024-09-16T07:45:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-16T07:45:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_curl_buffersize": "524288", 2024-09-16T07:45:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-16T07:45:16.038 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_curl_low_speed_time": "300", 2024-09-16T07:45:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-16T07:45:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-16T07:45:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-16T07:45:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-16T07:45:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-16T07:45:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-16T07:45:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-16T07:45:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-16T07:45:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-16T07:45:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-16T07:45:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-16T07:45:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-16T07:45:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-16T07:45:16.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-16T07:45:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-16T07:45:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-16T07:45:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-16T07:45:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-16T07:45:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-16T07:45:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_data_log_changes_size": "1000", 2024-09-16T07:45:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_data_log_num_shards": "128", 2024-09-16T07:45:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-16T07:45:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_data_log_window": "30", 2024-09-16T07:45:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-16T07:45:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-16T07:45:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-16T07:45:16.040 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-16T07:45:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-16T07:45:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-16T07:45:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-16T07:45:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-16T07:45:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-16T07:45:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-16T07:45:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-16T07:45:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-16T07:45:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-16T07:45:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_disable_s3select": "false", 2024-09-16T07:45:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-16T07:45:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-16T07:45:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-16T07:45:16.041 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-16T07:45:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-16T07:45:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-16T07:45:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-16T07:45:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-16T07:45:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-16T07:45:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-16T07:45:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-16T07:45:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-16T07:45:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dns_name": "", 2024-09-16T07:45:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dns_s3website_name": "", 2024-09-16T07:45:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dynamic_resharding": "true", 2024-09-16T07:45:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-16T07:45:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-16T07:45:16.042 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-16T07:45:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_enable_gc_threads": "true", 2024-09-16T07:45:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_enable_lc_threads": "true", 2024-09-16T07:45:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_enable_mdsearch": "true", 2024-09-16T07:45:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_enable_ops_log": "false", 2024-09-16T07:45:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_enable_quota_threads": "true", 2024-09-16T07:45:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_enable_static_website": "false", 2024-09-16T07:45:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_enable_usage_log": "false", 2024-09-16T07:45:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_enforce_swift_acls": "true", 2024-09-16T07:45:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_exit_timeout_secs": "120", 2024-09-16T07:45:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_expose_bucket": "false", 2024-09-16T07:45:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_extended_http_attrs": "", 2024-09-16T07:45:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_filter": "none", 2024-09-16T07:45:16.043 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-16T07:45:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_frontends": "beast port=7480", 2024-09-16T07:45:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-16T07:45:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_gc_max_deferred": "50", 2024-09-16T07:45:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-16T07:45:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_gc_max_objs": "32", 2024-09-16T07:45:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-16T07:45:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-16T07:45:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-16T07:45:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-16T07:45:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_gc_processor_period": "3600", 2024-09-16T07:45:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-16T07:45:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-16T07:45:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-16T07:45:16.044 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-16T07:45:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_init_timeout": "300", 2024-09-16T07:45:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-16T07:45:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-16T07:45:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_kafka_connection_idle": "300", 2024-09-16T07:45:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-16T07:45:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-16T07:45:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-16T07:45:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-16T07:45:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-16T07:45:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_admin_domain": "", 2024-09-16T07:45:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_admin_password": "", 2024-09-16T07:45:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_admin_password_path": "", 2024-09-16T07:45:16.045 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_admin_project": "", 2024-09-16T07:45:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_admin_tenant": "", 2024-09-16T07:45:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_admin_token": "", 2024-09-16T07:45:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_admin_token_path": "", 2024-09-16T07:45:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_admin_user": "", 2024-09-16T07:45:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_barbican_domain": "", 2024-09-16T07:45:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_barbican_password": "", 2024-09-16T07:45:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_barbican_project": "", 2024-09-16T07:45:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-16T07:45:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_barbican_user": "", 2024-09-16T07:45:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-16T07:45:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-16T07:45:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-16T07:45:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-16T07:45:16.046 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-16T07:45:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_url": "", 2024-09-16T07:45:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-16T07:45:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_lc_debug_interval": "-1", 2024-09-16T07:45:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_lc_lock_max_time": "90", 2024-09-16T07:45:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_lc_max_objs": "32", 2024-09-16T07:45:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_lc_max_rules": "1000", 2024-09-16T07:45:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_lc_max_worker": "3", 2024-09-16T07:45:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-16T07:45:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_lc_thread_delay": "0", 2024-09-16T07:45:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-16T07:45:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_ldap_dnattr": "uid", 2024-09-16T07:45:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-16T07:45:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_ldap_searchfilter": "", 2024-09-16T07:45:16.047 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-16T07:45:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_ldap_uri": "", 2024-09-16T07:45:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-16T07:45:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-16T07:45:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-16T07:45:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-16T07:45:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_log_http_headers": "", 2024-09-16T07:45:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-16T07:45:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-16T07:45:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_log_object_name_utc": "false", 2024-09-16T07:45:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-16T07:45:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-16T07:45:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_max_attr_name_len": "0", 2024-09-16T07:45:16.048 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_max_attr_size": "0", 2024-09-16T07:45:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-16T07:45:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_max_chunk_size": "4194304", 2024-09-16T07:45:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-16T07:45:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-16T07:45:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-16T07:45:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_max_listing_results": "5000", 2024-09-16T07:45:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_max_notify_retries": "10", 2024-09-16T07:45:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-16T07:45:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_max_put_param_size": "1048576", 2024-09-16T07:45:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_max_put_size": "5368709120", 2024-09-16T07:45:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_max_slo_entries": "1000", 2024-09-16T07:45:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_md_log_max_shards": "64", 2024-09-16T07:45:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-16T07:45:16.049 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-16T07:45:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-16T07:45:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-16T07:45:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_mp_lock_max_time": "600", 2024-09-16T07:45:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-16T07:45:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-16T07:45:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-16T07:45:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-16T07:45:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-16T07:45:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-16T07:45:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-16T07:45:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-16T07:45:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_nfs_max_gc": "300", 2024-09-16T07:45:16.050 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-16T07:45:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-16T07:45:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-16T07:45:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-16T07:45:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-16T07:45:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-16T07:45:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-16T07:45:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_num_async_rados_threads": "32", 2024-09-16T07:45:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_num_control_oids": "8", 2024-09-16T07:45:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_numa_node": "-1", 2024-09-16T07:45:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-16T07:45:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-16T07:45:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_objexp_chunk_size": "100", 2024-09-16T07:45:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_objexp_gc_interval": "600", 2024-09-16T07:45:16.051 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-16T07:45:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-16T07:45:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-16T07:45:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_op_thread_timeout": "600", 2024-09-16T07:45:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_op_tracing": "false", 2024-09-16T07:45:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_opa_token": "", 2024-09-16T07:45:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_opa_url": "", 2024-09-16T07:45:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_opa_verify_ssl": "true", 2024-09-16T07:45:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-16T07:45:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-16T07:45:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_ops_log_rados": "false", 2024-09-16T07:45:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_ops_log_socket_path": "", 2024-09-16T07:45:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-16T07:45:16.052 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-16T07:45:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-16T07:45:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_period_push_interval": "2.000000", 2024-09-16T07:45:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-16T07:45:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-16T07:45:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-16T07:45:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-16T07:45:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_posix_cache_lanes": "3", 2024-09-16T07:45:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-16T07:45:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-16T07:45:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_posix_cache_partitions": "3", 2024-09-16T07:45:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-16T07:45:16.053 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_print_continue": "true", 2024-09-16T07:45:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-16T07:45:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-16T07:45:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-16T07:45:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-16T07:45:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-16T07:45:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_rados_tracing": "false", 2024-09-16T07:45:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_realm": "", 2024-09-16T07:45:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_realm_id": "", 2024-09-16T07:45:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-16T07:45:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_region": "", 2024-09-16T07:45:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-16T07:45:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-16T07:45:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-16T07:45:16.054 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-16T07:45:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_request_uri": "", 2024-09-16T07:45:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_reshard_batch_size": "64", 2024-09-16T07:45:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-16T07:45:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-16T07:45:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_reshard_max_aio": "128", 2024-09-16T07:45:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_reshard_num_logs": "16", 2024-09-16T07:45:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-16T07:45:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-16T07:45:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_reshard_thread_interval": "600", 2024-09-16T07:45:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-16T07:45:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_resolve_cname": "false", 2024-09-16T07:45:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-16T07:45:16.055 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_run_sync_thread": "true", 2024-09-16T07:45:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-16T07:45:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-16T07:45:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-16T07:45:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-16T07:45:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-16T07:45:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-16T07:45:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-16T07:45:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-16T07:45:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-16T07:45:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_scheduler_type": "throttler", 2024-09-16T07:45:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_script_uri": "", 2024-09-16T07:45:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_service_provider_name": "", 2024-09-16T07:45:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-16T07:45:16.056 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sts_client_id": "", 2024-09-16T07:45:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sts_client_secret": "", 2024-09-16T07:45:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sts_entry": "sts", 2024-09-16T07:45:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sts_key": "sts", 2024-09-16T07:45:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-16T07:45:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sts_min_session_duration": "900", 2024-09-16T07:45:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sts_token_introspection_url": "", 2024-09-16T07:45:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_swift_account_in_url": "false", 2024-09-16T07:45:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_swift_auth_entry": "auth", 2024-09-16T07:45:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_swift_auth_url": "", 2024-09-16T07:45:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_swift_custom_header": "", 2024-09-16T07:45:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-16T07:45:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_swift_need_stats": "true", 2024-09-16T07:45:16.057 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_swift_tenant_name": "", 2024-09-16T07:45:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_swift_token_expiration": "86400", 2024-09-16T07:45:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_swift_url": "", 2024-09-16T07:45:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_swift_url_prefix": "swift", 2024-09-16T07:45:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-16T07:45:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-16T07:45:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-16T07:45:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sync_lease_period": "120", 2024-09-16T07:45:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-16T07:45:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-16T07:45:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-16T07:45:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-16T07:45:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-16T07:45:16.058 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-16T07:45:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-16T07:45:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-16T07:45:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-16T07:45:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_thread_pool_size": "512", 2024-09-16T07:45:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-16T07:45:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-16T07:45:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-16T07:45:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-16T07:45:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_torrent_comment": "", 2024-09-16T07:45:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_torrent_createby": "", 2024-09-16T07:45:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_torrent_encoding": "", 2024-09-16T07:45:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_torrent_flag": "false", 2024-09-16T07:45:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-16T07:45:16.059 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_torrent_origin": "", 2024-09-16T07:45:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-16T07:45:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_torrent_tracker": "", 2024-09-16T07:45:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_trust_forwarded_https": "false", 2024-09-16T07:45:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-16T07:45:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-16T07:45:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_usage_max_shards": "32", 2024-09-16T07:45:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_usage_max_user_shards": "1", 2024-09-16T07:45:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_use_opa_authz": "false", 2024-09-16T07:45:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_user_counters_cache": "false", 2024-09-16T07:45:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-16T07:45:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-16T07:45:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-16T07:45:16.060 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_user_max_buckets": "1000", 2024-09-16T07:45:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_user_policies_max_num": "100", 2024-09-16T07:45:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-16T07:45:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-16T07:45:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-16T07:45:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-16T07:45:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_user_unique_email": "true", 2024-09-16T07:45:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_verify_ssl": "true", 2024-09-16T07:45:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-16T07:45:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_zone": "", 2024-09-16T07:45:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_zone_id": "", 2024-09-16T07:45:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-16T07:45:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_zonegroup": "", 2024-09-16T07:45:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_zonegroup_id": "", 2024-09-16T07:45:16.061 INFO:teuthology.orchestra.run.smithi003.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-16T07:45:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: "rgwlc_auto_session_clear": "true", 2024-09-16T07:45:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-16T07:45:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_block_size": "4096", 2024-09-16T07:45:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-16T07:45:16.062 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-16T07:45:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-16T07:45:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-16T07:45:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-16T07:45:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_cache_size": "536870912", 2024-09-16T07:45:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-16T07:45:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-16T07:45:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-16T07:45:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-16T07:45:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-16T07:45:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-16T07:45:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-16T07:45:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-16T07:45:16.064 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_index_type": "binary_search", 2024-09-16T07:45:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-16T07:45:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-16T07:45:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_partition_filters": "false", 2024-09-16T07:45:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_perf": "false", 2024-09-16T07:45:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-16T07:45:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-16T07:45:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-16T07:45:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "run_dir": "/var/run/ceph", 2024-09-16T07:45:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_block_create": "true", 2024-09-16T07:45:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_cache_lru_size": "67108864", 2024-09-16T07:45:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-16T07:45:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-16T07:45:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_default_max_object_size": "16777216", 2024-09-16T07:45:16.065 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-16T07:45:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_device_size": "53687091200", 2024-09-16T07:45:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-16T07:45:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_full_integrity_check": "false", 2024-09-16T07:45:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_journal_batch_capacity": "16", 2024-09-16T07:45:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-16T07:45:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-16T07:45:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-16T07:45:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_main_device_type": "SSD", 2024-09-16T07:45:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-16T07:45:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-16T07:45:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-16T07:45:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-16T07:45:16.066 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-16T07:45:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-16T07:45:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "seastore_segment_size": "67108864", 2024-09-16T07:45:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "set_keepcaps": "false", 2024-09-16T07:45:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "setgroup": "", 2024-09-16T07:45:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "setuser": "", 2024-09-16T07:45:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "setuser_match_path": "", 2024-09-16T07:45:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-16T07:45:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "thp": "false", 2024-09-16T07:45:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "threadpool_default_timeout": "60", 2024-09-16T07:45:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-16T07:45:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "throttler_perf_counter": "true", 2024-09-16T07:45:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "tmp_dir": "/tmp", 2024-09-16T07:45:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-16T07:45:16.067 INFO:teuthology.orchestra.run.smithi003.stdout: "uadk_compressor_enabled": "false", 2024-09-16T07:45:16.068 INFO:teuthology.orchestra.run.smithi003.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-16T07:45:16.068 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T07:45:16.070 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-16T07:45:16.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:16.181+0000 7fc420688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:16.187+0000 7fc420688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.202 INFO:teuthology.orchestra.run.smithi003.stdout:{} 2024-09-16T07:45:16.202 INFO:teuthology.orchestra.run.smithi003.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-16T07:45:16.213 DEBUG:teuthology.orchestra.run.smithi003:> type ceph-objectstore-tool 2024-09-16T07:45:16.228 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-16T07:45:16.228 DEBUG:teuthology.orchestra.run.smithi134:> type ceph-objectstore-tool 2024-09-16T07:45:16.246 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-16T07:45:16.246 INFO:teuthology.run_tasks:Running task full_sequential... 2024-09-16T07:45:16.256 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T07:45:16.257 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T07:45:16.258 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-16T07:45:16.258 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-16T07:45:16.258 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-16T07:45:16.258 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:45:16.258 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:45:16.258 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:45:16.259 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:45:16.259 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-16T07:45:16.259 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:16.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:16.385+0000 7fea80a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:16.383+0000 7f2c500fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:16.391+0000 7fea80a7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:16.383+0000 7f8f97846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:16.394+0000 7f2c500fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:16.399+0000 7f8f97846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.413 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:16.413 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:45:16.413 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:45:16.413 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:45:16.413 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:45:16.413 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:45:16.413 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:45:16.414 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:45:16.414 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:45:16.414 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:45:16.414 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:45:16.414 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:45:16.417 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:16.417 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:16.418 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:45:16.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:16.533+0000 7f33fb674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:16.543+0000 7f33fb674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.563 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:16.563 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:45:16.563 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:45:16.563 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:45:16.563 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:45:16.563 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:45:16.563 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:45:16.563 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:45:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:45:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:45:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:45:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:45:16.566 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:16.567 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:16.567 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:45:16.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:16.719+0000 7ff269391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:16.729+0000 7ff269391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.748 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:16.748 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:45:16.748 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:45:16.748 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:45:16.748 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:45:16.749 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:45:16.749 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:45:16.749 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:45:16.749 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:45:16.749 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:45:16.749 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:45:16.749 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:45:16.751 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:16.751 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:16.751 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:45:16.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:16.860+0000 7f021e151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:16.870+0000 7f021e151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.888 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:16.888 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:45:16.889 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:45:16.889 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:45:16.889 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:45:16.889 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:45:16.889 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:45:16.889 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:45:16.889 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:45:16.889 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:45:16.889 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:45:16.889 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:45:16.890 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:16.890 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:17.391 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'unique_pool_0' created 2024-09-16T07:45:17.413 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-16T07:45:17.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:17.563+0000 7f107a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:17.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:17.578+0000 7f107a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:18.395 INFO:teuthology.orchestra.run.smithi003.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-16T07:45:18.525 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:18.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:18.669+0000 7f8116391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:18.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:18.675+0000 7f8116391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:19.416 DEBUG:teuthology.orchestra.run.smithi003:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 90 write' 2024-09-16T07:45:19.419 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T07:45:19.419 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T07:45:19.491 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:hints = 1 2024-09-16T07:45:19.492 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T07:45:19.492 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Object prefix: benchmark_data_smithi003_30169 2024-09-16T07:45:19.492 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:45:19.492 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 0 0 0 0 0 0 - 0 2024-09-16T07:45:20.492 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 1 16 204 188 11.7492 11.75 0.0520823 0.0819884 2024-09-16T07:45:20.775 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:20.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:20.949+0000 7f789a27d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:20.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:20.958+0000 7f789a27d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:21.492 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 2 16 402 386 12.0616 12.375 0.131506 0.0810333 2024-09-16T07:45:21.891 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:45:21.891 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:45:21.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:22.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:22.055+0000 7f0729a63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:22.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:22.074+0000 7f0728801640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:22.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:22.389 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:45:22.409 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-16T07:45:22.288691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108032,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379328,"statfs":{"total":386547056640,"available":386436431872,"internally_reserved":0,"allocated":704512,"data_stored":1906173,"data_compressed":90123,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000969"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.395156+0000","last_change":"2024-09-16T07:45:07.405679+0000","last_active":"2024-09-16T07:45:11.395156+0000","last_peered":"2024-09-16T07:45:11.395156+0000","last_clean":"2024-09-16T07:45:11.395156+0000","last_became_active":"2024-09-16T07:45:07.398279+0000","last_became_peered":"2024-09-16T07:45:07.398279+0000","last_unstale":"2024-09-16T07:45:11.395156+0000","last_undegraded":"2024-09-16T07:45:11.395156+0000","last_fullsized":"2024-09-16T07:45:11.395156+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396937+0000","last_change":"2024-09-16T07:45:11.400212+0000","last_active":"2024-09-16T07:45:11.396937+0000","last_peered":"2024-09-16T07:45:11.396937+0000","last_clean":"2024-09-16T07:45:11.396937+0000","last_became_active":"2024-09-16T07:45:09.452060+0000","last_became_peered":"2024-09-16T07:45:09.452060+0000","last_unstale":"2024-09-16T07:45:11.396937+0000","last_undegraded":"2024-09-16T07:45:11.396937+0000","last_fullsized":"2024-09-16T07:45:11.396937+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:11.400765+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.392752+0000","last_change":"2024-09-16T07:45:11.395908+0000","last_active":"2024-09-16T07:45:11.392752+0000","last_peered":"2024-09-16T07:45:11.392752+0000","last_clean":"2024-09-16T07:45:11.392752+0000","last_became_active":"2024-09-16T07:45:09.435810+0000","last_became_peered":"2024-09-16T07:45:09.435810+0000","last_unstale":"2024-09-16T07:45:11.392752+0000","last_undegraded":"2024-09-16T07:45:11.392752+0000","last_fullsized":"2024-09-16T07:45:11.392752+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:11.397414+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:11.396333+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.398355+0000","last_change":"2024-09-16T07:45:11.401508+0000","last_active":"2024-09-16T07:45:11.398355+0000","last_peered":"2024-09-16T07:45:11.398355+0000","last_clean":"2024-09-16T07:45:11.398355+0000","last_became_active":"2024-09-16T07:45:09.435575+0000","last_became_peered":"2024-09-16T07:45:09.435575+0000","last_unstale":"2024-09-16T07:45:11.398355+0000","last_undegraded":"2024-09-16T07:45:11.398355+0000","last_fullsized":"2024-09-16T07:45:11.398355+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:11.396269+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T07:45:11.396744+0000","last_change":"2024-09-16T07:45:11.399603+0000","last_active":"2024-09-16T07:45:11.396744+0000","last_peered":"2024-09-16T07:45:11.396744+0000","last_clean":"2024-09-16T07:45:11.396744+0000","last_became_active":"2024-09-16T07:45:09.463398+0000","last_became_peered":"2024-09-16T07:45:09.463398+0000","last_unstale":"2024-09-16T07:45:11.396744+0000","last_undegraded":"2024-09-16T07:45:11.396744+0000","last_fullsized":"2024-09-16T07:45:11.396744+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27016,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344824,"statfs":{"total":96636764160,"available":96609099776,"internally_reserved":0,"allocated":188416,"data_stored":624121,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":33772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:22.492 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 3 16 599 583 12.1449 12.3125 0.0676359 0.0812761 2024-09-16T07:45:23.393 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:23.492 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 4 16 810 794 12.4053 13.1875 0.0760068 0.079857 2024-09-16T07:45:23.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:23.557+0000 7f6f31cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:23.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:23.567+0000 7f6f31cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:24.492 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 5 16 1002 986 12.324 12 0.0747561 0.0806551 2024-09-16T07:45:25.492 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 6 15 1197 1182 12.3115 12.25 0.143309 0.0805676 2024-09-16T07:45:25.868 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:26.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:26.043+0000 7f5d88c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:26.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:26.055+0000 7f5d88c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:26.492 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 7 16 1396 1380 12.3204 12.375 0.0741816 0.080616 2024-09-16T07:45:27.412 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:45:27.412 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:45:27.412 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2, 3] 2024-09-16T07:45:27.412 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T07:45:27.413 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:45:27.492 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 8 16 1580 1564 12.2177 11.5 0.0944204 0.0808679 2024-09-16T07:45:27.503 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T07:45:28.408 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:28.493 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 9 16 1580 1564 10.8602 0 - 0.0808679 2024-09-16T07:45:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:28.533+0000 7faf0eaac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:28.540+0000 7faf0eaac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:29.493 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 10 16 1580 1564 9.7741 0 - 0.0808679 2024-09-16T07:45:30.493 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 11 16 1580 1564 8.88548 0 - 0.0808679 2024-09-16T07:45:31.493 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 12 16 1580 1564 8.14496 0 - 0.0808679 2024-09-16T07:45:32.493 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 13 16 1580 1564 7.51838 0 - 0.0808679 2024-09-16T07:45:32.504 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2] live_osds: [0, 1, 3] 2024-09-16T07:45:32.504 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:45:32.504 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 3] 2024-09-16T07:45:32.504 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T07:45:32.505 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:45:32.576 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T07:45:33.498 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 14 16 1580 1564 6.98135 0 - 0.0808679 2024-09-16T07:45:34.494 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 15 16 1580 1564 6.51592 0 - 0.0808679 2024-09-16T07:45:35.494 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 16 16 1580 1564 6.10865 0 - 0.0808679 2024-09-16T07:45:36.494 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 17 16 1580 1564 5.7493 0 - 0.0808679 2024-09-16T07:45:37.494 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 18 16 1580 1564 5.42989 0 - 0.0808679 2024-09-16T07:45:37.577 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2, 0] live_osds: [1, 3] 2024-09-16T07:45:37.577 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-16T07:45:37.577 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:45:37.577 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T07:45:37.580 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:45:37.581 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:45:37.699 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:45:37.703 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:37.703 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:45:38.494 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 19 16 1580 1564 5.14411 0 - 0.0808679 2024-09-16T07:45:39.494 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:45:39.496242+0000 min lat: 0.0163118 max lat: 0.174103 avg lat: 0.0808679 2024-09-16T07:45:39.494 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:45:39.494 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 20 16 1580 1564 4.88691 0 - 0.0808679 2024-09-16T07:45:40.494 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 21 16 1580 1564 4.6542 0 - 0.0808679 2024-09-16T07:45:41.495 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 22 16 1580 1564 4.44265 0 - 0.0808679 2024-09-16T07:45:42.497 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 23 16 1580 1564 4.2495 0 - 0.0808679 2024-09-16T07:45:42.704 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:45:42.810 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T07:45:42.810 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [] 2024-09-16T07:45:42.810 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T07:45:42.819 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-09-16T07:45:42.819 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T07:45:42.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T07:45:42.822 INFO:tasks.ceph.osd.2:Started 2024-09-16T07:45:42.822 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T07:45:42.922 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:45:42.925 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:42.926 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-16T07:45:43.495 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 24 16 1580 1564 4.07244 0 - 0.0808679 2024-09-16T07:45:44.495 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 25 16 1580 1564 3.90955 0 - 0.0808679 2024-09-16T07:45:45.495 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 26 16 1580 1564 3.75918 0 - 0.0808679 2024-09-16T07:45:46.495 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 27 16 1580 1564 3.61994 0 - 0.0808679 2024-09-16T07:45:47.495 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 28 16 1580 1564 3.49066 0 - 0.0808679 2024-09-16T07:45:47.927 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T07:45:48.031 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-16T07:45:48.031 INFO:teuthology.orchestra.run.smithi134.stdout: "ops_in_flight": [] 2024-09-16T07:45:48.031 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-16T07:45:48.041 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:45:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:48.167+0000 7fe873d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:48.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:48.178+0000 7fe873d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:48.454 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:45:48.477 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:45:48.495 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 29 16 1580 1564 3.37029 0 - 0.0808679 2024-09-16T07:45:48.546 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:45:48.595 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:45:48.596 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:45:48.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:48.620+0000 7fc2d0b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:48.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:48.633+0000 7fc2d0b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:49.455 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:45:49.487 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:45:49.495 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 30 16 1580 1564 3.25795 0 - 0.0808679 2024-09-16T07:45:49.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:49.643+0000 7fdbe0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:49.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:49.655+0000 7fdbe0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:50.463 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:45:50.486 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:45:50.495 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 31 16 1580 1564 3.15286 0 - 0.0808679 2024-09-16T07:45:50.597 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:50.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:50.632+0000 7f7f4fafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:50.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:50.653+0000 7f7f4fafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:50.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:50.755+0000 7fc043423640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:50.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:50.767+0000 7fc043423640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:51.464 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:45:51.489 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:45:51.489 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:51.495 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 32 16 1725 1709 3.3375 0.377604 0.0900241 0.299091 2024-09-16T07:45:51.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:51.650+0000 7f53e04bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:51.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:51.663+0000 7f53e04bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:51.996 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:51.996 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:45:52.013 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-09-16T07:45:51.466259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":54133299,"num_objects":821,"num_object_clones":0,"num_object_copies":2463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":898,"num_write_kb":53396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":872,"ondisk_log_size":872,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":126844,"kb_used_data":11180,"kb_used_omap":0,"kb_used_meta":115584,"kb_avail":377360516,"statfs":{"total":386547056640,"available":386417168384,"internally_reserved":0,"allocated":11448320,"data_stored":173042361,"data_compressed":8213703,"data_compressed_allocated":10817536,"data_compressed_original":172834816,"omap_allocated":0,"internal_metadata":118358016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.172131"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"18'105","reported_seq":117,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.082337+0000","last_change":"2024-09-16T07:45:18.598420+0000","last_active":"2024-09-16T07:45:27.082337+0000","last_peered":"2024-09-16T07:45:27.082337+0000","last_clean":"2024-09-16T07:45:27.082337+0000","last_became_active":"2024-09-16T07:45:18.586576+0000","last_became_peered":"2024-09-16T07:45:18.586576+0000","last_unstale":"2024-09-16T07:45:27.082337+0000","last_undegraded":"2024-09-16T07:45:27.082337+0000","last_fullsized":"2024-09-16T07:45:27.082337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"18'86","reported_seq":98,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.447983+0000","last_change":"2024-09-16T07:45:18.557648+0000","last_active":"2024-09-16T07:45:27.447983+0000","last_peered":"2024-09-16T07:45:27.447983+0000","last_clean":"2024-09-16T07:45:27.447983+0000","last_became_active":"2024-09-16T07:45:18.543769+0000","last_became_peered":"2024-09-16T07:45:18.543769+0000","last_unstale":"2024-09-16T07:45:27.447983+0000","last_undegraded":"2024-09-16T07:45:27.447983+0000","last_fullsized":"2024-09-16T07:45:27.447983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"18'90","reported_seq":102,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.312577+0000","last_change":"2024-09-16T07:45:18.546066+0000","last_active":"2024-09-16T07:45:27.312577+0000","last_peered":"2024-09-16T07:45:27.312577+0000","last_clean":"2024-09-16T07:45:27.312577+0000","last_became_active":"2024-09-16T07:45:18.530524+0000","last_became_peered":"2024-09-16T07:45:18.530524+0000","last_unstale":"2024-09-16T07:45:27.312577+0000","last_undegraded":"2024-09-16T07:45:27.312577+0000","last_fullsized":"2024-09-16T07:45:27.312577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.418982+0000","last_change":"2024-09-16T07:45:07.405679+0000","last_active":"2024-09-16T07:45:19.418982+0000","last_peered":"2024-09-16T07:45:19.418982+0000","last_clean":"2024-09-16T07:45:19.418982+0000","last_became_active":"2024-09-16T07:45:07.398279+0000","last_became_peered":"2024-09-16T07:45:07.398279+0000","last_unstale":"2024-09-16T07:45:19.418982+0000","last_undegraded":"2024-09-16T07:45:19.418982+0000","last_fullsized":"2024-09-16T07:45:19.418982+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.433249+0000","last_change":"2024-09-16T07:45:11.400212+0000","last_active":"2024-09-16T07:45:19.433249+0000","last_peered":"2024-09-16T07:45:19.433249+0000","last_clean":"2024-09-16T07:45:19.433249+0000","last_became_active":"2024-09-16T07:45:09.452060+0000","last_became_peered":"2024-09-16T07:45:09.452060+0000","last_unstale":"2024-09-16T07:45:19.433249+0000","last_undegraded":"2024-09-16T07:45:19.433249+0000","last_fullsized":"2024-09-16T07:45:19.433249+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'98","reported_seq":110,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.158441+0000","last_change":"2024-09-16T07:45:18.576020+0000","last_active":"2024-09-16T07:45:27.158441+0000","last_peered":"2024-09-16T07:45:27.158441+0000","last_clean":"2024-09-16T07:45:27.158441+0000","last_became_active":"2024-09-16T07:45:18.566642+0000","last_became_peered":"2024-09-16T07:45:18.566642+0000","last_unstale":"2024-09-16T07:45:27.158441+0000","last_undegraded":"2024-09-16T07:45:27.158441+0000","last_fullsized":"2024-09-16T07:45:27.158441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:42.438903+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'101","reported_seq":113,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.374194+0000","last_change":"2024-09-16T07:45:18.565470+0000","last_active":"2024-09-16T07:45:27.374194+0000","last_peered":"2024-09-16T07:45:27.374194+0000","last_clean":"2024-09-16T07:45:27.374194+0000","last_became_active":"2024-09-16T07:45:18.550698+0000","last_became_peered":"2024-09-16T07:45:18.550698+0000","last_unstale":"2024-09-16T07:45:27.374194+0000","last_undegraded":"2024-09-16T07:45:27.374194+0000","last_fullsized":"2024-09-16T07:45:27.374194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.422394+0000","last_change":"2024-09-16T07:45:11.395908+0000","last_active":"2024-09-16T07:45:19.422394+0000","last_peered":"2024-09-16T07:45:19.422394+0000","last_clean":"2024-09-16T07:45:19.422394+0000","last_became_active":"2024-09-16T07:45:09.435810+0000","last_became_peered":"2024-09-16T07:45:09.435810+0000","last_unstale":"2024-09-16T07:45:19.422394+0000","last_undegraded":"2024-09-16T07:45:19.422394+0000","last_fullsized":"2024-09-16T07:45:19.422394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'117","reported_seq":129,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.435400+0000","last_change":"2024-09-16T07:45:18.561282+0000","last_active":"2024-09-16T07:45:27.435400+0000","last_peered":"2024-09-16T07:45:27.435400+0000","last_clean":"2024-09-16T07:45:27.435400+0000","last_became_active":"2024-09-16T07:45:18.551046+0000","last_became_peered":"2024-09-16T07:45:18.551046+0000","last_unstale":"2024-09-16T07:45:27.435400+0000","last_undegraded":"2024-09-16T07:45:27.435400+0000","last_fullsized":"2024-09-16T07:45:27.435400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:42.438905+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"18'125","reported_seq":137,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.322414+0000","last_change":"2024-09-16T07:45:18.569387+0000","last_active":"2024-09-16T07:45:27.322414+0000","last_peered":"2024-09-16T07:45:27.322414+0000","last_clean":"2024-09-16T07:45:27.322414+0000","last_became_active":"2024-09-16T07:45:18.555943+0000","last_became_peered":"2024-09-16T07:45:18.555943+0000","last_unstale":"2024-09-16T07:45:27.322414+0000","last_undegraded":"2024-09-16T07:45:27.322414+0000","last_fullsized":"2024-09-16T07:45:27.322414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:48.456269+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.424124+0000","last_change":"2024-09-16T07:45:11.401508+0000","last_active":"2024-09-16T07:45:19.424124+0000","last_peered":"2024-09-16T07:45:19.424124+0000","last_clean":"2024-09-16T07:45:19.424124+0000","last_became_active":"2024-09-16T07:45:09.435575+0000","last_became_peered":"2024-09-16T07:45:09.435575+0000","last_unstale":"2024-09-16T07:45:19.424124+0000","last_undegraded":"2024-09-16T07:45:19.424124+0000","last_fullsized":"2024-09-16T07:45:19.424124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'95","reported_seq":107,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.258261+0000","last_change":"2024-09-16T07:45:18.538421+0000","last_active":"2024-09-16T07:45:27.258261+0000","last_peered":"2024-09-16T07:45:27.258261+0000","last_clean":"2024-09-16T07:45:27.258261+0000","last_became_active":"2024-09-16T07:45:18.526458+0000","last_became_peered":"2024-09-16T07:45:18.526458+0000","last_unstale":"2024-09-16T07:45:27.258261+0000","last_undegraded":"2024-09-16T07:45:27.258261+0000","last_fullsized":"2024-09-16T07:45:27.258261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:48.456270+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.430231+0000","last_change":"2024-09-16T07:45:11.399603+0000","last_active":"2024-09-16T07:45:19.430231+0000","last_peered":"2024-09-16T07:45:19.430231+0000","last_clean":"2024-09-16T07:45:19.430231+0000","last_became_active":"2024-09-16T07:45:09.463398+0000","last_became_peered":"2024-09-16T07:45:09.463398+0000","last_unstale":"2024-09-16T07:45:19.430231+0000","last_undegraded":"2024-09-16T07:45:19.430231+0000","last_fullsized":"2024-09-16T07:45:19.430231+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":53542912,"num_objects":817,"num_object_clones":0,"num_object_copies":2451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":817,"num_write_kb":52288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10694656,"data_stored":171114496,"data_compressed":8123580,"data_compressed_allocated":10694656,"data_compressed_original":171114496,"omap_allocated":0,"internal_metadata":0},"log_size":817,"ondisk_log_size":817,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36748,"kb_used_data":5756,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335092,"statfs":{"total":96636764160,"available":96599134208,"internally_reserved":0,"allocated":5894144,"data_stored":91533399,"data_compressed":4345415,"data_compressed_allocated":5722112,"data_compressed_original":91471872,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36040,"kb_used_data":5048,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335800,"statfs":{"total":96636764160,"available":96599859200,"internally_reserved":0,"allocated":5169152,"data_stored":80260682,"data_compressed":3808206,"data_compressed_allocated":5013504,"data_compressed_original":80216064,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5013504,"data_stored":80216064,"data_compressed":3808206,"data_compressed_allocated":5013504,"data_compressed_original":80216064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5681152,"data_stored":90898432,"data_compressed":4315374,"data_compressed_allocated":5681152,"data_compressed_original":90898432,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:52.016 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:52.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:52.207+0000 7ff70b8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:52.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:52.220+0000 7ff70b8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:52.496 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 33 16 1925 1909 3.61511 12.5 0.101911 0.276155 2024-09-16T07:45:52.498 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:45:52.515 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-16T07:45:52.295447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":54133299,"num_objects":821,"num_object_clones":0,"num_object_copies":2463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":898,"num_write_kb":53396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":872,"ondisk_log_size":872,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":126844,"kb_used_data":11180,"kb_used_omap":0,"kb_used_meta":115584,"kb_avail":377360516,"statfs":{"total":386547056640,"available":386417168384,"internally_reserved":0,"allocated":11448320,"data_stored":173042361,"data_compressed":8213703,"data_compressed_allocated":10817536,"data_compressed_original":172834816,"omap_allocated":0,"internal_metadata":118358016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000963"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"18'105","reported_seq":117,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.082337+0000","last_change":"2024-09-16T07:45:18.598420+0000","last_active":"2024-09-16T07:45:27.082337+0000","last_peered":"2024-09-16T07:45:27.082337+0000","last_clean":"2024-09-16T07:45:27.082337+0000","last_became_active":"2024-09-16T07:45:18.586576+0000","last_became_peered":"2024-09-16T07:45:18.586576+0000","last_unstale":"2024-09-16T07:45:27.082337+0000","last_undegraded":"2024-09-16T07:45:27.082337+0000","last_fullsized":"2024-09-16T07:45:27.082337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"18'86","reported_seq":98,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.447983+0000","last_change":"2024-09-16T07:45:18.557648+0000","last_active":"2024-09-16T07:45:27.447983+0000","last_peered":"2024-09-16T07:45:27.447983+0000","last_clean":"2024-09-16T07:45:27.447983+0000","last_became_active":"2024-09-16T07:45:18.543769+0000","last_became_peered":"2024-09-16T07:45:18.543769+0000","last_unstale":"2024-09-16T07:45:27.447983+0000","last_undegraded":"2024-09-16T07:45:27.447983+0000","last_fullsized":"2024-09-16T07:45:27.447983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"18'90","reported_seq":102,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.312577+0000","last_change":"2024-09-16T07:45:18.546066+0000","last_active":"2024-09-16T07:45:27.312577+0000","last_peered":"2024-09-16T07:45:27.312577+0000","last_clean":"2024-09-16T07:45:27.312577+0000","last_became_active":"2024-09-16T07:45:18.530524+0000","last_became_peered":"2024-09-16T07:45:18.530524+0000","last_unstale":"2024-09-16T07:45:27.312577+0000","last_undegraded":"2024-09-16T07:45:27.312577+0000","last_fullsized":"2024-09-16T07:45:27.312577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.418982+0000","last_change":"2024-09-16T07:45:07.405679+0000","last_active":"2024-09-16T07:45:19.418982+0000","last_peered":"2024-09-16T07:45:19.418982+0000","last_clean":"2024-09-16T07:45:19.418982+0000","last_became_active":"2024-09-16T07:45:07.398279+0000","last_became_peered":"2024-09-16T07:45:07.398279+0000","last_unstale":"2024-09-16T07:45:19.418982+0000","last_undegraded":"2024-09-16T07:45:19.418982+0000","last_fullsized":"2024-09-16T07:45:19.418982+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.433249+0000","last_change":"2024-09-16T07:45:11.400212+0000","last_active":"2024-09-16T07:45:19.433249+0000","last_peered":"2024-09-16T07:45:19.433249+0000","last_clean":"2024-09-16T07:45:19.433249+0000","last_became_active":"2024-09-16T07:45:09.452060+0000","last_became_peered":"2024-09-16T07:45:09.452060+0000","last_unstale":"2024-09-16T07:45:19.433249+0000","last_undegraded":"2024-09-16T07:45:19.433249+0000","last_fullsized":"2024-09-16T07:45:19.433249+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'98","reported_seq":110,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.158441+0000","last_change":"2024-09-16T07:45:18.576020+0000","last_active":"2024-09-16T07:45:27.158441+0000","last_peered":"2024-09-16T07:45:27.158441+0000","last_clean":"2024-09-16T07:45:27.158441+0000","last_became_active":"2024-09-16T07:45:18.566642+0000","last_became_peered":"2024-09-16T07:45:18.566642+0000","last_unstale":"2024-09-16T07:45:27.158441+0000","last_undegraded":"2024-09-16T07:45:27.158441+0000","last_fullsized":"2024-09-16T07:45:27.158441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:42.438903+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'101","reported_seq":113,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.374194+0000","last_change":"2024-09-16T07:45:18.565470+0000","last_active":"2024-09-16T07:45:27.374194+0000","last_peered":"2024-09-16T07:45:27.374194+0000","last_clean":"2024-09-16T07:45:27.374194+0000","last_became_active":"2024-09-16T07:45:18.550698+0000","last_became_peered":"2024-09-16T07:45:18.550698+0000","last_unstale":"2024-09-16T07:45:27.374194+0000","last_undegraded":"2024-09-16T07:45:27.374194+0000","last_fullsized":"2024-09-16T07:45:27.374194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.422394+0000","last_change":"2024-09-16T07:45:11.395908+0000","last_active":"2024-09-16T07:45:19.422394+0000","last_peered":"2024-09-16T07:45:19.422394+0000","last_clean":"2024-09-16T07:45:19.422394+0000","last_became_active":"2024-09-16T07:45:09.435810+0000","last_became_peered":"2024-09-16T07:45:09.435810+0000","last_unstale":"2024-09-16T07:45:19.422394+0000","last_undegraded":"2024-09-16T07:45:19.422394+0000","last_fullsized":"2024-09-16T07:45:19.422394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'117","reported_seq":129,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.435400+0000","last_change":"2024-09-16T07:45:18.561282+0000","last_active":"2024-09-16T07:45:27.435400+0000","last_peered":"2024-09-16T07:45:27.435400+0000","last_clean":"2024-09-16T07:45:27.435400+0000","last_became_active":"2024-09-16T07:45:18.551046+0000","last_became_peered":"2024-09-16T07:45:18.551046+0000","last_unstale":"2024-09-16T07:45:27.435400+0000","last_undegraded":"2024-09-16T07:45:27.435400+0000","last_fullsized":"2024-09-16T07:45:27.435400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:42.438905+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"18'125","reported_seq":137,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.322414+0000","last_change":"2024-09-16T07:45:18.569387+0000","last_active":"2024-09-16T07:45:27.322414+0000","last_peered":"2024-09-16T07:45:27.322414+0000","last_clean":"2024-09-16T07:45:27.322414+0000","last_became_active":"2024-09-16T07:45:18.555943+0000","last_became_peered":"2024-09-16T07:45:18.555943+0000","last_unstale":"2024-09-16T07:45:27.322414+0000","last_undegraded":"2024-09-16T07:45:27.322414+0000","last_fullsized":"2024-09-16T07:45:27.322414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:48.456269+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.424124+0000","last_change":"2024-09-16T07:45:11.401508+0000","last_active":"2024-09-16T07:45:19.424124+0000","last_peered":"2024-09-16T07:45:19.424124+0000","last_clean":"2024-09-16T07:45:19.424124+0000","last_became_active":"2024-09-16T07:45:09.435575+0000","last_became_peered":"2024-09-16T07:45:09.435575+0000","last_unstale":"2024-09-16T07:45:19.424124+0000","last_undegraded":"2024-09-16T07:45:19.424124+0000","last_fullsized":"2024-09-16T07:45:19.424124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'95","reported_seq":107,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.258261+0000","last_change":"2024-09-16T07:45:18.538421+0000","last_active":"2024-09-16T07:45:27.258261+0000","last_peered":"2024-09-16T07:45:27.258261+0000","last_clean":"2024-09-16T07:45:27.258261+0000","last_became_active":"2024-09-16T07:45:18.526458+0000","last_became_peered":"2024-09-16T07:45:18.526458+0000","last_unstale":"2024-09-16T07:45:27.258261+0000","last_undegraded":"2024-09-16T07:45:27.258261+0000","last_fullsized":"2024-09-16T07:45:27.258261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:48.456270+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.430231+0000","last_change":"2024-09-16T07:45:11.399603+0000","last_active":"2024-09-16T07:45:19.430231+0000","last_peered":"2024-09-16T07:45:19.430231+0000","last_clean":"2024-09-16T07:45:19.430231+0000","last_became_active":"2024-09-16T07:45:09.463398+0000","last_became_peered":"2024-09-16T07:45:09.463398+0000","last_unstale":"2024-09-16T07:45:19.430231+0000","last_undegraded":"2024-09-16T07:45:19.430231+0000","last_fullsized":"2024-09-16T07:45:19.430231+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":53542912,"num_objects":817,"num_object_clones":0,"num_object_copies":2451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":817,"num_write_kb":52288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10694656,"data_stored":171114496,"data_compressed":8123580,"data_compressed_allocated":10694656,"data_compressed_original":171114496,"omap_allocated":0,"internal_metadata":0},"log_size":817,"ondisk_log_size":817,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36748,"kb_used_data":5756,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335092,"statfs":{"total":96636764160,"available":96599134208,"internally_reserved":0,"allocated":5894144,"data_stored":91533399,"data_compressed":4345415,"data_compressed_allocated":5722112,"data_compressed_original":91471872,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36040,"kb_used_data":5048,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335800,"statfs":{"total":96636764160,"available":96599859200,"internally_reserved":0,"allocated":5169152,"data_stored":80260682,"data_compressed":3808206,"data_compressed_allocated":5013504,"data_compressed_original":80216064,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5013504,"data_stored":80216064,"data_compressed":3808206,"data_compressed_allocated":5013504,"data_compressed_original":80216064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5681152,"data_stored":90898432,"data_compressed":4315374,"data_compressed_allocated":5681152,"data_compressed_original":90898432,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:52.516 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:45:52.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:52.661+0000 7fdbf5d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:52.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:52.671+0000 7fdbf5d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:53.068 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:53.081 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:53.082 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":55,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":25,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472749,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":13},{"state_name":"unknown","count":8},{"state_name":"stale+active+clean","count":4}],"num_pgs":25,"num_pools":3,"num_objects":821,"data_bytes":54133299,"bytes_used":129888256,"bytes_avail":386417168384,"bytes_total":386547056640,"unknown_pgs_ratio":0.31999999284744263},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-16T07:44:57.936809+0000","services":{}},"progress_events":{}} 2024-09-16T07:45:53.104 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:45:53.104 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:53.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:53.227+0000 7f15c1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:53.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:53.235+0000 7f15c1b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:53.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:53.302+0000 7f9005f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:53.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:53.320+0000 7f9005f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:53.496 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 34 16 2107 2091 3.84331 11.375 0.12183 0.25971 2024-09-16T07:45:53.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:53.680 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:45:53.699 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-16T07:45:52.295447+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":54133299,"num_objects":821,"num_object_clones":0,"num_object_copies":2463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":898,"num_write_kb":53396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":872,"ondisk_log_size":872,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":126844,"kb_used_data":11180,"kb_used_omap":0,"kb_used_meta":115584,"kb_avail":377360516,"statfs":{"total":386547056640,"available":386417168384,"internally_reserved":0,"allocated":11448320,"data_stored":173042361,"data_compressed":8213703,"data_compressed_allocated":10817536,"data_compressed_original":172834816,"omap_allocated":0,"internal_metadata":118358016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000963"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"18'105","reported_seq":117,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.082337+0000","last_change":"2024-09-16T07:45:18.598420+0000","last_active":"2024-09-16T07:45:27.082337+0000","last_peered":"2024-09-16T07:45:27.082337+0000","last_clean":"2024-09-16T07:45:27.082337+0000","last_became_active":"2024-09-16T07:45:18.586576+0000","last_became_peered":"2024-09-16T07:45:18.586576+0000","last_unstale":"2024-09-16T07:45:27.082337+0000","last_undegraded":"2024-09-16T07:45:27.082337+0000","last_fullsized":"2024-09-16T07:45:27.082337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"18'86","reported_seq":98,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.447983+0000","last_change":"2024-09-16T07:45:18.557648+0000","last_active":"2024-09-16T07:45:27.447983+0000","last_peered":"2024-09-16T07:45:27.447983+0000","last_clean":"2024-09-16T07:45:27.447983+0000","last_became_active":"2024-09-16T07:45:18.543769+0000","last_became_peered":"2024-09-16T07:45:18.543769+0000","last_unstale":"2024-09-16T07:45:27.447983+0000","last_undegraded":"2024-09-16T07:45:27.447983+0000","last_fullsized":"2024-09-16T07:45:27.447983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"18'90","reported_seq":102,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.312577+0000","last_change":"2024-09-16T07:45:18.546066+0000","last_active":"2024-09-16T07:45:27.312577+0000","last_peered":"2024-09-16T07:45:27.312577+0000","last_clean":"2024-09-16T07:45:27.312577+0000","last_became_active":"2024-09-16T07:45:18.530524+0000","last_became_peered":"2024-09-16T07:45:18.530524+0000","last_unstale":"2024-09-16T07:45:27.312577+0000","last_undegraded":"2024-09-16T07:45:27.312577+0000","last_fullsized":"2024-09-16T07:45:27.312577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.418982+0000","last_change":"2024-09-16T07:45:07.405679+0000","last_active":"2024-09-16T07:45:19.418982+0000","last_peered":"2024-09-16T07:45:19.418982+0000","last_clean":"2024-09-16T07:45:19.418982+0000","last_became_active":"2024-09-16T07:45:07.398279+0000","last_became_peered":"2024-09-16T07:45:07.398279+0000","last_unstale":"2024-09-16T07:45:19.418982+0000","last_undegraded":"2024-09-16T07:45:19.418982+0000","last_fullsized":"2024-09-16T07:45:19.418982+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.433249+0000","last_change":"2024-09-16T07:45:11.400212+0000","last_active":"2024-09-16T07:45:19.433249+0000","last_peered":"2024-09-16T07:45:19.433249+0000","last_clean":"2024-09-16T07:45:19.433249+0000","last_became_active":"2024-09-16T07:45:09.452060+0000","last_became_peered":"2024-09-16T07:45:09.452060+0000","last_unstale":"2024-09-16T07:45:19.433249+0000","last_undegraded":"2024-09-16T07:45:19.433249+0000","last_fullsized":"2024-09-16T07:45:19.433249+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'98","reported_seq":110,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.158441+0000","last_change":"2024-09-16T07:45:18.576020+0000","last_active":"2024-09-16T07:45:27.158441+0000","last_peered":"2024-09-16T07:45:27.158441+0000","last_clean":"2024-09-16T07:45:27.158441+0000","last_became_active":"2024-09-16T07:45:18.566642+0000","last_became_peered":"2024-09-16T07:45:18.566642+0000","last_unstale":"2024-09-16T07:45:27.158441+0000","last_undegraded":"2024-09-16T07:45:27.158441+0000","last_fullsized":"2024-09-16T07:45:27.158441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:42.438903+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'101","reported_seq":113,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.374194+0000","last_change":"2024-09-16T07:45:18.565470+0000","last_active":"2024-09-16T07:45:27.374194+0000","last_peered":"2024-09-16T07:45:27.374194+0000","last_clean":"2024-09-16T07:45:27.374194+0000","last_became_active":"2024-09-16T07:45:18.550698+0000","last_became_peered":"2024-09-16T07:45:18.550698+0000","last_unstale":"2024-09-16T07:45:27.374194+0000","last_undegraded":"2024-09-16T07:45:27.374194+0000","last_fullsized":"2024-09-16T07:45:27.374194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.422394+0000","last_change":"2024-09-16T07:45:11.395908+0000","last_active":"2024-09-16T07:45:19.422394+0000","last_peered":"2024-09-16T07:45:19.422394+0000","last_clean":"2024-09-16T07:45:19.422394+0000","last_became_active":"2024-09-16T07:45:09.435810+0000","last_became_peered":"2024-09-16T07:45:09.435810+0000","last_unstale":"2024-09-16T07:45:19.422394+0000","last_undegraded":"2024-09-16T07:45:19.422394+0000","last_fullsized":"2024-09-16T07:45:19.422394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'117","reported_seq":129,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.435400+0000","last_change":"2024-09-16T07:45:18.561282+0000","last_active":"2024-09-16T07:45:27.435400+0000","last_peered":"2024-09-16T07:45:27.435400+0000","last_clean":"2024-09-16T07:45:27.435400+0000","last_became_active":"2024-09-16T07:45:18.551046+0000","last_became_peered":"2024-09-16T07:45:18.551046+0000","last_unstale":"2024-09-16T07:45:27.435400+0000","last_undegraded":"2024-09-16T07:45:27.435400+0000","last_fullsized":"2024-09-16T07:45:27.435400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:42.438905+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"18'125","reported_seq":137,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.322414+0000","last_change":"2024-09-16T07:45:18.569387+0000","last_active":"2024-09-16T07:45:27.322414+0000","last_peered":"2024-09-16T07:45:27.322414+0000","last_clean":"2024-09-16T07:45:27.322414+0000","last_became_active":"2024-09-16T07:45:18.555943+0000","last_became_peered":"2024-09-16T07:45:18.555943+0000","last_unstale":"2024-09-16T07:45:27.322414+0000","last_undegraded":"2024-09-16T07:45:27.322414+0000","last_fullsized":"2024-09-16T07:45:27.322414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:48.456269+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.424124+0000","last_change":"2024-09-16T07:45:11.401508+0000","last_active":"2024-09-16T07:45:19.424124+0000","last_peered":"2024-09-16T07:45:19.424124+0000","last_clean":"2024-09-16T07:45:19.424124+0000","last_became_active":"2024-09-16T07:45:09.435575+0000","last_became_peered":"2024-09-16T07:45:09.435575+0000","last_unstale":"2024-09-16T07:45:19.424124+0000","last_undegraded":"2024-09-16T07:45:19.424124+0000","last_fullsized":"2024-09-16T07:45:19.424124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'95","reported_seq":107,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.258261+0000","last_change":"2024-09-16T07:45:18.538421+0000","last_active":"2024-09-16T07:45:27.258261+0000","last_peered":"2024-09-16T07:45:27.258261+0000","last_clean":"2024-09-16T07:45:27.258261+0000","last_became_active":"2024-09-16T07:45:18.526458+0000","last_became_peered":"2024-09-16T07:45:18.526458+0000","last_unstale":"2024-09-16T07:45:27.258261+0000","last_undegraded":"2024-09-16T07:45:27.258261+0000","last_fullsized":"2024-09-16T07:45:27.258261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:48.456270+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.430231+0000","last_change":"2024-09-16T07:45:11.399603+0000","last_active":"2024-09-16T07:45:19.430231+0000","last_peered":"2024-09-16T07:45:19.430231+0000","last_clean":"2024-09-16T07:45:19.430231+0000","last_became_active":"2024-09-16T07:45:09.463398+0000","last_became_peered":"2024-09-16T07:45:09.463398+0000","last_unstale":"2024-09-16T07:45:19.430231+0000","last_undegraded":"2024-09-16T07:45:19.430231+0000","last_fullsized":"2024-09-16T07:45:19.430231+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":53542912,"num_objects":817,"num_object_clones":0,"num_object_copies":2451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":817,"num_write_kb":52288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10694656,"data_stored":171114496,"data_compressed":8123580,"data_compressed_allocated":10694656,"data_compressed_original":171114496,"omap_allocated":0,"internal_metadata":0},"log_size":817,"ondisk_log_size":817,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36748,"kb_used_data":5756,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335092,"statfs":{"total":96636764160,"available":96599134208,"internally_reserved":0,"allocated":5894144,"data_stored":91533399,"data_compressed":4345415,"data_compressed_allocated":5722112,"data_compressed_original":91471872,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36040,"kb_used_data":5048,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335800,"statfs":{"total":96636764160,"available":96599859200,"internally_reserved":0,"allocated":5169152,"data_stored":80260682,"data_compressed":3808206,"data_compressed_allocated":5013504,"data_compressed_original":80216064,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5013504,"data_stored":80216064,"data_compressed":3808206,"data_compressed_allocated":5013504,"data_compressed_original":80216064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5681152,"data_stored":90898432,"data_compressed":4315374,"data_compressed_allocated":5681152,"data_compressed_original":90898432,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:54.496 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 35 16 2313 2297 4.10132 12.875 0.0530873 0.243523 2024-09-16T07:45:55.496 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 36 16 2519 2503 4.345 12.875 0.0721157 0.22987 2024-09-16T07:45:55.949 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:56.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:56.104+0000 7f7073991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:56.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:56.115+0000 7f7073991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:56.496 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 37 16 2721 2705 4.56875 12.625 0.098429 0.218663 2024-09-16T07:45:56.701 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:56.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:56.869+0000 7fb886711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:56.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:56.884+0000 7fb886711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:57.224 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:57.225 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:45:57.246 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-09-16T07:45:56.296300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":54133299,"num_objects":821,"num_object_clones":0,"num_object_copies":2463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":898,"num_write_kb":53396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":872,"ondisk_log_size":872,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":126844,"kb_used_data":11180,"kb_used_omap":0,"kb_used_meta":115584,"kb_avail":377360516,"statfs":{"total":386547056640,"available":386417168384,"internally_reserved":0,"allocated":11448320,"data_stored":173042361,"data_compressed":8213703,"data_compressed_allocated":10817536,"data_compressed_original":172834816,"omap_allocated":0,"internal_metadata":118358016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.839048"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"18'105","reported_seq":117,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.082337+0000","last_change":"2024-09-16T07:45:18.598420+0000","last_active":"2024-09-16T07:45:27.082337+0000","last_peered":"2024-09-16T07:45:27.082337+0000","last_clean":"2024-09-16T07:45:27.082337+0000","last_became_active":"2024-09-16T07:45:18.586576+0000","last_became_peered":"2024-09-16T07:45:18.586576+0000","last_unstale":"2024-09-16T07:45:27.082337+0000","last_undegraded":"2024-09-16T07:45:27.082337+0000","last_fullsized":"2024-09-16T07:45:27.082337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"18'86","reported_seq":98,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.447983+0000","last_change":"2024-09-16T07:45:18.557648+0000","last_active":"2024-09-16T07:45:27.447983+0000","last_peered":"2024-09-16T07:45:27.447983+0000","last_clean":"2024-09-16T07:45:27.447983+0000","last_became_active":"2024-09-16T07:45:18.543769+0000","last_became_peered":"2024-09-16T07:45:18.543769+0000","last_unstale":"2024-09-16T07:45:27.447983+0000","last_undegraded":"2024-09-16T07:45:27.447983+0000","last_fullsized":"2024-09-16T07:45:27.447983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"18'90","reported_seq":102,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.312577+0000","last_change":"2024-09-16T07:45:18.546066+0000","last_active":"2024-09-16T07:45:27.312577+0000","last_peered":"2024-09-16T07:45:27.312577+0000","last_clean":"2024-09-16T07:45:27.312577+0000","last_became_active":"2024-09-16T07:45:18.530524+0000","last_became_peered":"2024-09-16T07:45:18.530524+0000","last_unstale":"2024-09-16T07:45:27.312577+0000","last_undegraded":"2024-09-16T07:45:27.312577+0000","last_fullsized":"2024-09-16T07:45:27.312577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.418982+0000","last_change":"2024-09-16T07:45:07.405679+0000","last_active":"2024-09-16T07:45:19.418982+0000","last_peered":"2024-09-16T07:45:19.418982+0000","last_clean":"2024-09-16T07:45:19.418982+0000","last_became_active":"2024-09-16T07:45:07.398279+0000","last_became_peered":"2024-09-16T07:45:07.398279+0000","last_unstale":"2024-09-16T07:45:19.418982+0000","last_undegraded":"2024-09-16T07:45:19.418982+0000","last_fullsized":"2024-09-16T07:45:19.418982+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.433249+0000","last_change":"2024-09-16T07:45:11.400212+0000","last_active":"2024-09-16T07:45:19.433249+0000","last_peered":"2024-09-16T07:45:19.433249+0000","last_clean":"2024-09-16T07:45:19.433249+0000","last_became_active":"2024-09-16T07:45:09.452060+0000","last_became_peered":"2024-09-16T07:45:09.452060+0000","last_unstale":"2024-09-16T07:45:19.433249+0000","last_undegraded":"2024-09-16T07:45:19.433249+0000","last_fullsized":"2024-09-16T07:45:19.433249+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'98","reported_seq":110,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.158441+0000","last_change":"2024-09-16T07:45:18.576020+0000","last_active":"2024-09-16T07:45:27.158441+0000","last_peered":"2024-09-16T07:45:27.158441+0000","last_clean":"2024-09-16T07:45:27.158441+0000","last_became_active":"2024-09-16T07:45:18.566642+0000","last_became_peered":"2024-09-16T07:45:18.566642+0000","last_unstale":"2024-09-16T07:45:27.158441+0000","last_undegraded":"2024-09-16T07:45:27.158441+0000","last_fullsized":"2024-09-16T07:45:27.158441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:42.438903+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'101","reported_seq":113,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.374194+0000","last_change":"2024-09-16T07:45:18.565470+0000","last_active":"2024-09-16T07:45:27.374194+0000","last_peered":"2024-09-16T07:45:27.374194+0000","last_clean":"2024-09-16T07:45:27.374194+0000","last_became_active":"2024-09-16T07:45:18.550698+0000","last_became_peered":"2024-09-16T07:45:18.550698+0000","last_unstale":"2024-09-16T07:45:27.374194+0000","last_undegraded":"2024-09-16T07:45:27.374194+0000","last_fullsized":"2024-09-16T07:45:27.374194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.422394+0000","last_change":"2024-09-16T07:45:11.395908+0000","last_active":"2024-09-16T07:45:19.422394+0000","last_peered":"2024-09-16T07:45:19.422394+0000","last_clean":"2024-09-16T07:45:19.422394+0000","last_became_active":"2024-09-16T07:45:09.435810+0000","last_became_peered":"2024-09-16T07:45:09.435810+0000","last_unstale":"2024-09-16T07:45:19.422394+0000","last_undegraded":"2024-09-16T07:45:19.422394+0000","last_fullsized":"2024-09-16T07:45:19.422394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'117","reported_seq":129,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.435400+0000","last_change":"2024-09-16T07:45:18.561282+0000","last_active":"2024-09-16T07:45:27.435400+0000","last_peered":"2024-09-16T07:45:27.435400+0000","last_clean":"2024-09-16T07:45:27.435400+0000","last_became_active":"2024-09-16T07:45:18.551046+0000","last_became_peered":"2024-09-16T07:45:18.551046+0000","last_unstale":"2024-09-16T07:45:27.435400+0000","last_undegraded":"2024-09-16T07:45:27.435400+0000","last_fullsized":"2024-09-16T07:45:27.435400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:42.438905+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"18'125","reported_seq":137,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.322414+0000","last_change":"2024-09-16T07:45:18.569387+0000","last_active":"2024-09-16T07:45:27.322414+0000","last_peered":"2024-09-16T07:45:27.322414+0000","last_clean":"2024-09-16T07:45:27.322414+0000","last_became_active":"2024-09-16T07:45:18.555943+0000","last_became_peered":"2024-09-16T07:45:18.555943+0000","last_unstale":"2024-09-16T07:45:27.322414+0000","last_undegraded":"2024-09-16T07:45:27.322414+0000","last_fullsized":"2024-09-16T07:45:27.322414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:48.456269+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.424124+0000","last_change":"2024-09-16T07:45:11.401508+0000","last_active":"2024-09-16T07:45:19.424124+0000","last_peered":"2024-09-16T07:45:19.424124+0000","last_clean":"2024-09-16T07:45:19.424124+0000","last_became_active":"2024-09-16T07:45:09.435575+0000","last_became_peered":"2024-09-16T07:45:09.435575+0000","last_unstale":"2024-09-16T07:45:19.424124+0000","last_undegraded":"2024-09-16T07:45:19.424124+0000","last_fullsized":"2024-09-16T07:45:19.424124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'95","reported_seq":107,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.258261+0000","last_change":"2024-09-16T07:45:18.538421+0000","last_active":"2024-09-16T07:45:27.258261+0000","last_peered":"2024-09-16T07:45:27.258261+0000","last_clean":"2024-09-16T07:45:27.258261+0000","last_became_active":"2024-09-16T07:45:18.526458+0000","last_became_peered":"2024-09-16T07:45:18.526458+0000","last_unstale":"2024-09-16T07:45:27.258261+0000","last_undegraded":"2024-09-16T07:45:27.258261+0000","last_fullsized":"2024-09-16T07:45:27.258261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:48.456270+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.430231+0000","last_change":"2024-09-16T07:45:11.399603+0000","last_active":"2024-09-16T07:45:19.430231+0000","last_peered":"2024-09-16T07:45:19.430231+0000","last_clean":"2024-09-16T07:45:19.430231+0000","last_became_active":"2024-09-16T07:45:09.463398+0000","last_became_peered":"2024-09-16T07:45:09.463398+0000","last_unstale":"2024-09-16T07:45:19.430231+0000","last_undegraded":"2024-09-16T07:45:19.430231+0000","last_fullsized":"2024-09-16T07:45:19.430231+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":53542912,"num_objects":817,"num_object_clones":0,"num_object_copies":2451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":817,"num_write_kb":52288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10694656,"data_stored":171114496,"data_compressed":8123580,"data_compressed_allocated":10694656,"data_compressed_original":171114496,"omap_allocated":0,"internal_metadata":0},"log_size":817,"ondisk_log_size":817,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36748,"kb_used_data":5756,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335092,"statfs":{"total":96636764160,"available":96599134208,"internally_reserved":0,"allocated":5894144,"data_stored":91533399,"data_compressed":4345415,"data_compressed_allocated":5722112,"data_compressed_original":91471872,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36040,"kb_used_data":5048,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335800,"statfs":{"total":96636764160,"available":96599859200,"internally_reserved":0,"allocated":5169152,"data_stored":80260682,"data_compressed":3808206,"data_compressed_allocated":5013504,"data_compressed_original":80216064,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5013504,"data_stored":80216064,"data_compressed":3808206,"data_compressed_allocated":5013504,"data_compressed_original":80216064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5681152,"data_stored":90898432,"data_compressed":4315374,"data_compressed_allocated":5681152,"data_compressed_original":90898432,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:57.248 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:45:57.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:57.393+0000 7f327487f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:57.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:57.406+0000 7f327487f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:57.496 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 38 16 2917 2901 4.77085 12.25 0.0763322 0.209298 2024-09-16T07:45:57.858 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:57.858 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":59,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":25,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472749,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":13},{"state_name":"unknown","count":8},{"state_name":"stale+active+clean","count":4}],"num_pgs":25,"num_pools":3,"num_objects":821,"data_bytes":54133299,"bytes_used":129888256,"bytes_avail":386417168384,"bytes_total":386547056640,"unknown_pgs_ratio":0.31999999284744263},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-16T07:44:57.936809+0000","services":{}},"progress_events":{}} 2024-09-16T07:45:57.876 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:45:57.876 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:58.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:58.024+0000 7fee76d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:58.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:58.037+0000 7fee76d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:58.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:45:58.340 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:45:58.360 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-16T07:45:58.296679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":54133299,"num_objects":821,"num_object_clones":0,"num_object_copies":2463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":898,"num_write_kb":53396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":872,"ondisk_log_size":872,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":126844,"kb_used_data":11180,"kb_used_omap":0,"kb_used_meta":115584,"kb_avail":377360516,"statfs":{"total":386547056640,"available":386417168384,"internally_reserved":0,"allocated":11448320,"data_stored":173042361,"data_compressed":8213703,"data_compressed_allocated":10817536,"data_compressed_original":172834816,"omap_allocated":0,"internal_metadata":118358016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001756"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"18'105","reported_seq":117,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.082337+0000","last_change":"2024-09-16T07:45:18.598420+0000","last_active":"2024-09-16T07:45:27.082337+0000","last_peered":"2024-09-16T07:45:27.082337+0000","last_clean":"2024-09-16T07:45:27.082337+0000","last_became_active":"2024-09-16T07:45:18.586576+0000","last_became_peered":"2024-09-16T07:45:18.586576+0000","last_unstale":"2024-09-16T07:45:27.082337+0000","last_undegraded":"2024-09-16T07:45:27.082337+0000","last_fullsized":"2024-09-16T07:45:27.082337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"18'86","reported_seq":98,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.447983+0000","last_change":"2024-09-16T07:45:18.557648+0000","last_active":"2024-09-16T07:45:27.447983+0000","last_peered":"2024-09-16T07:45:27.447983+0000","last_clean":"2024-09-16T07:45:27.447983+0000","last_became_active":"2024-09-16T07:45:18.543769+0000","last_became_peered":"2024-09-16T07:45:18.543769+0000","last_unstale":"2024-09-16T07:45:27.447983+0000","last_undegraded":"2024-09-16T07:45:27.447983+0000","last_fullsized":"2024-09-16T07:45:27.447983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"18'90","reported_seq":102,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.312577+0000","last_change":"2024-09-16T07:45:18.546066+0000","last_active":"2024-09-16T07:45:27.312577+0000","last_peered":"2024-09-16T07:45:27.312577+0000","last_clean":"2024-09-16T07:45:27.312577+0000","last_became_active":"2024-09-16T07:45:18.530524+0000","last_became_peered":"2024-09-16T07:45:18.530524+0000","last_unstale":"2024-09-16T07:45:27.312577+0000","last_undegraded":"2024-09-16T07:45:27.312577+0000","last_fullsized":"2024-09-16T07:45:27.312577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.418982+0000","last_change":"2024-09-16T07:45:07.405679+0000","last_active":"2024-09-16T07:45:19.418982+0000","last_peered":"2024-09-16T07:45:19.418982+0000","last_clean":"2024-09-16T07:45:19.418982+0000","last_became_active":"2024-09-16T07:45:07.398279+0000","last_became_peered":"2024-09-16T07:45:07.398279+0000","last_unstale":"2024-09-16T07:45:19.418982+0000","last_undegraded":"2024-09-16T07:45:19.418982+0000","last_fullsized":"2024-09-16T07:45:19.418982+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.433249+0000","last_change":"2024-09-16T07:45:11.400212+0000","last_active":"2024-09-16T07:45:19.433249+0000","last_peered":"2024-09-16T07:45:19.433249+0000","last_clean":"2024-09-16T07:45:19.433249+0000","last_became_active":"2024-09-16T07:45:09.452060+0000","last_became_peered":"2024-09-16T07:45:09.452060+0000","last_unstale":"2024-09-16T07:45:19.433249+0000","last_undegraded":"2024-09-16T07:45:19.433249+0000","last_fullsized":"2024-09-16T07:45:19.433249+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'98","reported_seq":110,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.158441+0000","last_change":"2024-09-16T07:45:18.576020+0000","last_active":"2024-09-16T07:45:27.158441+0000","last_peered":"2024-09-16T07:45:27.158441+0000","last_clean":"2024-09-16T07:45:27.158441+0000","last_became_active":"2024-09-16T07:45:18.566642+0000","last_became_peered":"2024-09-16T07:45:18.566642+0000","last_unstale":"2024-09-16T07:45:27.158441+0000","last_undegraded":"2024-09-16T07:45:27.158441+0000","last_fullsized":"2024-09-16T07:45:27.158441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:42.438903+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'101","reported_seq":113,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.374194+0000","last_change":"2024-09-16T07:45:18.565470+0000","last_active":"2024-09-16T07:45:27.374194+0000","last_peered":"2024-09-16T07:45:27.374194+0000","last_clean":"2024-09-16T07:45:27.374194+0000","last_became_active":"2024-09-16T07:45:18.550698+0000","last_became_peered":"2024-09-16T07:45:18.550698+0000","last_unstale":"2024-09-16T07:45:27.374194+0000","last_undegraded":"2024-09-16T07:45:27.374194+0000","last_fullsized":"2024-09-16T07:45:27.374194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.422394+0000","last_change":"2024-09-16T07:45:11.395908+0000","last_active":"2024-09-16T07:45:19.422394+0000","last_peered":"2024-09-16T07:45:19.422394+0000","last_clean":"2024-09-16T07:45:19.422394+0000","last_became_active":"2024-09-16T07:45:09.435810+0000","last_became_peered":"2024-09-16T07:45:09.435810+0000","last_unstale":"2024-09-16T07:45:19.422394+0000","last_undegraded":"2024-09-16T07:45:19.422394+0000","last_fullsized":"2024-09-16T07:45:19.422394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'117","reported_seq":129,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.435400+0000","last_change":"2024-09-16T07:45:18.561282+0000","last_active":"2024-09-16T07:45:27.435400+0000","last_peered":"2024-09-16T07:45:27.435400+0000","last_clean":"2024-09-16T07:45:27.435400+0000","last_became_active":"2024-09-16T07:45:18.551046+0000","last_became_peered":"2024-09-16T07:45:18.551046+0000","last_unstale":"2024-09-16T07:45:27.435400+0000","last_undegraded":"2024-09-16T07:45:27.435400+0000","last_fullsized":"2024-09-16T07:45:27.435400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:42.438905+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"18'125","reported_seq":137,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.322414+0000","last_change":"2024-09-16T07:45:18.569387+0000","last_active":"2024-09-16T07:45:27.322414+0000","last_peered":"2024-09-16T07:45:27.322414+0000","last_clean":"2024-09-16T07:45:27.322414+0000","last_became_active":"2024-09-16T07:45:18.555943+0000","last_became_peered":"2024-09-16T07:45:18.555943+0000","last_unstale":"2024-09-16T07:45:27.322414+0000","last_undegraded":"2024-09-16T07:45:27.322414+0000","last_fullsized":"2024-09-16T07:45:27.322414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:48.456269+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.424124+0000","last_change":"2024-09-16T07:45:11.401508+0000","last_active":"2024-09-16T07:45:19.424124+0000","last_peered":"2024-09-16T07:45:19.424124+0000","last_clean":"2024-09-16T07:45:19.424124+0000","last_became_active":"2024-09-16T07:45:09.435575+0000","last_became_peered":"2024-09-16T07:45:09.435575+0000","last_unstale":"2024-09-16T07:45:19.424124+0000","last_undegraded":"2024-09-16T07:45:19.424124+0000","last_fullsized":"2024-09-16T07:45:19.424124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'95","reported_seq":107,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.258261+0000","last_change":"2024-09-16T07:45:18.538421+0000","last_active":"2024-09-16T07:45:27.258261+0000","last_peered":"2024-09-16T07:45:27.258261+0000","last_clean":"2024-09-16T07:45:27.258261+0000","last_became_active":"2024-09-16T07:45:18.526458+0000","last_became_peered":"2024-09-16T07:45:18.526458+0000","last_unstale":"2024-09-16T07:45:27.258261+0000","last_undegraded":"2024-09-16T07:45:27.258261+0000","last_fullsized":"2024-09-16T07:45:27.258261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:48.456270+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.430231+0000","last_change":"2024-09-16T07:45:11.399603+0000","last_active":"2024-09-16T07:45:19.430231+0000","last_peered":"2024-09-16T07:45:19.430231+0000","last_clean":"2024-09-16T07:45:19.430231+0000","last_became_active":"2024-09-16T07:45:09.463398+0000","last_became_peered":"2024-09-16T07:45:09.463398+0000","last_unstale":"2024-09-16T07:45:19.430231+0000","last_undegraded":"2024-09-16T07:45:19.430231+0000","last_fullsized":"2024-09-16T07:45:19.430231+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":53542912,"num_objects":817,"num_object_clones":0,"num_object_copies":2451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":817,"num_write_kb":52288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10694656,"data_stored":171114496,"data_compressed":8123580,"data_compressed_allocated":10694656,"data_compressed_original":171114496,"omap_allocated":0,"internal_metadata":0},"log_size":817,"ondisk_log_size":817,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36748,"kb_used_data":5756,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335092,"statfs":{"total":96636764160,"available":96599134208,"internally_reserved":0,"allocated":5894144,"data_stored":91533399,"data_compressed":4345415,"data_compressed_allocated":5722112,"data_compressed_original":91471872,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36040,"kb_used_data":5048,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335800,"statfs":{"total":96636764160,"available":96599859200,"internally_reserved":0,"allocated":5169152,"data_stored":80260682,"data_compressed":3808206,"data_compressed_allocated":5013504,"data_compressed_original":80216064,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5013504,"data_stored":80216064,"data_compressed":3808206,"data_compressed_allocated":5013504,"data_compressed_original":80216064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5681152,"data_stored":90898432,"data_compressed":4315374,"data_compressed_allocated":5681152,"data_compressed_original":90898432,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:58.496 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 39 16 3109 3093 4.95618 12 0.115815 0.201496 2024-09-16T07:45:58.736 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:58.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:58.890+0000 7f8ebab48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:58.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:45:58.902+0000 7f8ebab48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:59.496 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:45:59.498225+0000 min lat: 0.0163118 max lat: 23.4475 avg lat: 0.194561 2024-09-16T07:45:59.496 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:45:59.497 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 40 16 3302 3286 5.13381 12.0625 0.127114 0.194561 2024-09-16T07:46:00.496 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 41 16 3506 3490 5.31954 12.75 0.0835768 0.187779 2024-09-16T07:46:01.362 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:01.452 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:01.496 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 42 16 3705 3689 5.48898 12.4375 0.119581 0.181982 2024-09-16T07:46:01.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:01.527+0000 7fd1ba991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:01.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:01.548+0000 7fd1ba991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:01.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:01.620+0000 7fc5c8d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:01.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:01.632+0000 7fc5c8d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:01.829 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:01.829 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:01.848 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-09-16T07:46:00.297090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":54133299,"num_objects":821,"num_object_clones":0,"num_object_copies":2463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":898,"num_write_kb":53396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":872,"ondisk_log_size":872,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":126844,"kb_used_data":11180,"kb_used_omap":0,"kb_used_meta":115584,"kb_avail":377360516,"statfs":{"total":386547056640,"available":386417168384,"internally_reserved":0,"allocated":11448320,"data_stored":173042361,"data_compressed":8213703,"data_compressed_allocated":10817536,"data_compressed_original":172834816,"omap_allocated":0,"internal_metadata":118358016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.829861"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"18'105","reported_seq":117,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.082337+0000","last_change":"2024-09-16T07:45:18.598420+0000","last_active":"2024-09-16T07:45:27.082337+0000","last_peered":"2024-09-16T07:45:27.082337+0000","last_clean":"2024-09-16T07:45:27.082337+0000","last_became_active":"2024-09-16T07:45:18.586576+0000","last_became_peered":"2024-09-16T07:45:18.586576+0000","last_unstale":"2024-09-16T07:45:27.082337+0000","last_undegraded":"2024-09-16T07:45:27.082337+0000","last_fullsized":"2024-09-16T07:45:27.082337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"18'86","reported_seq":98,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.447983+0000","last_change":"2024-09-16T07:45:18.557648+0000","last_active":"2024-09-16T07:45:27.447983+0000","last_peered":"2024-09-16T07:45:27.447983+0000","last_clean":"2024-09-16T07:45:27.447983+0000","last_became_active":"2024-09-16T07:45:18.543769+0000","last_became_peered":"2024-09-16T07:45:18.543769+0000","last_unstale":"2024-09-16T07:45:27.447983+0000","last_undegraded":"2024-09-16T07:45:27.447983+0000","last_fullsized":"2024-09-16T07:45:27.447983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"18'90","reported_seq":102,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.312577+0000","last_change":"2024-09-16T07:45:18.546066+0000","last_active":"2024-09-16T07:45:27.312577+0000","last_peered":"2024-09-16T07:45:27.312577+0000","last_clean":"2024-09-16T07:45:27.312577+0000","last_became_active":"2024-09-16T07:45:18.530524+0000","last_became_peered":"2024-09-16T07:45:18.530524+0000","last_unstale":"2024-09-16T07:45:27.312577+0000","last_undegraded":"2024-09-16T07:45:27.312577+0000","last_fullsized":"2024-09-16T07:45:27.312577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.418982+0000","last_change":"2024-09-16T07:45:07.405679+0000","last_active":"2024-09-16T07:45:19.418982+0000","last_peered":"2024-09-16T07:45:19.418982+0000","last_clean":"2024-09-16T07:45:19.418982+0000","last_became_active":"2024-09-16T07:45:07.398279+0000","last_became_peered":"2024-09-16T07:45:07.398279+0000","last_unstale":"2024-09-16T07:45:19.418982+0000","last_undegraded":"2024-09-16T07:45:19.418982+0000","last_fullsized":"2024-09-16T07:45:19.418982+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.433249+0000","last_change":"2024-09-16T07:45:11.400212+0000","last_active":"2024-09-16T07:45:19.433249+0000","last_peered":"2024-09-16T07:45:19.433249+0000","last_clean":"2024-09-16T07:45:19.433249+0000","last_became_active":"2024-09-16T07:45:09.452060+0000","last_became_peered":"2024-09-16T07:45:09.452060+0000","last_unstale":"2024-09-16T07:45:19.433249+0000","last_undegraded":"2024-09-16T07:45:19.433249+0000","last_fullsized":"2024-09-16T07:45:19.433249+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'98","reported_seq":110,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.158441+0000","last_change":"2024-09-16T07:45:18.576020+0000","last_active":"2024-09-16T07:45:27.158441+0000","last_peered":"2024-09-16T07:45:27.158441+0000","last_clean":"2024-09-16T07:45:27.158441+0000","last_became_active":"2024-09-16T07:45:18.566642+0000","last_became_peered":"2024-09-16T07:45:18.566642+0000","last_unstale":"2024-09-16T07:45:27.158441+0000","last_undegraded":"2024-09-16T07:45:27.158441+0000","last_fullsized":"2024-09-16T07:45:27.158441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:42.438903+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'101","reported_seq":113,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.374194+0000","last_change":"2024-09-16T07:45:18.565470+0000","last_active":"2024-09-16T07:45:27.374194+0000","last_peered":"2024-09-16T07:45:27.374194+0000","last_clean":"2024-09-16T07:45:27.374194+0000","last_became_active":"2024-09-16T07:45:18.550698+0000","last_became_peered":"2024-09-16T07:45:18.550698+0000","last_unstale":"2024-09-16T07:45:27.374194+0000","last_undegraded":"2024-09-16T07:45:27.374194+0000","last_fullsized":"2024-09-16T07:45:27.374194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.422394+0000","last_change":"2024-09-16T07:45:11.395908+0000","last_active":"2024-09-16T07:45:19.422394+0000","last_peered":"2024-09-16T07:45:19.422394+0000","last_clean":"2024-09-16T07:45:19.422394+0000","last_became_active":"2024-09-16T07:45:09.435810+0000","last_became_peered":"2024-09-16T07:45:09.435810+0000","last_unstale":"2024-09-16T07:45:19.422394+0000","last_undegraded":"2024-09-16T07:45:19.422394+0000","last_fullsized":"2024-09-16T07:45:19.422394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'117","reported_seq":129,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.435400+0000","last_change":"2024-09-16T07:45:18.561282+0000","last_active":"2024-09-16T07:45:27.435400+0000","last_peered":"2024-09-16T07:45:27.435400+0000","last_clean":"2024-09-16T07:45:27.435400+0000","last_became_active":"2024-09-16T07:45:18.551046+0000","last_became_peered":"2024-09-16T07:45:18.551046+0000","last_unstale":"2024-09-16T07:45:27.435400+0000","last_undegraded":"2024-09-16T07:45:27.435400+0000","last_fullsized":"2024-09-16T07:45:27.435400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:42.438905+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"18'125","reported_seq":137,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.322414+0000","last_change":"2024-09-16T07:45:18.569387+0000","last_active":"2024-09-16T07:45:27.322414+0000","last_peered":"2024-09-16T07:45:27.322414+0000","last_clean":"2024-09-16T07:45:27.322414+0000","last_became_active":"2024-09-16T07:45:18.555943+0000","last_became_peered":"2024-09-16T07:45:18.555943+0000","last_unstale":"2024-09-16T07:45:27.322414+0000","last_undegraded":"2024-09-16T07:45:27.322414+0000","last_fullsized":"2024-09-16T07:45:27.322414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:48.456269+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.424124+0000","last_change":"2024-09-16T07:45:11.401508+0000","last_active":"2024-09-16T07:45:19.424124+0000","last_peered":"2024-09-16T07:45:19.424124+0000","last_clean":"2024-09-16T07:45:19.424124+0000","last_became_active":"2024-09-16T07:45:09.435575+0000","last_became_peered":"2024-09-16T07:45:09.435575+0000","last_unstale":"2024-09-16T07:45:19.424124+0000","last_undegraded":"2024-09-16T07:45:19.424124+0000","last_fullsized":"2024-09-16T07:45:19.424124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'95","reported_seq":107,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.258261+0000","last_change":"2024-09-16T07:45:18.538421+0000","last_active":"2024-09-16T07:45:27.258261+0000","last_peered":"2024-09-16T07:45:27.258261+0000","last_clean":"2024-09-16T07:45:27.258261+0000","last_became_active":"2024-09-16T07:45:18.526458+0000","last_became_peered":"2024-09-16T07:45:18.526458+0000","last_unstale":"2024-09-16T07:45:27.258261+0000","last_undegraded":"2024-09-16T07:45:27.258261+0000","last_fullsized":"2024-09-16T07:45:27.258261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:48.456270+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.430231+0000","last_change":"2024-09-16T07:45:11.399603+0000","last_active":"2024-09-16T07:45:19.430231+0000","last_peered":"2024-09-16T07:45:19.430231+0000","last_clean":"2024-09-16T07:45:19.430231+0000","last_became_active":"2024-09-16T07:45:09.463398+0000","last_became_peered":"2024-09-16T07:45:09.463398+0000","last_unstale":"2024-09-16T07:45:19.430231+0000","last_undegraded":"2024-09-16T07:45:19.430231+0000","last_fullsized":"2024-09-16T07:45:19.430231+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":53542912,"num_objects":817,"num_object_clones":0,"num_object_copies":2451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":817,"num_write_kb":52288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10694656,"data_stored":171114496,"data_compressed":8123580,"data_compressed_allocated":10694656,"data_compressed_original":171114496,"omap_allocated":0,"internal_metadata":0},"log_size":817,"ondisk_log_size":817,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36748,"kb_used_data":5756,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335092,"statfs":{"total":96636764160,"available":96599134208,"internally_reserved":0,"allocated":5894144,"data_stored":91533399,"data_compressed":4345415,"data_compressed_allocated":5722112,"data_compressed_original":91471872,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36040,"kb_used_data":5048,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335800,"statfs":{"total":96636764160,"available":96599859200,"internally_reserved":0,"allocated":5169152,"data_stored":80260682,"data_compressed":3808206,"data_compressed_allocated":5013504,"data_compressed_original":80216064,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5013504,"data_stored":80216064,"data_compressed":3808206,"data_compressed_allocated":5013504,"data_compressed_original":80216064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5681152,"data_stored":90898432,"data_compressed":4315374,"data_compressed_allocated":5681152,"data_compressed_original":90898432,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:01.849 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:46:02.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:02.063+0000 7f7f36063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:02.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:02.078+0000 7f7f36063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:02.496 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 43 16 3910 3894 5.65927 12.8125 0.0372109 0.176507 2024-09-16T07:46:02.576 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:02.576 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":64,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":25,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472749,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":13},{"state_name":"unknown","count":8},{"state_name":"stale+active+clean","count":4}],"num_pgs":25,"num_pools":3,"num_objects":821,"data_bytes":54133299,"bytes_used":129888256,"bytes_avail":386417168384,"bytes_total":386547056640,"unknown_pgs_ratio":0.31999999284744263},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-16T07:44:57.936809+0000","services":{}},"progress_events":{}} 2024-09-16T07:46:02.601 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:46:02.601 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:02.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:02.758+0000 7f6904d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:02.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:02.773+0000 7f6904d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:03.094 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:03.111 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-09-16T07:46:02.297514+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":54133299,"num_objects":821,"num_object_clones":0,"num_object_copies":2463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":898,"num_write_kb":53396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":872,"ondisk_log_size":872,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":126844,"kb_used_data":11180,"kb_used_omap":0,"kb_used_meta":115584,"kb_avail":377360516,"statfs":{"total":386547056640,"available":386417168384,"internally_reserved":0,"allocated":11448320,"data_stored":173042361,"data_compressed":8213703,"data_compressed_allocated":10817536,"data_compressed_original":172834816,"omap_allocated":0,"internal_metadata":118358016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.831254"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"18'105","reported_seq":117,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.082337+0000","last_change":"2024-09-16T07:45:18.598420+0000","last_active":"2024-09-16T07:45:27.082337+0000","last_peered":"2024-09-16T07:45:27.082337+0000","last_clean":"2024-09-16T07:45:27.082337+0000","last_became_active":"2024-09-16T07:45:18.586576+0000","last_became_peered":"2024-09-16T07:45:18.586576+0000","last_unstale":"2024-09-16T07:45:27.082337+0000","last_undegraded":"2024-09-16T07:45:27.082337+0000","last_fullsized":"2024-09-16T07:45:27.082337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"18'86","reported_seq":98,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.447983+0000","last_change":"2024-09-16T07:45:18.557648+0000","last_active":"2024-09-16T07:45:27.447983+0000","last_peered":"2024-09-16T07:45:27.447983+0000","last_clean":"2024-09-16T07:45:27.447983+0000","last_became_active":"2024-09-16T07:45:18.543769+0000","last_became_peered":"2024-09-16T07:45:18.543769+0000","last_unstale":"2024-09-16T07:45:27.447983+0000","last_undegraded":"2024-09-16T07:45:27.447983+0000","last_fullsized":"2024-09-16T07:45:27.447983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"18'90","reported_seq":102,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.312577+0000","last_change":"2024-09-16T07:45:18.546066+0000","last_active":"2024-09-16T07:45:27.312577+0000","last_peered":"2024-09-16T07:45:27.312577+0000","last_clean":"2024-09-16T07:45:27.312577+0000","last_became_active":"2024-09-16T07:45:18.530524+0000","last_became_peered":"2024-09-16T07:45:18.530524+0000","last_unstale":"2024-09-16T07:45:27.312577+0000","last_undegraded":"2024-09-16T07:45:27.312577+0000","last_fullsized":"2024-09-16T07:45:27.312577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.418982+0000","last_change":"2024-09-16T07:45:07.405679+0000","last_active":"2024-09-16T07:45:19.418982+0000","last_peered":"2024-09-16T07:45:19.418982+0000","last_clean":"2024-09-16T07:45:19.418982+0000","last_became_active":"2024-09-16T07:45:07.398279+0000","last_became_peered":"2024-09-16T07:45:07.398279+0000","last_unstale":"2024-09-16T07:45:19.418982+0000","last_undegraded":"2024-09-16T07:45:19.418982+0000","last_fullsized":"2024-09-16T07:45:19.418982+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.433249+0000","last_change":"2024-09-16T07:45:11.400212+0000","last_active":"2024-09-16T07:45:19.433249+0000","last_peered":"2024-09-16T07:45:19.433249+0000","last_clean":"2024-09-16T07:45:19.433249+0000","last_became_active":"2024-09-16T07:45:09.452060+0000","last_became_peered":"2024-09-16T07:45:09.452060+0000","last_unstale":"2024-09-16T07:45:19.433249+0000","last_undegraded":"2024-09-16T07:45:19.433249+0000","last_fullsized":"2024-09-16T07:45:19.433249+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'98","reported_seq":110,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.158441+0000","last_change":"2024-09-16T07:45:18.576020+0000","last_active":"2024-09-16T07:45:27.158441+0000","last_peered":"2024-09-16T07:45:27.158441+0000","last_clean":"2024-09-16T07:45:27.158441+0000","last_became_active":"2024-09-16T07:45:18.566642+0000","last_became_peered":"2024-09-16T07:45:18.566642+0000","last_unstale":"2024-09-16T07:45:27.158441+0000","last_undegraded":"2024-09-16T07:45:27.158441+0000","last_fullsized":"2024-09-16T07:45:27.158441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:42.438903+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'101","reported_seq":113,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.374194+0000","last_change":"2024-09-16T07:45:18.565470+0000","last_active":"2024-09-16T07:45:27.374194+0000","last_peered":"2024-09-16T07:45:27.374194+0000","last_clean":"2024-09-16T07:45:27.374194+0000","last_became_active":"2024-09-16T07:45:18.550698+0000","last_became_peered":"2024-09-16T07:45:18.550698+0000","last_unstale":"2024-09-16T07:45:27.374194+0000","last_undegraded":"2024-09-16T07:45:27.374194+0000","last_fullsized":"2024-09-16T07:45:27.374194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.422394+0000","last_change":"2024-09-16T07:45:11.395908+0000","last_active":"2024-09-16T07:45:19.422394+0000","last_peered":"2024-09-16T07:45:19.422394+0000","last_clean":"2024-09-16T07:45:19.422394+0000","last_became_active":"2024-09-16T07:45:09.435810+0000","last_became_peered":"2024-09-16T07:45:09.435810+0000","last_unstale":"2024-09-16T07:45:19.422394+0000","last_undegraded":"2024-09-16T07:45:19.422394+0000","last_fullsized":"2024-09-16T07:45:19.422394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'117","reported_seq":129,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.435400+0000","last_change":"2024-09-16T07:45:18.561282+0000","last_active":"2024-09-16T07:45:27.435400+0000","last_peered":"2024-09-16T07:45:27.435400+0000","last_clean":"2024-09-16T07:45:27.435400+0000","last_became_active":"2024-09-16T07:45:18.551046+0000","last_became_peered":"2024-09-16T07:45:18.551046+0000","last_unstale":"2024-09-16T07:45:27.435400+0000","last_undegraded":"2024-09-16T07:45:27.435400+0000","last_fullsized":"2024-09-16T07:45:27.435400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:42.438905+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"18'125","reported_seq":137,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.322414+0000","last_change":"2024-09-16T07:45:18.569387+0000","last_active":"2024-09-16T07:45:27.322414+0000","last_peered":"2024-09-16T07:45:27.322414+0000","last_clean":"2024-09-16T07:45:27.322414+0000","last_became_active":"2024-09-16T07:45:18.555943+0000","last_became_peered":"2024-09-16T07:45:18.555943+0000","last_unstale":"2024-09-16T07:45:27.322414+0000","last_undegraded":"2024-09-16T07:45:27.322414+0000","last_fullsized":"2024-09-16T07:45:27.322414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":8000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:48.456269+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.424124+0000","last_change":"2024-09-16T07:45:11.401508+0000","last_active":"2024-09-16T07:45:19.424124+0000","last_peered":"2024-09-16T07:45:19.424124+0000","last_clean":"2024-09-16T07:45:19.424124+0000","last_became_active":"2024-09-16T07:45:09.435575+0000","last_became_peered":"2024-09-16T07:45:09.435575+0000","last_unstale":"2024-09-16T07:45:19.424124+0000","last_undegraded":"2024-09-16T07:45:19.424124+0000","last_fullsized":"2024-09-16T07:45:19.424124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'95","reported_seq":107,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:27.258261+0000","last_change":"2024-09-16T07:45:18.538421+0000","last_active":"2024-09-16T07:45:27.258261+0000","last_peered":"2024-09-16T07:45:27.258261+0000","last_clean":"2024-09-16T07:45:27.258261+0000","last_became_active":"2024-09-16T07:45:18.526458+0000","last_became_peered":"2024-09-16T07:45:18.526458+0000","last_unstale":"2024-09-16T07:45:27.258261+0000","last_undegraded":"2024-09-16T07:45:27.258261+0000","last_fullsized":"2024-09-16T07:45:27.258261+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:48.456270+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T07:45:19.430231+0000","last_change":"2024-09-16T07:45:11.399603+0000","last_active":"2024-09-16T07:45:19.430231+0000","last_peered":"2024-09-16T07:45:19.430231+0000","last_clean":"2024-09-16T07:45:19.430231+0000","last_became_active":"2024-09-16T07:45:09.463398+0000","last_became_peered":"2024-09-16T07:45:09.463398+0000","last_unstale":"2024-09-16T07:45:19.430231+0000","last_undegraded":"2024-09-16T07:45:19.430231+0000","last_fullsized":"2024-09-16T07:45:19.430231+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":53542912,"num_objects":817,"num_object_clones":0,"num_object_copies":2451,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":817,"num_write_kb":52288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10694656,"data_stored":171114496,"data_compressed":8123580,"data_compressed_allocated":10694656,"data_compressed_original":171114496,"omap_allocated":0,"internal_metadata":0},"log_size":817,"ondisk_log_size":817,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36748,"kb_used_data":5756,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335092,"statfs":{"total":96636764160,"available":96599134208,"internally_reserved":0,"allocated":5894144,"data_stored":91533399,"data_compressed":4345415,"data_compressed_allocated":5722112,"data_compressed_original":91471872,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36040,"kb_used_data":5048,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335800,"statfs":{"total":96636764160,"available":96599859200,"internally_reserved":0,"allocated":5169152,"data_stored":80260682,"data_compressed":3808206,"data_compressed_allocated":5013504,"data_compressed_original":80216064,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5013504,"data_stored":80216064,"data_compressed":3808206,"data_compressed_allocated":5013504,"data_compressed_original":80216064,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5681152,"data_stored":90898432,"data_compressed":4315374,"data_compressed_allocated":5681152,"data_compressed_original":90898432,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:03.497 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 44 16 4107 4091 5.81045 12.3125 0.0850753 0.171862 2024-09-16T07:46:04.247 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:04.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:04.403+0000 7fe1ab857640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:04.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:04.411+0000 7fe1ab857640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:04.497 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 45 16 4308 4292 5.96047 12.5625 0.0807131 0.16765 2024-09-16T07:46:05.497 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 46 16 4500 4484 6.09173 12 0.0584602 0.16406 2024-09-16T07:46:06.114 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:06.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:06.263+0000 7f3749351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:06.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:06.276+0000 7f3749351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:06.497 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 47 16 4700 4684 6.22805 12.5 0.0499865 0.160378 2024-09-16T07:46:06.558 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:06.559 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:06.578 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-09-16T07:46:06.298214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":149488179,"num_objects":2276,"num_object_clones":0,"num_object_copies":6828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2353,"num_write_kb":146516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":393216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2327,"ondisk_log_size":2327,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":161136,"kb_used_data":28832,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377326224,"statfs":{"total":386547056640,"available":386382053376,"internally_reserved":0,"allocated":29523968,"data_stored":460467947,"data_compressed":21859823,"data_compressed_allocated":28778496,"data_compressed_original":460210176,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":95354880,"num_objects":1455,"num_object_clones":0,"num_object_copies":4365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1455,"num_write_kb":93120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":393216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002343"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"25'267","reported_seq":301,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.074118+0000","last_change":"2024-09-16T07:45:44.531824+0000","last_active":"2024-09-16T07:46:05.074118+0000","last_peered":"2024-09-16T07:46:05.074118+0000","last_clean":"2024-09-16T07:46:05.074118+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:05.074118+0000","last_undegraded":"2024-09-16T07:46:05.074118+0000","last_fullsized":"2024-09-16T07:46:05.074118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":17088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"25'270","reported_seq":307,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.286482+0000","last_change":"2024-09-16T07:45:50.886832+0000","last_active":"2024-09-16T07:46:05.286482+0000","last_peered":"2024-09-16T07:46:05.286482+0000","last_clean":"2024-09-16T07:46:05.286482+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:05.286482+0000","last_undegraded":"2024-09-16T07:46:05.286482+0000","last_fullsized":"2024-09-16T07:46:05.286482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"25'269","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.007863+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:05.007863+0000","last_peered":"2024-09-16T07:46:05.007863+0000","last_clean":"2024-09-16T07:46:05.007863+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:05.007863+0000","last_undegraded":"2024-09-16T07:46:05.007863+0000","last_fullsized":"2024-09-16T07:46:05.007863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.483345+0000","last_change":"2024-09-16T07:45:50.567248+0000","last_active":"2024-09-16T07:45:51.483345+0000","last_peered":"2024-09-16T07:45:51.483345+0000","last_clean":"2024-09-16T07:45:51.483345+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:45:51.483345+0000","last_undegraded":"2024-09-16T07:45:51.483345+0000","last_fullsized":"2024-09-16T07:45:51.483345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.497787+0000","last_change":"2024-09-16T07:45:51.505238+0000","last_active":"2024-09-16T07:45:51.497787+0000","last_peered":"2024-09-16T07:45:51.497787+0000","last_clean":"2024-09-16T07:45:51.497787+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:45:51.497787+0000","last_undegraded":"2024-09-16T07:45:51.497787+0000","last_fullsized":"2024-09-16T07:45:51.497787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'288","reported_seq":322,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.270154+0000","last_change":"2024-09-16T07:45:44.522728+0000","last_active":"2024-09-16T07:46:05.270154+0000","last_peered":"2024-09-16T07:46:05.270154+0000","last_clean":"2024-09-16T07:46:05.270154+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:05.270154+0000","last_undegraded":"2024-09-16T07:46:05.270154+0000","last_fullsized":"2024-09-16T07:46:05.270154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:42.438903+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'283","reported_seq":317,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.098297+0000","last_change":"2024-09-16T07:45:44.540876+0000","last_active":"2024-09-16T07:46:05.098297+0000","last_peered":"2024-09-16T07:46:05.098297+0000","last_clean":"2024-09-16T07:46:05.098297+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:05.098297+0000","last_undegraded":"2024-09-16T07:46:05.098297+0000","last_fullsized":"2024-09-16T07:46:05.098297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.491482+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:45:51.491482+0000","last_peered":"2024-09-16T07:45:51.491482+0000","last_clean":"2024-09-16T07:45:51.491482+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:45:51.491482+0000","last_undegraded":"2024-09-16T07:45:51.491482+0000","last_fullsized":"2024-09-16T07:45:51.491482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'280","reported_seq":321,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.004625+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:05.004625+0000","last_peered":"2024-09-16T07:46:05.004625+0000","last_clean":"2024-09-16T07:46:05.004625+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:05.004625+0000","last_undegraded":"2024-09-16T07:46:05.004625+0000","last_fullsized":"2024-09-16T07:46:05.004625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":17920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:42.438905+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"25'318","reported_seq":352,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:04.948700+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:04.948700+0000","last_peered":"2024-09-16T07:46:04.948700+0000","last_clean":"2024-09-16T07:46:04.948700+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:04.948700+0000","last_undegraded":"2024-09-16T07:46:04.948700+0000","last_fullsized":"2024-09-16T07:46:04.948700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20840448,"num_objects":318,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:48.456269+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.494227+0000","last_change":"2024-09-16T07:45:51.499250+0000","last_active":"2024-09-16T07:45:51.494227+0000","last_peered":"2024-09-16T07:45:51.494227+0000","last_clean":"2024-09-16T07:45:51.494227+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:45:51.494227+0000","last_undegraded":"2024-09-16T07:45:51.494227+0000","last_fullsized":"2024-09-16T07:45:51.494227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'297","reported_seq":331,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.289324+0000","last_change":"2024-09-16T07:45:44.552616+0000","last_active":"2024-09-16T07:46:05.289324+0000","last_peered":"2024-09-16T07:46:05.289324+0000","last_clean":"2024-09-16T07:46:05.289324+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:05.289324+0000","last_undegraded":"2024-09-16T07:46:05.289324+0000","last_fullsized":"2024-09-16T07:46:05.289324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":19008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:48.456270+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.497684+0000","last_change":"2024-09-16T07:45:51.507878+0000","last_active":"2024-09-16T07:45:51.497684+0000","last_peered":"2024-09-16T07:45:51.497684+0000","last_clean":"2024-09-16T07:45:51.497684+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:45:51.497684+0000","last_undegraded":"2024-09-16T07:45:51.497684+0000","last_fullsized":"2024-09-16T07:45:51.497684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":148897792,"num_objects":2272,"num_object_clones":0,"num_object_copies":6816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2272,"num_write_kb":145408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":393216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":29921280,"data_stored":478740480,"data_compressed":22731308,"data_compressed_allocated":29921280,"data_compressed_original":478740480,"omap_allocated":0,"internal_metadata":0},"log_size":2272,"ondisk_log_size":2272,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54596,"kb_used_data":15284,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317244,"statfs":{"total":96636764160,"available":96580857856,"internally_reserved":0,"allocated":15650816,"data_stored":246747760,"data_compressed":11714631,"data_compressed_allocated":15421440,"data_compressed_original":246661120,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52484,"kb_used_data":13172,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94319356,"statfs":{"total":96636764160,"available":96583020544,"internally_reserved":0,"allocated":13488128,"data_stored":212471907,"data_compressed":10085110,"data_compressed_allocated":13275136,"data_compressed_original":212402176,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13873152,"data_stored":221970432,"data_compressed":10539462,"data_compressed_allocated":13873152,"data_compressed_original":221970432,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16048128,"data_stored":256770048,"data_compressed":12191846,"data_compressed_allocated":16048128,"data_compressed_original":256770048,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:06.580 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:46:06.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:06.728+0000 7f4c008c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:06.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:06.743+0000 7f4bfb59e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:06.749 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:06.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:06.910+0000 7f6ea6551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:06.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:06.919+0000 7f6ea6551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:07.283 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:07.283 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":69,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":25,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472749,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":13},{"state_name":"unknown","count":8},{"state_name":"stale+active+clean","count":4}],"num_pgs":25,"num_pools":3,"num_objects":2276,"data_bytes":149488179,"bytes_used":165003264,"bytes_avail":386382053376,"bytes_total":386547056640,"unknown_pgs_ratio":0.31999999284744263,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":32761,"recovering_keys_per_sec":0,"num_objects_recovered":6,"num_bytes_recovered":393216,"num_keys_recovered":0,"write_bytes_sec":7944688,"read_op_per_sec":0,"write_op_per_sec":121},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:46:07.307 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:46:07.307 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:07.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:07.473+0000 7f1f0c8c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:07.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:07.485+0000 7f1f0c8c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:07.497 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 48 16 4881 4865 6.33396 11.3125 0.0496906 0.157696 2024-09-16T07:46:07.770 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:07.770 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:07.790 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-09-16T07:46:06.298214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":149488179,"num_objects":2276,"num_object_clones":0,"num_object_copies":6828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2353,"num_write_kb":146516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":393216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2327,"ondisk_log_size":2327,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":161136,"kb_used_data":28832,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377326224,"statfs":{"total":386547056640,"available":386382053376,"internally_reserved":0,"allocated":29523968,"data_stored":460467947,"data_compressed":21859823,"data_compressed_allocated":28778496,"data_compressed_original":460210176,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":95354880,"num_objects":1455,"num_object_clones":0,"num_object_copies":4365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1455,"num_write_kb":93120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":393216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002343"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"25'267","reported_seq":301,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.074118+0000","last_change":"2024-09-16T07:45:44.531824+0000","last_active":"2024-09-16T07:46:05.074118+0000","last_peered":"2024-09-16T07:46:05.074118+0000","last_clean":"2024-09-16T07:46:05.074118+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:05.074118+0000","last_undegraded":"2024-09-16T07:46:05.074118+0000","last_fullsized":"2024-09-16T07:46:05.074118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":17088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"25'270","reported_seq":307,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.286482+0000","last_change":"2024-09-16T07:45:50.886832+0000","last_active":"2024-09-16T07:46:05.286482+0000","last_peered":"2024-09-16T07:46:05.286482+0000","last_clean":"2024-09-16T07:46:05.286482+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:05.286482+0000","last_undegraded":"2024-09-16T07:46:05.286482+0000","last_fullsized":"2024-09-16T07:46:05.286482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"25'269","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.007863+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:05.007863+0000","last_peered":"2024-09-16T07:46:05.007863+0000","last_clean":"2024-09-16T07:46:05.007863+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:05.007863+0000","last_undegraded":"2024-09-16T07:46:05.007863+0000","last_fullsized":"2024-09-16T07:46:05.007863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.483345+0000","last_change":"2024-09-16T07:45:50.567248+0000","last_active":"2024-09-16T07:45:51.483345+0000","last_peered":"2024-09-16T07:45:51.483345+0000","last_clean":"2024-09-16T07:45:51.483345+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:45:51.483345+0000","last_undegraded":"2024-09-16T07:45:51.483345+0000","last_fullsized":"2024-09-16T07:45:51.483345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.497787+0000","last_change":"2024-09-16T07:45:51.505238+0000","last_active":"2024-09-16T07:45:51.497787+0000","last_peered":"2024-09-16T07:45:51.497787+0000","last_clean":"2024-09-16T07:45:51.497787+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:45:51.497787+0000","last_undegraded":"2024-09-16T07:45:51.497787+0000","last_fullsized":"2024-09-16T07:45:51.497787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'288","reported_seq":322,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.270154+0000","last_change":"2024-09-16T07:45:44.522728+0000","last_active":"2024-09-16T07:46:05.270154+0000","last_peered":"2024-09-16T07:46:05.270154+0000","last_clean":"2024-09-16T07:46:05.270154+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:05.270154+0000","last_undegraded":"2024-09-16T07:46:05.270154+0000","last_fullsized":"2024-09-16T07:46:05.270154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:42.438903+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'283","reported_seq":317,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.098297+0000","last_change":"2024-09-16T07:45:44.540876+0000","last_active":"2024-09-16T07:46:05.098297+0000","last_peered":"2024-09-16T07:46:05.098297+0000","last_clean":"2024-09-16T07:46:05.098297+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:05.098297+0000","last_undegraded":"2024-09-16T07:46:05.098297+0000","last_fullsized":"2024-09-16T07:46:05.098297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.491482+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:45:51.491482+0000","last_peered":"2024-09-16T07:45:51.491482+0000","last_clean":"2024-09-16T07:45:51.491482+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:45:51.491482+0000","last_undegraded":"2024-09-16T07:45:51.491482+0000","last_fullsized":"2024-09-16T07:45:51.491482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'280","reported_seq":321,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.004625+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:05.004625+0000","last_peered":"2024-09-16T07:46:05.004625+0000","last_clean":"2024-09-16T07:46:05.004625+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:05.004625+0000","last_undegraded":"2024-09-16T07:46:05.004625+0000","last_fullsized":"2024-09-16T07:46:05.004625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":17920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:42.438905+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"25'318","reported_seq":352,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:04.948700+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:04.948700+0000","last_peered":"2024-09-16T07:46:04.948700+0000","last_clean":"2024-09-16T07:46:04.948700+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:04.948700+0000","last_undegraded":"2024-09-16T07:46:04.948700+0000","last_fullsized":"2024-09-16T07:46:04.948700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20840448,"num_objects":318,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:48.456269+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.494227+0000","last_change":"2024-09-16T07:45:51.499250+0000","last_active":"2024-09-16T07:45:51.494227+0000","last_peered":"2024-09-16T07:45:51.494227+0000","last_clean":"2024-09-16T07:45:51.494227+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:45:51.494227+0000","last_undegraded":"2024-09-16T07:45:51.494227+0000","last_fullsized":"2024-09-16T07:45:51.494227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'297","reported_seq":331,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.289324+0000","last_change":"2024-09-16T07:45:44.552616+0000","last_active":"2024-09-16T07:46:05.289324+0000","last_peered":"2024-09-16T07:46:05.289324+0000","last_clean":"2024-09-16T07:46:05.289324+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:05.289324+0000","last_undegraded":"2024-09-16T07:46:05.289324+0000","last_fullsized":"2024-09-16T07:46:05.289324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":19008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:48.456270+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.497684+0000","last_change":"2024-09-16T07:45:51.507878+0000","last_active":"2024-09-16T07:45:51.497684+0000","last_peered":"2024-09-16T07:45:51.497684+0000","last_clean":"2024-09-16T07:45:51.497684+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:45:51.497684+0000","last_undegraded":"2024-09-16T07:45:51.497684+0000","last_fullsized":"2024-09-16T07:45:51.497684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":148897792,"num_objects":2272,"num_object_clones":0,"num_object_copies":6816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2272,"num_write_kb":145408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":393216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":29921280,"data_stored":478740480,"data_compressed":22731308,"data_compressed_allocated":29921280,"data_compressed_original":478740480,"omap_allocated":0,"internal_metadata":0},"log_size":2272,"ondisk_log_size":2272,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54596,"kb_used_data":15284,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317244,"statfs":{"total":96636764160,"available":96580857856,"internally_reserved":0,"allocated":15650816,"data_stored":246747760,"data_compressed":11714631,"data_compressed_allocated":15421440,"data_compressed_original":246661120,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52484,"kb_used_data":13172,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94319356,"statfs":{"total":96636764160,"available":96583020544,"internally_reserved":0,"allocated":13488128,"data_stored":212471907,"data_compressed":10085110,"data_compressed_allocated":13275136,"data_compressed_original":212402176,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13873152,"data_stored":221970432,"data_compressed":10539462,"data_compressed_allocated":13873152,"data_compressed_original":221970432,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16048128,"data_stored":256770048,"data_compressed":12191846,"data_compressed_allocated":16048128,"data_compressed_original":256770048,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:08.497 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 49 16 5062 5046 6.43554 11.3125 0.111061 0.155233 2024-09-16T07:46:09.497 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 50 16 5257 5241 6.55055 12.1875 0.104705 0.152538 2024-09-16T07:46:09.596 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:09.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:09.754+0000 7f70be591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:09.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:09.763+0000 7f70be591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:10.497 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 51 16 5443 5427 6.65003 11.625 0.0915411 0.150254 2024-09-16T07:46:10.792 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:10.962+0000 7ffb6dd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:10.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:10.979+0000 7ffb6dd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:11.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:11.353 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:11.370 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-16T07:46:10.299149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":149488179,"num_objects":2276,"num_object_clones":0,"num_object_copies":6828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2353,"num_write_kb":146516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":393216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2327,"ondisk_log_size":2327,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":161136,"kb_used_data":28832,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377326224,"statfs":{"total":386547056640,"available":386382053376,"internally_reserved":0,"allocated":29523968,"data_stored":460467947,"data_compressed":21859823,"data_compressed_allocated":28778496,"data_compressed_original":460210176,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":95354880,"num_objects":1455,"num_object_clones":0,"num_object_copies":4365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1455,"num_write_kb":93120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":393216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002469"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"25'267","reported_seq":301,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.074118+0000","last_change":"2024-09-16T07:45:44.531824+0000","last_active":"2024-09-16T07:46:05.074118+0000","last_peered":"2024-09-16T07:46:05.074118+0000","last_clean":"2024-09-16T07:46:05.074118+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:05.074118+0000","last_undegraded":"2024-09-16T07:46:05.074118+0000","last_fullsized":"2024-09-16T07:46:05.074118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":17088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"25'270","reported_seq":307,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.286482+0000","last_change":"2024-09-16T07:45:50.886832+0000","last_active":"2024-09-16T07:46:05.286482+0000","last_peered":"2024-09-16T07:46:05.286482+0000","last_clean":"2024-09-16T07:46:05.286482+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:05.286482+0000","last_undegraded":"2024-09-16T07:46:05.286482+0000","last_fullsized":"2024-09-16T07:46:05.286482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"25'269","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.007863+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:05.007863+0000","last_peered":"2024-09-16T07:46:05.007863+0000","last_clean":"2024-09-16T07:46:05.007863+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:05.007863+0000","last_undegraded":"2024-09-16T07:46:05.007863+0000","last_fullsized":"2024-09-16T07:46:05.007863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.483345+0000","last_change":"2024-09-16T07:45:50.567248+0000","last_active":"2024-09-16T07:45:51.483345+0000","last_peered":"2024-09-16T07:45:51.483345+0000","last_clean":"2024-09-16T07:45:51.483345+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:45:51.483345+0000","last_undegraded":"2024-09-16T07:45:51.483345+0000","last_fullsized":"2024-09-16T07:45:51.483345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.497787+0000","last_change":"2024-09-16T07:45:51.505238+0000","last_active":"2024-09-16T07:45:51.497787+0000","last_peered":"2024-09-16T07:45:51.497787+0000","last_clean":"2024-09-16T07:45:51.497787+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:45:51.497787+0000","last_undegraded":"2024-09-16T07:45:51.497787+0000","last_fullsized":"2024-09-16T07:45:51.497787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'288","reported_seq":322,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.270154+0000","last_change":"2024-09-16T07:45:44.522728+0000","last_active":"2024-09-16T07:46:05.270154+0000","last_peered":"2024-09-16T07:46:05.270154+0000","last_clean":"2024-09-16T07:46:05.270154+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:05.270154+0000","last_undegraded":"2024-09-16T07:46:05.270154+0000","last_fullsized":"2024-09-16T07:46:05.270154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:42.438903+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'283","reported_seq":317,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.098297+0000","last_change":"2024-09-16T07:45:44.540876+0000","last_active":"2024-09-16T07:46:05.098297+0000","last_peered":"2024-09-16T07:46:05.098297+0000","last_clean":"2024-09-16T07:46:05.098297+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:05.098297+0000","last_undegraded":"2024-09-16T07:46:05.098297+0000","last_fullsized":"2024-09-16T07:46:05.098297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.491482+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:45:51.491482+0000","last_peered":"2024-09-16T07:45:51.491482+0000","last_clean":"2024-09-16T07:45:51.491482+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:45:51.491482+0000","last_undegraded":"2024-09-16T07:45:51.491482+0000","last_fullsized":"2024-09-16T07:45:51.491482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'280","reported_seq":321,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.004625+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:05.004625+0000","last_peered":"2024-09-16T07:46:05.004625+0000","last_clean":"2024-09-16T07:46:05.004625+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:05.004625+0000","last_undegraded":"2024-09-16T07:46:05.004625+0000","last_fullsized":"2024-09-16T07:46:05.004625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":17920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:42.438905+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"25'318","reported_seq":352,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:04.948700+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:04.948700+0000","last_peered":"2024-09-16T07:46:04.948700+0000","last_clean":"2024-09-16T07:46:04.948700+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:04.948700+0000","last_undegraded":"2024-09-16T07:46:04.948700+0000","last_fullsized":"2024-09-16T07:46:04.948700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20840448,"num_objects":318,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:48.456269+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.494227+0000","last_change":"2024-09-16T07:45:51.499250+0000","last_active":"2024-09-16T07:45:51.494227+0000","last_peered":"2024-09-16T07:45:51.494227+0000","last_clean":"2024-09-16T07:45:51.494227+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:45:51.494227+0000","last_undegraded":"2024-09-16T07:45:51.494227+0000","last_fullsized":"2024-09-16T07:45:51.494227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'297","reported_seq":331,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.289324+0000","last_change":"2024-09-16T07:45:44.552616+0000","last_active":"2024-09-16T07:46:05.289324+0000","last_peered":"2024-09-16T07:46:05.289324+0000","last_clean":"2024-09-16T07:46:05.289324+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:05.289324+0000","last_undegraded":"2024-09-16T07:46:05.289324+0000","last_fullsized":"2024-09-16T07:46:05.289324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":19008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:48.456270+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.497684+0000","last_change":"2024-09-16T07:45:51.507878+0000","last_active":"2024-09-16T07:45:51.497684+0000","last_peered":"2024-09-16T07:45:51.497684+0000","last_clean":"2024-09-16T07:45:51.497684+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:45:51.497684+0000","last_undegraded":"2024-09-16T07:45:51.497684+0000","last_fullsized":"2024-09-16T07:45:51.497684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":148897792,"num_objects":2272,"num_object_clones":0,"num_object_copies":6816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2272,"num_write_kb":145408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":393216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":29921280,"data_stored":478740480,"data_compressed":22731308,"data_compressed_allocated":29921280,"data_compressed_original":478740480,"omap_allocated":0,"internal_metadata":0},"log_size":2272,"ondisk_log_size":2272,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54596,"kb_used_data":15284,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317244,"statfs":{"total":96636764160,"available":96580857856,"internally_reserved":0,"allocated":15650816,"data_stored":246747760,"data_compressed":11714631,"data_compressed_allocated":15421440,"data_compressed_original":246661120,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52484,"kb_used_data":13172,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94319356,"statfs":{"total":96636764160,"available":96583020544,"internally_reserved":0,"allocated":13488128,"data_stored":212471907,"data_compressed":10085110,"data_compressed_allocated":13275136,"data_compressed_original":212402176,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13873152,"data_stored":221970432,"data_compressed":10539462,"data_compressed_allocated":13873152,"data_compressed_original":221970432,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16048128,"data_stored":256770048,"data_compressed":12191846,"data_compressed_allocated":16048128,"data_compressed_original":256770048,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:11.372 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:46:11.497 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 52 16 5643 5627 6.76251 12.5 0.0919577 0.147755 2024-09-16T07:46:11.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:11.528+0000 7f17b3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:11.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:11.539+0000 7f17b3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:12.025 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:12.025 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":74,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":25,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472749,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":13},{"state_name":"unknown","count":8},{"state_name":"stale+active+clean","count":4}],"num_pgs":25,"num_pools":3,"num_objects":2276,"data_bytes":149488179,"bytes_used":165003264,"bytes_avail":386382053376,"bytes_total":386547056640,"unknown_pgs_ratio":0.31999999284744263,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":32761,"recovering_keys_per_sec":0,"num_objects_recovered":6,"num_bytes_recovered":393216,"num_keys_recovered":0,"write_bytes_sec":7944604,"read_op_per_sec":0,"write_op_per_sec":121},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:46:12.050 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:46:12.050 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:12.144 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:12.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:12.208+0000 7fb32eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:12.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:12.225+0000 7fb32eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:12.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:12.306+0000 7fe026b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:12.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:12.318+0000 7fe026b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:12.497 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 53 16 5826 5810 6.85069 11.4375 0.108472 0.145845 2024-09-16T07:46:12.588 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:12.588 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:12.607 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-09-16T07:46:12.299601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":149488179,"num_objects":2276,"num_object_clones":0,"num_object_copies":6828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2353,"num_write_kb":146516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":393216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2327,"ondisk_log_size":2327,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":161136,"kb_used_data":28832,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377326224,"statfs":{"total":386547056640,"available":386382053376,"internally_reserved":0,"allocated":29523968,"data_stored":460467947,"data_compressed":21859823,"data_compressed_allocated":28778496,"data_compressed_original":460210176,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":95354880,"num_objects":1455,"num_object_clones":0,"num_object_copies":4365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1455,"num_write_kb":93120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":393216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002511"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"25'267","reported_seq":301,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.074118+0000","last_change":"2024-09-16T07:45:44.531824+0000","last_active":"2024-09-16T07:46:05.074118+0000","last_peered":"2024-09-16T07:46:05.074118+0000","last_clean":"2024-09-16T07:46:05.074118+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:05.074118+0000","last_undegraded":"2024-09-16T07:46:05.074118+0000","last_fullsized":"2024-09-16T07:46:05.074118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":17088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"25'270","reported_seq":307,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.286482+0000","last_change":"2024-09-16T07:45:50.886832+0000","last_active":"2024-09-16T07:46:05.286482+0000","last_peered":"2024-09-16T07:46:05.286482+0000","last_clean":"2024-09-16T07:46:05.286482+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:05.286482+0000","last_undegraded":"2024-09-16T07:46:05.286482+0000","last_fullsized":"2024-09-16T07:46:05.286482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"25'269","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.007863+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:05.007863+0000","last_peered":"2024-09-16T07:46:05.007863+0000","last_clean":"2024-09-16T07:46:05.007863+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:05.007863+0000","last_undegraded":"2024-09-16T07:46:05.007863+0000","last_fullsized":"2024-09-16T07:46:05.007863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.483345+0000","last_change":"2024-09-16T07:45:50.567248+0000","last_active":"2024-09-16T07:45:51.483345+0000","last_peered":"2024-09-16T07:45:51.483345+0000","last_clean":"2024-09-16T07:45:51.483345+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:45:51.483345+0000","last_undegraded":"2024-09-16T07:45:51.483345+0000","last_fullsized":"2024-09-16T07:45:51.483345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.497787+0000","last_change":"2024-09-16T07:45:51.505238+0000","last_active":"2024-09-16T07:45:51.497787+0000","last_peered":"2024-09-16T07:45:51.497787+0000","last_clean":"2024-09-16T07:45:51.497787+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:45:51.497787+0000","last_undegraded":"2024-09-16T07:45:51.497787+0000","last_fullsized":"2024-09-16T07:45:51.497787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'288","reported_seq":322,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.270154+0000","last_change":"2024-09-16T07:45:44.522728+0000","last_active":"2024-09-16T07:46:05.270154+0000","last_peered":"2024-09-16T07:46:05.270154+0000","last_clean":"2024-09-16T07:46:05.270154+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:05.270154+0000","last_undegraded":"2024-09-16T07:46:05.270154+0000","last_fullsized":"2024-09-16T07:46:05.270154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.400765+0000","last_change":"2024-09-16T07:45:11.402815+0000","last_active":"2024-09-16T07:45:11.400765+0000","last_peered":"2024-09-16T07:45:11.400765+0000","last_clean":"2024-09-16T07:45:11.400765+0000","last_became_active":"2024-09-16T07:45:09.445691+0000","last_became_peered":"2024-09-16T07:45:09.445691+0000","last_unstale":"2024-09-16T07:45:42.438903+0000","last_undegraded":"2024-09-16T07:45:11.400765+0000","last_fullsized":"2024-09-16T07:45:11.400765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'283","reported_seq":317,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.098297+0000","last_change":"2024-09-16T07:45:44.540876+0000","last_active":"2024-09-16T07:46:05.098297+0000","last_peered":"2024-09-16T07:46:05.098297+0000","last_clean":"2024-09-16T07:46:05.098297+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:05.098297+0000","last_undegraded":"2024-09-16T07:46:05.098297+0000","last_fullsized":"2024-09-16T07:46:05.098297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.491482+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:45:51.491482+0000","last_peered":"2024-09-16T07:45:51.491482+0000","last_clean":"2024-09-16T07:45:51.491482+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:45:51.491482+0000","last_undegraded":"2024-09-16T07:45:51.491482+0000","last_fullsized":"2024-09-16T07:45:51.491482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'280","reported_seq":321,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.004625+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:05.004625+0000","last_peered":"2024-09-16T07:46:05.004625+0000","last_clean":"2024-09-16T07:46:05.004625+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:05.004625+0000","last_undegraded":"2024-09-16T07:46:05.004625+0000","last_fullsized":"2024-09-16T07:46:05.004625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":17920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.397414+0000","last_change":"2024-09-16T07:45:11.397414+0000","last_active":"2024-09-16T07:45:11.397414+0000","last_peered":"2024-09-16T07:45:11.397414+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:45:09.447130+0000","last_became_peered":"2024-09-16T07:45:09.447130+0000","last_unstale":"2024-09-16T07:45:42.438905+0000","last_undegraded":"2024-09-16T07:45:11.397414+0000","last_fullsized":"2024-09-16T07:45:11.397414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"25'318","reported_seq":352,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:04.948700+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:04.948700+0000","last_peered":"2024-09-16T07:46:04.948700+0000","last_clean":"2024-09-16T07:46:04.948700+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:04.948700+0000","last_undegraded":"2024-09-16T07:46:04.948700+0000","last_fullsized":"2024-09-16T07:46:04.948700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20840448,"num_objects":318,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:48.456269+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.494227+0000","last_change":"2024-09-16T07:45:51.499250+0000","last_active":"2024-09-16T07:45:51.494227+0000","last_peered":"2024-09-16T07:45:51.494227+0000","last_clean":"2024-09-16T07:45:51.494227+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:45:51.494227+0000","last_undegraded":"2024-09-16T07:45:51.494227+0000","last_fullsized":"2024-09-16T07:45:51.494227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'297","reported_seq":331,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.289324+0000","last_change":"2024-09-16T07:45:44.552616+0000","last_active":"2024-09-16T07:46:05.289324+0000","last_peered":"2024-09-16T07:46:05.289324+0000","last_clean":"2024-09-16T07:46:05.289324+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:05.289324+0000","last_undegraded":"2024-09-16T07:46:05.289324+0000","last_fullsized":"2024-09-16T07:46:05.289324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":19008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:48.456270+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.497684+0000","last_change":"2024-09-16T07:45:51.507878+0000","last_active":"2024-09-16T07:45:51.497684+0000","last_peered":"2024-09-16T07:45:51.497684+0000","last_clean":"2024-09-16T07:45:51.497684+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:45:51.497684+0000","last_undegraded":"2024-09-16T07:45:51.497684+0000","last_fullsized":"2024-09-16T07:45:51.497684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":148897792,"num_objects":2272,"num_object_clones":0,"num_object_copies":6816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2272,"num_write_kb":145408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":393216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":29921280,"data_stored":478740480,"data_compressed":22731308,"data_compressed_allocated":29921280,"data_compressed_original":478740480,"omap_allocated":0,"internal_metadata":0},"log_size":2272,"ondisk_log_size":2272,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54596,"kb_used_data":15284,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317244,"statfs":{"total":96636764160,"available":96580857856,"internally_reserved":0,"allocated":15650816,"data_stored":246747760,"data_compressed":11714631,"data_compressed_allocated":15421440,"data_compressed_original":246661120,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52484,"kb_used_data":13172,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94319356,"statfs":{"total":96636764160,"available":96583020544,"internally_reserved":0,"allocated":13488128,"data_stored":212471907,"data_compressed":10085110,"data_compressed_allocated":13275136,"data_compressed_original":212402176,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13873152,"data_stored":221970432,"data_compressed":10539462,"data_compressed_allocated":13873152,"data_compressed_original":221970432,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16048128,"data_stored":256770048,"data_compressed":12191846,"data_compressed_allocated":16048128,"data_compressed_original":256770048,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:13.497 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 54 16 6025 6009 6.95412 12.4375 0.0327488 0.143694 2024-09-16T07:46:14.498 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 55 16 6231 6215 7.06175 12.875 0.0516149 0.141493 2024-09-16T07:46:14.726 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:14.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:14.888+0000 7fb842b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:14.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:14.900+0000 7fb842b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:15.498 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 56 16 6417 6401 7.14322 11.625 0.158022 0.13983 2024-09-16T07:46:15.609 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:15.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:15.765+0000 7fee9ed51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:15.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:15.782+0000 7fee9ed51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:16.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:16.083 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:16.102 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-16T07:46:14.300052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":246350376,"num_objects":3754,"num_object_clones":0,"num_object_copies":11262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3830,"num_write_kb":241107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3809,"ondisk_log_size":3809,"up":63,"acting":63,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":194036,"kb_used_data":44852,"kb_used_omap":0,"kb_used_meta":149120,"kb_avail":377293324,"statfs":{"total":386547056640,"available":386348363776,"internally_reserved":0,"allocated":45928448,"data_stored":721664866,"data_compressed":34260396,"data_compressed_allocated":45101056,"data_compressed_original":721371136,"omap_allocated":0,"internal_metadata":152698880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":192217077,"num_objects":2933,"num_object_clones":0,"num_object_copies":8799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2932,"num_write_kb":187711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002538"},"pg_stats":[{"pgid":"3.f","version":"25'395","reported_seq":427,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:12.954045+0000","last_change":"2024-09-16T07:45:44.535560+0000","last_active":"2024-09-16T07:46:12.954045+0000","last_peered":"2024-09-16T07:46:12.954045+0000","last_clean":"2024-09-16T07:46:12.954045+0000","last_became_active":"2024-09-16T07:45:44.523789+0000","last_became_peered":"2024-09-16T07:45:44.523789+0000","last_unstale":"2024-09-16T07:46:12.954045+0000","last_undegraded":"2024-09-16T07:46:12.954045+0000","last_fullsized":"2024-09-16T07:46:12.954045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"25'267","reported_seq":301,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.074118+0000","last_change":"2024-09-16T07:45:44.531824+0000","last_active":"2024-09-16T07:46:05.074118+0000","last_peered":"2024-09-16T07:46:05.074118+0000","last_clean":"2024-09-16T07:46:05.074118+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:05.074118+0000","last_undegraded":"2024-09-16T07:46:05.074118+0000","last_fullsized":"2024-09-16T07:46:05.074118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":17088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'342","reported_seq":375,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.292186+0000","last_change":"2024-09-16T07:45:50.902218+0000","last_active":"2024-09-16T07:46:13.292186+0000","last_peered":"2024-09-16T07:46:13.292186+0000","last_clean":"2024-09-16T07:46:13.292186+0000","last_became_active":"2024-09-16T07:45:50.691944+0000","last_became_peered":"2024-09-16T07:45:50.691944+0000","last_unstale":"2024-09-16T07:46:13.292186+0000","last_undegraded":"2024-09-16T07:46:13.292186+0000","last_fullsized":"2024-09-16T07:46:13.292186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'270","reported_seq":307,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.286482+0000","last_change":"2024-09-16T07:45:50.886832+0000","last_active":"2024-09-16T07:46:05.286482+0000","last_peered":"2024-09-16T07:46:05.286482+0000","last_clean":"2024-09-16T07:46:05.286482+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:05.286482+0000","last_undegraded":"2024-09-16T07:46:05.286482+0000","last_fullsized":"2024-09-16T07:46:05.286482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'355","reported_seq":381,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.308341+0000","last_change":"2024-09-16T07:45:50.666069+0000","last_active":"2024-09-16T07:46:13.308341+0000","last_peered":"2024-09-16T07:46:13.308341+0000","last_clean":"2024-09-16T07:46:13.308341+0000","last_became_active":"2024-09-16T07:45:50.653189+0000","last_became_peered":"2024-09-16T07:45:50.653189+0000","last_unstale":"2024-09-16T07:46:13.308341+0000","last_undegraded":"2024-09-16T07:46:13.308341+0000","last_fullsized":"2024-09-16T07:46:13.308341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'390","reported_seq":416,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.247682+0000","last_change":"2024-09-16T07:45:50.622899+0000","last_active":"2024-09-16T07:46:13.247682+0000","last_peered":"2024-09-16T07:46:13.247682+0000","last_clean":"2024-09-16T07:46:13.247682+0000","last_became_active":"2024-09-16T07:45:50.606399+0000","last_became_peered":"2024-09-16T07:45:50.606399+0000","last_unstale":"2024-09-16T07:46:13.247682+0000","last_undegraded":"2024-09-16T07:46:13.247682+0000","last_fullsized":"2024-09-16T07:46:13.247682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'269","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.007863+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:05.007863+0000","last_peered":"2024-09-16T07:46:05.007863+0000","last_clean":"2024-09-16T07:46:05.007863+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:05.007863+0000","last_undegraded":"2024-09-16T07:46:05.007863+0000","last_fullsized":"2024-09-16T07:46:05.007863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.483345+0000","last_change":"2024-09-16T07:45:50.567248+0000","last_active":"2024-09-16T07:45:51.483345+0000","last_peered":"2024-09-16T07:45:51.483345+0000","last_clean":"2024-09-16T07:45:51.483345+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:45:51.483345+0000","last_undegraded":"2024-09-16T07:45:51.483345+0000","last_fullsized":"2024-09-16T07:45:51.483345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.497787+0000","last_change":"2024-09-16T07:45:51.505238+0000","last_active":"2024-09-16T07:45:51.497787+0000","last_peered":"2024-09-16T07:45:51.497787+0000","last_clean":"2024-09-16T07:45:51.497787+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:45:51.497787+0000","last_undegraded":"2024-09-16T07:45:51.497787+0000","last_fullsized":"2024-09-16T07:45:51.497787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'288","reported_seq":322,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.270154+0000","last_change":"2024-09-16T07:45:44.522728+0000","last_active":"2024-09-16T07:46:05.270154+0000","last_peered":"2024-09-16T07:46:05.270154+0000","last_clean":"2024-09-16T07:46:05.270154+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:05.270154+0000","last_undegraded":"2024-09-16T07:46:05.270154+0000","last_fullsized":"2024-09-16T07:46:05.270154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.513996+0000","last_change":"2024-09-16T07:45:51.521750+0000","last_active":"2024-09-16T07:45:51.513996+0000","last_peered":"2024-09-16T07:45:51.513996+0000","last_clean":"2024-09-16T07:45:51.513996+0000","last_became_active":"2024-09-16T07:45:50.665366+0000","last_became_peered":"2024-09-16T07:45:50.665366+0000","last_unstale":"2024-09-16T07:45:51.513996+0000","last_undegraded":"2024-09-16T07:45:51.513996+0000","last_fullsized":"2024-09-16T07:45:51.513996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'283","reported_seq":317,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.098297+0000","last_change":"2024-09-16T07:45:44.540876+0000","last_active":"2024-09-16T07:46:05.098297+0000","last_peered":"2024-09-16T07:46:05.098297+0000","last_clean":"2024-09-16T07:46:05.098297+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:05.098297+0000","last_undegraded":"2024-09-16T07:46:05.098297+0000","last_fullsized":"2024-09-16T07:46:05.098297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.491482+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:45:51.491482+0000","last_peered":"2024-09-16T07:45:51.491482+0000","last_clean":"2024-09-16T07:45:51.491482+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:45:51.491482+0000","last_undegraded":"2024-09-16T07:45:51.491482+0000","last_fullsized":"2024-09-16T07:45:51.491482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'280","reported_seq":321,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.004625+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:05.004625+0000","last_peered":"2024-09-16T07:46:05.004625+0000","last_clean":"2024-09-16T07:46:05.004625+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:05.004625+0000","last_undegraded":"2024-09-16T07:46:05.004625+0000","last_fullsized":"2024-09-16T07:46:05.004625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":17920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.511360+0000","last_change":"2024-09-16T07:45:51.520543+0000","last_active":"2024-09-16T07:45:51.511360+0000","last_peered":"2024-09-16T07:45:51.511360+0000","last_clean":"2024-09-16T07:45:51.511360+0000","last_became_active":"2024-09-16T07:45:50.656425+0000","last_became_peered":"2024-09-16T07:45:50.656425+0000","last_unstale":"2024-09-16T07:45:51.511360+0000","last_undegraded":"2024-09-16T07:45:51.511360+0000","last_fullsized":"2024-09-16T07:45:51.511360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"25'318","reported_seq":352,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:04.948700+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:04.948700+0000","last_peered":"2024-09-16T07:46:04.948700+0000","last_clean":"2024-09-16T07:46:04.948700+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:04.948700+0000","last_undegraded":"2024-09-16T07:46:04.948700+0000","last_fullsized":"2024-09-16T07:46:04.948700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20840448,"num_objects":318,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:48.456269+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.494227+0000","last_change":"2024-09-16T07:45:51.499250+0000","last_active":"2024-09-16T07:45:51.494227+0000","last_peered":"2024-09-16T07:45:51.494227+0000","last_clean":"2024-09-16T07:45:51.494227+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:45:51.494227+0000","last_undegraded":"2024-09-16T07:45:51.494227+0000","last_fullsized":"2024-09-16T07:45:51.494227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'297","reported_seq":331,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.289324+0000","last_change":"2024-09-16T07:45:44.552616+0000","last_active":"2024-09-16T07:46:05.289324+0000","last_peered":"2024-09-16T07:46:05.289324+0000","last_clean":"2024-09-16T07:46:05.289324+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:05.289324+0000","last_undegraded":"2024-09-16T07:46:05.289324+0000","last_fullsized":"2024-09-16T07:46:05.289324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":19008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:48.456270+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.497684+0000","last_change":"2024-09-16T07:45:51.507878+0000","last_active":"2024-09-16T07:45:51.497684+0000","last_peered":"2024-09-16T07:45:51.497684+0000","last_clean":"2024-09-16T07:45:51.497684+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:45:51.497684+0000","last_undegraded":"2024-09-16T07:45:51.497684+0000","last_fullsized":"2024-09-16T07:45:51.497684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":245760000,"num_objects":3750,"num_object_clones":0,"num_object_copies":11250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3750,"num_write_kb":240000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46706688,"data_stored":747307008,"data_compressed":35483537,"data_compressed_allocated":46706688,"data_compressed_original":747307008,"omap_allocated":0,"internal_metadata":0},"log_size":3754,"ondisk_log_size":3754,"up":36,"acting":36,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54596,"kb_used_data":15284,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317244,"statfs":{"total":96636764160,"available":96580857856,"internally_reserved":0,"allocated":15650816,"data_stored":246747760,"data_compressed":11714631,"data_compressed_allocated":15421440,"data_compressed_original":246661120,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52484,"kb_used_data":13172,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94319356,"statfs":{"total":96636764160,"available":96583020544,"internally_reserved":0,"allocated":13488128,"data_stored":212471907,"data_compressed":10085110,"data_compressed_allocated":13275136,"data_compressed_original":212402176,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":20,"seq":85899345949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59936,"kb_used_data":16208,"kb_used_omap":0,"kb_used_meta":43712,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":16596992,"data_stored":261821059,"data_compressed":12430614,"data_compressed_allocated":16363520,"data_compressed_original":261734400,"omap_allocated":0,"internal_metadata":44761088},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":268566528,"data_compressed":12752229,"data_compressed_allocated":16785408,"data_compressed_original":268566528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13873152,"data_stored":221970432,"data_compressed":10539462,"data_compressed_allocated":13873152,"data_compressed_original":221970432,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16048128,"data_stored":256770048,"data_compressed":12191846,"data_compressed_allocated":16048128,"data_compressed_original":256770048,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:16.104 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:46:16.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:16.274+0000 7f87f7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:16.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:16.287+0000 7f87f7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:16.498 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 57 16 6613 6597 7.23279 12.25 0.105982 0.138116 2024-09-16T07:46:16.805 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:16.806 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":78,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":25,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472749,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":19},{"state_name":"unknown","count":4},{"state_name":"stale+active+clean","count":2}],"num_pgs":25,"num_pools":3,"num_objects":3754,"data_bytes":246350376,"bytes_used":198692864,"bytes_avail":386348363776,"bytes_total":386547056640,"unknown_pgs_ratio":0.15999999642372131,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":43680,"recovering_keys_per_sec":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"write_bytes_sec":16014419,"read_op_per_sec":0,"write_op_per_sec":244},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:46:16.823 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:46:16.824 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:16.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:16.990+0000 7fd9e2111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:17.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:17.004+0000 7fd9e2111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:17.268 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:17.268 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:17.285 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-09-16T07:46:16.300515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":246350376,"num_objects":3754,"num_object_clones":0,"num_object_copies":11262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3830,"num_write_kb":241107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3809,"ondisk_log_size":3809,"up":63,"acting":63,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":194036,"kb_used_data":44852,"kb_used_omap":0,"kb_used_meta":149120,"kb_avail":377293324,"statfs":{"total":386547056640,"available":386348363776,"internally_reserved":0,"allocated":45928448,"data_stored":721664866,"data_compressed":34260396,"data_compressed_allocated":45101056,"data_compressed_original":721371136,"omap_allocated":0,"internal_metadata":152698880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":192217077,"num_objects":2933,"num_object_clones":0,"num_object_copies":8799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2932,"num_write_kb":187711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002686"},"pg_stats":[{"pgid":"3.f","version":"25'395","reported_seq":427,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:12.954045+0000","last_change":"2024-09-16T07:45:44.535560+0000","last_active":"2024-09-16T07:46:12.954045+0000","last_peered":"2024-09-16T07:46:12.954045+0000","last_clean":"2024-09-16T07:46:12.954045+0000","last_became_active":"2024-09-16T07:45:44.523789+0000","last_became_peered":"2024-09-16T07:45:44.523789+0000","last_unstale":"2024-09-16T07:46:12.954045+0000","last_undegraded":"2024-09-16T07:46:12.954045+0000","last_fullsized":"2024-09-16T07:46:12.954045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"25'267","reported_seq":301,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.074118+0000","last_change":"2024-09-16T07:45:44.531824+0000","last_active":"2024-09-16T07:46:05.074118+0000","last_peered":"2024-09-16T07:46:05.074118+0000","last_clean":"2024-09-16T07:46:05.074118+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:05.074118+0000","last_undegraded":"2024-09-16T07:46:05.074118+0000","last_fullsized":"2024-09-16T07:46:05.074118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":17088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'342","reported_seq":375,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.292186+0000","last_change":"2024-09-16T07:45:50.902218+0000","last_active":"2024-09-16T07:46:13.292186+0000","last_peered":"2024-09-16T07:46:13.292186+0000","last_clean":"2024-09-16T07:46:13.292186+0000","last_became_active":"2024-09-16T07:45:50.691944+0000","last_became_peered":"2024-09-16T07:45:50.691944+0000","last_unstale":"2024-09-16T07:46:13.292186+0000","last_undegraded":"2024-09-16T07:46:13.292186+0000","last_fullsized":"2024-09-16T07:46:13.292186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'270","reported_seq":307,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.286482+0000","last_change":"2024-09-16T07:45:50.886832+0000","last_active":"2024-09-16T07:46:05.286482+0000","last_peered":"2024-09-16T07:46:05.286482+0000","last_clean":"2024-09-16T07:46:05.286482+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:05.286482+0000","last_undegraded":"2024-09-16T07:46:05.286482+0000","last_fullsized":"2024-09-16T07:46:05.286482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'355","reported_seq":381,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.308341+0000","last_change":"2024-09-16T07:45:50.666069+0000","last_active":"2024-09-16T07:46:13.308341+0000","last_peered":"2024-09-16T07:46:13.308341+0000","last_clean":"2024-09-16T07:46:13.308341+0000","last_became_active":"2024-09-16T07:45:50.653189+0000","last_became_peered":"2024-09-16T07:45:50.653189+0000","last_unstale":"2024-09-16T07:46:13.308341+0000","last_undegraded":"2024-09-16T07:46:13.308341+0000","last_fullsized":"2024-09-16T07:46:13.308341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'390","reported_seq":416,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.247682+0000","last_change":"2024-09-16T07:45:50.622899+0000","last_active":"2024-09-16T07:46:13.247682+0000","last_peered":"2024-09-16T07:46:13.247682+0000","last_clean":"2024-09-16T07:46:13.247682+0000","last_became_active":"2024-09-16T07:45:50.606399+0000","last_became_peered":"2024-09-16T07:45:50.606399+0000","last_unstale":"2024-09-16T07:46:13.247682+0000","last_undegraded":"2024-09-16T07:46:13.247682+0000","last_fullsized":"2024-09-16T07:46:13.247682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'269","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.007863+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:05.007863+0000","last_peered":"2024-09-16T07:46:05.007863+0000","last_clean":"2024-09-16T07:46:05.007863+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:05.007863+0000","last_undegraded":"2024-09-16T07:46:05.007863+0000","last_fullsized":"2024-09-16T07:46:05.007863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.483345+0000","last_change":"2024-09-16T07:45:50.567248+0000","last_active":"2024-09-16T07:45:51.483345+0000","last_peered":"2024-09-16T07:45:51.483345+0000","last_clean":"2024-09-16T07:45:51.483345+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:45:51.483345+0000","last_undegraded":"2024-09-16T07:45:51.483345+0000","last_fullsized":"2024-09-16T07:45:51.483345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.497787+0000","last_change":"2024-09-16T07:45:51.505238+0000","last_active":"2024-09-16T07:45:51.497787+0000","last_peered":"2024-09-16T07:45:51.497787+0000","last_clean":"2024-09-16T07:45:51.497787+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:45:51.497787+0000","last_undegraded":"2024-09-16T07:45:51.497787+0000","last_fullsized":"2024-09-16T07:45:51.497787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'288","reported_seq":322,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.270154+0000","last_change":"2024-09-16T07:45:44.522728+0000","last_active":"2024-09-16T07:46:05.270154+0000","last_peered":"2024-09-16T07:46:05.270154+0000","last_clean":"2024-09-16T07:46:05.270154+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:05.270154+0000","last_undegraded":"2024-09-16T07:46:05.270154+0000","last_fullsized":"2024-09-16T07:46:05.270154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.513996+0000","last_change":"2024-09-16T07:45:51.521750+0000","last_active":"2024-09-16T07:45:51.513996+0000","last_peered":"2024-09-16T07:45:51.513996+0000","last_clean":"2024-09-16T07:45:51.513996+0000","last_became_active":"2024-09-16T07:45:50.665366+0000","last_became_peered":"2024-09-16T07:45:50.665366+0000","last_unstale":"2024-09-16T07:45:51.513996+0000","last_undegraded":"2024-09-16T07:45:51.513996+0000","last_fullsized":"2024-09-16T07:45:51.513996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'283","reported_seq":317,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.098297+0000","last_change":"2024-09-16T07:45:44.540876+0000","last_active":"2024-09-16T07:46:05.098297+0000","last_peered":"2024-09-16T07:46:05.098297+0000","last_clean":"2024-09-16T07:46:05.098297+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:05.098297+0000","last_undegraded":"2024-09-16T07:46:05.098297+0000","last_fullsized":"2024-09-16T07:46:05.098297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.491482+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:45:51.491482+0000","last_peered":"2024-09-16T07:45:51.491482+0000","last_clean":"2024-09-16T07:45:51.491482+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:45:51.491482+0000","last_undegraded":"2024-09-16T07:45:51.491482+0000","last_fullsized":"2024-09-16T07:45:51.491482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'280","reported_seq":321,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.004625+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:05.004625+0000","last_peered":"2024-09-16T07:46:05.004625+0000","last_clean":"2024-09-16T07:46:05.004625+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:05.004625+0000","last_undegraded":"2024-09-16T07:46:05.004625+0000","last_fullsized":"2024-09-16T07:46:05.004625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":17920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.511360+0000","last_change":"2024-09-16T07:45:51.520543+0000","last_active":"2024-09-16T07:45:51.511360+0000","last_peered":"2024-09-16T07:45:51.511360+0000","last_clean":"2024-09-16T07:45:51.511360+0000","last_became_active":"2024-09-16T07:45:50.656425+0000","last_became_peered":"2024-09-16T07:45:50.656425+0000","last_unstale":"2024-09-16T07:45:51.511360+0000","last_undegraded":"2024-09-16T07:45:51.511360+0000","last_fullsized":"2024-09-16T07:45:51.511360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"25'318","reported_seq":352,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:04.948700+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:04.948700+0000","last_peered":"2024-09-16T07:46:04.948700+0000","last_clean":"2024-09-16T07:46:04.948700+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:04.948700+0000","last_undegraded":"2024-09-16T07:46:04.948700+0000","last_fullsized":"2024-09-16T07:46:04.948700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20840448,"num_objects":318,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396333+0000","last_change":"2024-09-16T07:45:11.399310+0000","last_active":"2024-09-16T07:45:11.396333+0000","last_peered":"2024-09-16T07:45:11.396333+0000","last_clean":"2024-09-16T07:45:11.396333+0000","last_became_active":"2024-09-16T07:45:09.442499+0000","last_became_peered":"2024-09-16T07:45:09.442499+0000","last_unstale":"2024-09-16T07:45:48.456269+0000","last_undegraded":"2024-09-16T07:45:11.396333+0000","last_fullsized":"2024-09-16T07:45:11.396333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.494227+0000","last_change":"2024-09-16T07:45:51.499250+0000","last_active":"2024-09-16T07:45:51.494227+0000","last_peered":"2024-09-16T07:45:51.494227+0000","last_clean":"2024-09-16T07:45:51.494227+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:45:51.494227+0000","last_undegraded":"2024-09-16T07:45:51.494227+0000","last_fullsized":"2024-09-16T07:45:51.494227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'297","reported_seq":331,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.289324+0000","last_change":"2024-09-16T07:45:44.552616+0000","last_active":"2024-09-16T07:46:05.289324+0000","last_peered":"2024-09-16T07:46:05.289324+0000","last_clean":"2024-09-16T07:46:05.289324+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:05.289324+0000","last_undegraded":"2024-09-16T07:46:05.289324+0000","last_fullsized":"2024-09-16T07:46:05.289324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":19008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:11.396269+0000","last_change":"2024-09-16T07:45:11.399159+0000","last_active":"2024-09-16T07:45:11.396269+0000","last_peered":"2024-09-16T07:45:11.396269+0000","last_clean":"2024-09-16T07:45:11.396269+0000","last_became_active":"2024-09-16T07:45:09.462871+0000","last_became_peered":"2024-09-16T07:45:09.462871+0000","last_unstale":"2024-09-16T07:45:48.456270+0000","last_undegraded":"2024-09-16T07:45:11.396269+0000","last_fullsized":"2024-09-16T07:45:11.396269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:17.388638+0000","last_change":"2024-09-16T07:45:17.388638+0000","last_active":"2024-09-16T07:45:17.388638+0000","last_peered":"2024-09-16T07:45:17.388638+0000","last_clean":"2024-09-16T07:45:17.388638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:17.388638+0000","last_undegraded":"2024-09-16T07:45:17.388638+0000","last_fullsized":"2024-09-16T07:45:17.388638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.497684+0000","last_change":"2024-09-16T07:45:51.507878+0000","last_active":"2024-09-16T07:45:51.497684+0000","last_peered":"2024-09-16T07:45:51.497684+0000","last_clean":"2024-09-16T07:45:51.497684+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:45:51.497684+0000","last_undegraded":"2024-09-16T07:45:51.497684+0000","last_fullsized":"2024-09-16T07:45:51.497684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":245760000,"num_objects":3750,"num_object_clones":0,"num_object_copies":11250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3750,"num_write_kb":240000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46706688,"data_stored":747307008,"data_compressed":35483537,"data_compressed_allocated":46706688,"data_compressed_original":747307008,"omap_allocated":0,"internal_metadata":0},"log_size":3754,"ondisk_log_size":3754,"up":36,"acting":36,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54596,"kb_used_data":15284,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317244,"statfs":{"total":96636764160,"available":96580857856,"internally_reserved":0,"allocated":15650816,"data_stored":246747760,"data_compressed":11714631,"data_compressed_allocated":15421440,"data_compressed_original":246661120,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":192512,"data_stored":624140,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52484,"kb_used_data":13172,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94319356,"statfs":{"total":96636764160,"available":96583020544,"internally_reserved":0,"allocated":13488128,"data_stored":212471907,"data_compressed":10085110,"data_compressed_allocated":13275136,"data_compressed_original":212402176,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":20,"seq":85899345949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59936,"kb_used_data":16208,"kb_used_omap":0,"kb_used_meta":43712,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":16596992,"data_stored":261821059,"data_compressed":12430614,"data_compressed_allocated":16363520,"data_compressed_original":261734400,"omap_allocated":0,"internal_metadata":44761088},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":268566528,"data_compressed":12752229,"data_compressed_allocated":16785408,"data_compressed_original":268566528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13873152,"data_stored":221970432,"data_compressed":10539462,"data_compressed_allocated":13873152,"data_compressed_original":221970432,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16048128,"data_stored":256770048,"data_compressed":12191846,"data_compressed_allocated":16048128,"data_compressed_original":256770048,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:17.498 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 58 16 6805 6789 7.31496 12 0.081727 0.136628 2024-09-16T07:46:17.498 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:17.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:17.638+0000 7fcfb366c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:17.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:17.649+0000 7fcfb366c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:18.498 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 59 16 6986 6970 7.3827 11.3125 0.0609904 0.135325 2024-09-16T07:46:19.498 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:46:19.500122+0000 min lat: 0.0163118 max lat: 23.4475 avg lat: 0.133928 2024-09-16T07:46:19.498 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:46:19.498 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 60 16 7179 7163 7.46067 12.0625 0.0575256 0.133928 2024-09-16T07:46:20.022 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:20.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:20.179+0000 7f3c5a911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:20.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:20.189+0000 7f3c5a911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:20.288 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:20.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:20.435+0000 7f5d19951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:20.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:20.449+0000 7f5d19951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:20.498 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 61 16 7356 7340 7.5197 11.0625 0.146939 0.132795 2024-09-16T07:46:20.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:20.791 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:20.810 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-16T07:46:20.301354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":360907304,"num_objects":5502,"num_object_clones":0,"num_object_copies":16506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5578,"num_write_kb":352979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5561,"ondisk_log_size":5561,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":217648,"kb_used_data":64044,"kb_used_omap":0,"kb_used_meta":153536,"kb_avail":377269712,"statfs":{"total":386547056640,"available":386324185088,"internally_reserved":0,"allocated":65581056,"data_stored":1034831833,"data_compressed":49128801,"data_compressed_allocated":64671744,"data_compressed_original":1034502144,"omap_allocated":0,"internal_metadata":157220864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":211419125,"num_objects":3226,"num_object_clones":0,"num_object_copies":9678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3225,"num_write_kb":206463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002644"},"pg_stats":[{"pgid":"3.f","version":"25'395","reported_seq":427,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:12.954045+0000","last_change":"2024-09-16T07:45:44.535560+0000","last_active":"2024-09-16T07:46:12.954045+0000","last_peered":"2024-09-16T07:46:12.954045+0000","last_clean":"2024-09-16T07:46:12.954045+0000","last_became_active":"2024-09-16T07:45:44.523789+0000","last_became_peered":"2024-09-16T07:45:44.523789+0000","last_unstale":"2024-09-16T07:46:12.954045+0000","last_undegraded":"2024-09-16T07:46:12.954045+0000","last_fullsized":"2024-09-16T07:46:12.954045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'429","reported_seq":452,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.486362+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:46:18.486362+0000","last_peered":"2024-09-16T07:46:18.486362+0000","last_clean":"2024-09-16T07:46:18.486362+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:46:18.486362+0000","last_undegraded":"2024-09-16T07:46:18.486362+0000","last_fullsized":"2024-09-16T07:46:18.486362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'267","reported_seq":301,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.074118+0000","last_change":"2024-09-16T07:45:44.531824+0000","last_active":"2024-09-16T07:46:05.074118+0000","last_peered":"2024-09-16T07:46:05.074118+0000","last_clean":"2024-09-16T07:46:05.074118+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:05.074118+0000","last_undegraded":"2024-09-16T07:46:05.074118+0000","last_fullsized":"2024-09-16T07:46:05.074118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17498112,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":17088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'342","reported_seq":375,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.292186+0000","last_change":"2024-09-16T07:45:50.902218+0000","last_active":"2024-09-16T07:46:13.292186+0000","last_peered":"2024-09-16T07:46:13.292186+0000","last_clean":"2024-09-16T07:46:13.292186+0000","last_became_active":"2024-09-16T07:45:50.691944+0000","last_became_peered":"2024-09-16T07:45:50.691944+0000","last_unstale":"2024-09-16T07:46:13.292186+0000","last_undegraded":"2024-09-16T07:46:13.292186+0000","last_fullsized":"2024-09-16T07:46:13.292186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'270","reported_seq":307,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.286482+0000","last_change":"2024-09-16T07:45:50.886832+0000","last_active":"2024-09-16T07:46:05.286482+0000","last_peered":"2024-09-16T07:46:05.286482+0000","last_clean":"2024-09-16T07:46:05.286482+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:05.286482+0000","last_undegraded":"2024-09-16T07:46:05.286482+0000","last_fullsized":"2024-09-16T07:46:05.286482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'355","reported_seq":381,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.308341+0000","last_change":"2024-09-16T07:45:50.666069+0000","last_active":"2024-09-16T07:46:13.308341+0000","last_peered":"2024-09-16T07:46:13.308341+0000","last_clean":"2024-09-16T07:46:13.308341+0000","last_became_active":"2024-09-16T07:45:50.653189+0000","last_became_peered":"2024-09-16T07:45:50.653189+0000","last_unstale":"2024-09-16T07:46:13.308341+0000","last_undegraded":"2024-09-16T07:46:13.308341+0000","last_fullsized":"2024-09-16T07:46:13.308341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'390","reported_seq":416,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.247682+0000","last_change":"2024-09-16T07:45:50.622899+0000","last_active":"2024-09-16T07:46:13.247682+0000","last_peered":"2024-09-16T07:46:13.247682+0000","last_clean":"2024-09-16T07:46:13.247682+0000","last_became_active":"2024-09-16T07:45:50.606399+0000","last_became_peered":"2024-09-16T07:45:50.606399+0000","last_unstale":"2024-09-16T07:46:13.247682+0000","last_undegraded":"2024-09-16T07:46:13.247682+0000","last_fullsized":"2024-09-16T07:46:13.247682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'269","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.007863+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:05.007863+0000","last_peered":"2024-09-16T07:46:05.007863+0000","last_clean":"2024-09-16T07:46:05.007863+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:05.007863+0000","last_undegraded":"2024-09-16T07:46:05.007863+0000","last_fullsized":"2024-09-16T07:46:05.007863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17629184,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":269,"num_write_kb":17216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.483345+0000","last_change":"2024-09-16T07:45:50.567248+0000","last_active":"2024-09-16T07:45:51.483345+0000","last_peered":"2024-09-16T07:45:51.483345+0000","last_clean":"2024-09-16T07:45:51.483345+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:45:51.483345+0000","last_undegraded":"2024-09-16T07:45:51.483345+0000","last_fullsized":"2024-09-16T07:45:51.483345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.497787+0000","last_change":"2024-09-16T07:45:51.505238+0000","last_active":"2024-09-16T07:45:51.497787+0000","last_peered":"2024-09-16T07:45:51.497787+0000","last_clean":"2024-09-16T07:45:51.497787+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:45:51.497787+0000","last_undegraded":"2024-09-16T07:45:51.497787+0000","last_fullsized":"2024-09-16T07:45:51.497787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'288","reported_seq":322,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.270154+0000","last_change":"2024-09-16T07:45:44.522728+0000","last_active":"2024-09-16T07:46:05.270154+0000","last_peered":"2024-09-16T07:46:05.270154+0000","last_clean":"2024-09-16T07:46:05.270154+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:05.270154+0000","last_undegraded":"2024-09-16T07:46:05.270154+0000","last_fullsized":"2024-09-16T07:46:05.270154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.513996+0000","last_change":"2024-09-16T07:45:51.521750+0000","last_active":"2024-09-16T07:45:51.513996+0000","last_peered":"2024-09-16T07:45:51.513996+0000","last_clean":"2024-09-16T07:45:51.513996+0000","last_became_active":"2024-09-16T07:45:50.665366+0000","last_became_peered":"2024-09-16T07:45:50.665366+0000","last_unstale":"2024-09-16T07:45:51.513996+0000","last_undegraded":"2024-09-16T07:45:51.513996+0000","last_fullsized":"2024-09-16T07:45:51.513996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'283","reported_seq":317,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.098297+0000","last_change":"2024-09-16T07:45:44.540876+0000","last_active":"2024-09-16T07:46:05.098297+0000","last_peered":"2024-09-16T07:46:05.098297+0000","last_clean":"2024-09-16T07:46:05.098297+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:05.098297+0000","last_undegraded":"2024-09-16T07:46:05.098297+0000","last_fullsized":"2024-09-16T07:46:05.098297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18546688,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.491482+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:45:51.491482+0000","last_peered":"2024-09-16T07:45:51.491482+0000","last_clean":"2024-09-16T07:45:51.491482+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:45:51.491482+0000","last_undegraded":"2024-09-16T07:45:51.491482+0000","last_fullsized":"2024-09-16T07:45:51.491482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'280","reported_seq":321,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.004625+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:05.004625+0000","last_peered":"2024-09-16T07:46:05.004625+0000","last_clean":"2024-09-16T07:46:05.004625+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:05.004625+0000","last_undegraded":"2024-09-16T07:46:05.004625+0000","last_fullsized":"2024-09-16T07:46:05.004625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":17920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.511360+0000","last_change":"2024-09-16T07:45:51.520543+0000","last_active":"2024-09-16T07:45:51.511360+0000","last_peered":"2024-09-16T07:45:51.511360+0000","last_clean":"2024-09-16T07:45:51.511360+0000","last_became_active":"2024-09-16T07:45:50.656425+0000","last_became_peered":"2024-09-16T07:45:50.656425+0000","last_unstale":"2024-09-16T07:45:51.511360+0000","last_undegraded":"2024-09-16T07:45:51.511360+0000","last_fullsized":"2024-09-16T07:45:51.511360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'440","reported_seq":463,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.600917+0000","last_change":"2024-09-16T07:45:50.662284+0000","last_active":"2024-09-16T07:46:18.600917+0000","last_peered":"2024-09-16T07:46:18.600917+0000","last_clean":"2024-09-16T07:46:18.600917+0000","last_became_active":"2024-09-16T07:45:50.648809+0000","last_became_peered":"2024-09-16T07:45:50.648809+0000","last_unstale":"2024-09-16T07:46:18.600917+0000","last_undegraded":"2024-09-16T07:46:18.600917+0000","last_fullsized":"2024-09-16T07:46:18.600917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"25'318","reported_seq":352,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:04.948700+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:04.948700+0000","last_peered":"2024-09-16T07:46:04.948700+0000","last_clean":"2024-09-16T07:46:04.948700+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:04.948700+0000","last_undegraded":"2024-09-16T07:46:04.948700+0000","last_fullsized":"2024-09-16T07:46:04.948700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20840448,"num_objects":318,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.521563+0000","last_change":"2024-09-16T07:45:51.528912+0000","last_active":"2024-09-16T07:45:51.521563+0000","last_peered":"2024-09-16T07:45:51.521563+0000","last_clean":"2024-09-16T07:45:51.521563+0000","last_became_active":"2024-09-16T07:45:50.632911+0000","last_became_peered":"2024-09-16T07:45:50.632911+0000","last_unstale":"2024-09-16T07:45:51.521563+0000","last_undegraded":"2024-09-16T07:45:51.521563+0000","last_fullsized":"2024-09-16T07:45:51.521563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'447","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.755658+0000","last_change":"2024-09-16T07:45:50.704395+0000","last_active":"2024-09-16T07:46:18.755658+0000","last_peered":"2024-09-16T07:46:18.755658+0000","last_clean":"2024-09-16T07:46:18.755658+0000","last_became_active":"2024-09-16T07:45:50.690192+0000","last_became_peered":"2024-09-16T07:45:50.690192+0000","last_unstale":"2024-09-16T07:46:18.755658+0000","last_undegraded":"2024-09-16T07:46:18.755658+0000","last_fullsized":"2024-09-16T07:46:18.755658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29229056,"num_objects":446,"num_object_clones":0,"num_object_copies":1338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":446,"num_write_kb":28544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.494227+0000","last_change":"2024-09-16T07:45:51.499250+0000","last_active":"2024-09-16T07:45:51.494227+0000","last_peered":"2024-09-16T07:45:51.494227+0000","last_clean":"2024-09-16T07:45:51.494227+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:45:51.494227+0000","last_undegraded":"2024-09-16T07:45:51.494227+0000","last_fullsized":"2024-09-16T07:45:51.494227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'297","reported_seq":331,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:05.289324+0000","last_change":"2024-09-16T07:45:44.552616+0000","last_active":"2024-09-16T07:46:05.289324+0000","last_peered":"2024-09-16T07:46:05.289324+0000","last_clean":"2024-09-16T07:46:05.289324+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:05.289324+0000","last_undegraded":"2024-09-16T07:46:05.289324+0000","last_fullsized":"2024-09-16T07:46:05.289324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":19008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.524259+0000","last_change":"2024-09-16T07:45:51.527842+0000","last_active":"2024-09-16T07:45:51.524259+0000","last_peered":"2024-09-16T07:45:51.524259+0000","last_clean":"2024-09-16T07:45:51.524259+0000","last_became_active":"2024-09-16T07:45:50.692633+0000","last_became_peered":"2024-09-16T07:45:50.692633+0000","last_unstale":"2024-09-16T07:45:51.524259+0000","last_undegraded":"2024-09-16T07:45:51.524259+0000","last_fullsized":"2024-09-16T07:45:51.524259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"25'436","reported_seq":459,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.679738+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:46:18.679738+0000","last_peered":"2024-09-16T07:46:18.679738+0000","last_clean":"2024-09-16T07:46:18.679738+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:46:18.679738+0000","last_undegraded":"2024-09-16T07:46:18.679738+0000","last_fullsized":"2024-09-16T07:46:18.679738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.497684+0000","last_change":"2024-09-16T07:45:51.507878+0000","last_active":"2024-09-16T07:45:51.497684+0000","last_peered":"2024-09-16T07:45:51.497684+0000","last_clean":"2024-09-16T07:45:51.497684+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:45:51.497684+0000","last_undegraded":"2024-09-16T07:45:51.497684+0000","last_fullsized":"2024-09-16T07:45:51.497684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":360316928,"num_objects":5498,"num_object_clones":0,"num_object_copies":16494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5498,"num_write_kb":351872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":66428928,"data_stored":1062862848,"data_compressed":50467086,"data_compressed_allocated":66428928,"data_compressed_original":1062862848,"omap_allocated":0,"internal_metadata":0},"log_size":5506,"ondisk_log_size":5506,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54596,"kb_used_data":15284,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317244,"statfs":{"total":96636764160,"available":96580857856,"internally_reserved":0,"allocated":15650816,"data_stored":246747760,"data_compressed":11714631,"data_compressed_allocated":15421440,"data_compressed_original":246661120,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50632,"kb_used_data":19380,"kb_used_omap":0,"kb_used_meta":31232,"kb_avail":94321208,"statfs":{"total":96636764160,"available":96584916992,"internally_reserved":0,"allocated":19845120,"data_stored":313791107,"data_compressed":14898446,"data_compressed_allocated":19611648,"data_compressed_original":313704448,"omap_allocated":0,"internal_metadata":31981568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52484,"kb_used_data":13172,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94319356,"statfs":{"total":96636764160,"available":96583020544,"internally_reserved":0,"allocated":13488128,"data_stored":212471907,"data_compressed":10085110,"data_compressed_allocated":13275136,"data_compressed_original":212402176,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":20,"seq":85899345949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59936,"kb_used_data":16208,"kb_used_omap":0,"kb_used_meta":43712,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":16596992,"data_stored":261821059,"data_compressed":12430614,"data_compressed_allocated":16363520,"data_compressed_original":261734400,"omap_allocated":0,"internal_metadata":44761088},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":268566528,"data_compressed":12752229,"data_compressed_allocated":16785408,"data_compressed_original":268566528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13873152,"data_stored":221970432,"data_compressed":10539462,"data_compressed_allocated":13873152,"data_compressed_original":221970432,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19722240,"data_stored":315555840,"data_compressed":14983549,"data_compressed_allocated":19722240,"data_compressed_original":315555840,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16048128,"data_stored":256770048,"data_compressed":12191846,"data_compressed_allocated":16048128,"data_compressed_original":256770048,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:20.812 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:46:20.812 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:46:20.812 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [1, 3, 0, 2] 2024-09-16T07:46:20.812 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T07:46:20.813 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:46:20.887 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T07:46:21.498 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 62 16 7422 7406 7.46494 4.125 0.0174045 0.132406 2024-09-16T07:46:22.499 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 63 16 7422 7406 7.34644 0 - 0.132406 2024-09-16T07:46:22.540 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:22.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:22.674+0000 7fe13e0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:22.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:22.680+0000 7fe13e0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:23.499 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 64 16 7422 7406 7.23164 0 - 0.132406 2024-09-16T07:46:24.499 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 65 16 7422 7406 7.12038 0 - 0.132406 2024-09-16T07:46:25.499 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 66 16 7422 7406 7.01249 0 - 0.132406 2024-09-16T07:46:25.888 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [1, 3, 2] 2024-09-16T07:46:25.889 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:46:25.889 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-16T07:46:25.889 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:46:25.890 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T07:46:25.893 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:46:25.893 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:46:26.008 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:46:26.011 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:26.012 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:46:26.499 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 67 16 7422 7406 6.90783 0 - 0.132406 2024-09-16T07:46:27.499 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 68 16 7422 7406 6.80624 0 - 0.132406 2024-09-16T07:46:28.499 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 69 16 7422 7406 6.7076 0 - 0.132406 2024-09-16T07:46:29.499 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 70 16 7422 7406 6.61178 0 - 0.132406 2024-09-16T07:46:30.500 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 71 16 7422 7406 6.51866 0 - 0.132406 2024-09-16T07:46:31.013 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:46:31.117 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:46:31.120 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:31.121 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:46:31.500 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 72 16 7422 7406 6.42812 0 - 0.132406 2024-09-16T07:46:32.500 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 73 16 7422 7406 6.34006 0 - 0.132406 2024-09-16T07:46:33.500 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 74 16 7422 7406 6.25438 0 - 0.132406 2024-09-16T07:46:33.559 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:46:33.746 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:46:33.747 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:46:34.500 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 75 16 7422 7406 6.17099 0 - 0.132406 2024-09-16T07:46:35.500 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 76 16 7422 7406 6.08979 0 - 0.132406 2024-09-16T07:46:35.748 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:35.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:35.889+0000 7fec116d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:35.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:35.898+0000 7fec116d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:36.121 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:46:36.319 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T07:46:36.319 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [ 2024-09-16T07:46:36.319 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.319 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.319 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777290, 2024-09-16T07:46:36.319 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.319 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.319 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.262173+0000" 2024-09-16T07:46:36.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.321 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.262187+0000" 2024-09-16T07:46:36.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.321 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.321 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.262407+0000" 2024-09-16T07:46:36.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.322 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.322 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.322 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.322 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.322 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.322 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.322 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.323 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.262584+0000" 2024-09-16T07:46:36.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.323 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.323 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.323 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.323 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.269932+0000" 2024-09-16T07:46:36.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.323 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.324 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.324 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.324 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.325 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.325 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.325 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.325 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.325 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.271084+0000" 2024-09-16T07:46:36.325 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.325 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.325 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.325 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.325 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.325 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.325 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.325 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.326 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.326 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.272936+0000" 2024-09-16T07:46:36.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.326 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.327 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.327 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.327 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.327 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.327 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.327 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.328 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.328 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.328 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.329 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.329 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.274195+0000" 2024-09-16T07:46:36.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.329 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.329 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.329 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.329 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.329 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.330 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.330 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.330 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.330 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.330 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.330 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.330 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.278672+0000" 2024-09-16T07:46:36.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.331 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.331 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.331 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.332 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.332 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.332 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.332 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.332 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.332 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.332 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.332 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.333 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.333 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.333 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "replicated_request", 2024-09-16T07:46:36.333 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 222, 2024-09-16T07:46:36.333 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.333 INFO:teuthology.orchestra.run.smithi003.stdout: "RepRequest": { 2024-09-16T07:46:36.333 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.4238.0:7463", 2024-09-16T07:46:36.333 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "3.1", 2024-09-16T07:46:36.333 INFO:teuthology.orchestra.run.smithi003.stdout: "map_epoch": 28, 2024-09-16T07:46:36.333 INFO:teuthology.orchestra.run.smithi003.stdout: "min_epoch": 27, 2024-09-16T07:46:36.333 INFO:teuthology.orchestra.run.smithi003.stdout: "oid": "3:83c937c1:::benchmark_data_smithi003_30169_object7462:head", 2024-09-16T07:46:36.333 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "3" 2024-09-16T07:46:36.333 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.334 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.334 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.334 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.334 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777269, 2024-09-16T07:46:36.334 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.334 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.334 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.334 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.046817+0000" 2024-09-16T07:46:36.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.334 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.334 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.334 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.046842+0000" 2024-09-16T07:46:36.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.335 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.335 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.335 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.335 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.047021+0000" 2024-09-16T07:46:36.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.335 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.335 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.335 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.336 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.336 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.336 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.336 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.336 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.047154+0000" 2024-09-16T07:46:36.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.336 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.337 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.337 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.337 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.047475+0000" 2024-09-16T07:46:36.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.337 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.338 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.338 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.338 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.338 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.338 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.338 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.339 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.049837+0000" 2024-09-16T07:46:36.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.339 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.339 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.339 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.048202+0000" 2024-09-16T07:46:36.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.339 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.339 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.339 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.339 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.339 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.339 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.340 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.340 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.048542+0000" 2024-09-16T07:46:36.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.340 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.341 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.341 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.341 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.341 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.341 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.341 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.341 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.342 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.342 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.342 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.049224+0000" 2024-09-16T07:46:36.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.343 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.343 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.343 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.343 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.343 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.343 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.343 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.343 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.343 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.344 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.344 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.344 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.344 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.344 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.344 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.345 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.345 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.345 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.345 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.345 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.346 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.346 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.346 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.347 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.347 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.347 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.347 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.347 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.347 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777271, 2024-09-16T07:46:36.347 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.347 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.348 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.051308+0000" 2024-09-16T07:46:36.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.348 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.348 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.348 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.051327+0000" 2024-09-16T07:46:36.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.348 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.348 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.348 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.348 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.349 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.051668+0000" 2024-09-16T07:46:36.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.349 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.349 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.349 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.349 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.349 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.350 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.051897+0000" 2024-09-16T07:46:36.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.350 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.350 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.053288+0000" 2024-09-16T07:46:36.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.351 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.351 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.351 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.351 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.351 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.351 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.352 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.352 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.055024+0000" 2024-09-16T07:46:36.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.352 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.352 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.053737+0000" 2024-09-16T07:46:36.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.352 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.352 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.353 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.353 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.353 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.053936+0000" 2024-09-16T07:46:36.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.353 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.354 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.354 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.354 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.354 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.354 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.354 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.356 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.356 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.054354+0000" 2024-09-16T07:46:36.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.356 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.356 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.356 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.356 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.357 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.357 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.357 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.357 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.358 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.358 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.358 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.358 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.358 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.358 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.359 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.359 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.359 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.360 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.360 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.360 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.360 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.360 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777275, 2024-09-16T07:46:36.360 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.360 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.360 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.058218+0000" 2024-09-16T07:46:36.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.360 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.361 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.058227+0000" 2024-09-16T07:46:36.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.361 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.361 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.361 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.361 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.058342+0000" 2024-09-16T07:46:36.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.361 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.362 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.362 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.362 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.058555+0000" 2024-09-16T07:46:36.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.363 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.363 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.062711+0000" 2024-09-16T07:46:36.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.363 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.364 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.364 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.364 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.364 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.364 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.364 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.168768+0000" 2024-09-16T07:46:36.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.364 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.063691+0000" 2024-09-16T07:46:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.366 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.366 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.065100+0000" 2024-09-16T07:46:36.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.366 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.366 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.366 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.366 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.367 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.367 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.367 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.367 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.367 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.367 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.367 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.368 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.368 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.368 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.368 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.368 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.068459+0000" 2024-09-16T07:46:36.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.368 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.369 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.369 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.369 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.369 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.369 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.369 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.370 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.370 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.075246+0000" 2024-09-16T07:46:36.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.370 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.371 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.371 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.371 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.371 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.371 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.371 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.165642+0000" 2024-09-16T07:46:36.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.371 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.372 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.372 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.372 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.372 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.372 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.372 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.372 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.372 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777274, 2024-09-16T07:46:36.372 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.373 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.373 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.057003+0000" 2024-09-16T07:46:36.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.373 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.373 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.057022+0000" 2024-09-16T07:46:36.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.373 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.373 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.373 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.374 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.057269+0000" 2024-09-16T07:46:36.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.374 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.374 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.374 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.374 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.374 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.375 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.375 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.375 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.057552+0000" 2024-09-16T07:46:36.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.375 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.375 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.375 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.057955+0000" 2024-09-16T07:46:36.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.376 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.376 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.376 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.377 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.377 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.377 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.173033+0000" 2024-09-16T07:46:36.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.377 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.377 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.058630+0000" 2024-09-16T07:46:36.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.377 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.378 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.378 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.378 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.058960+0000" 2024-09-16T07:46:36.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.379 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.379 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.379 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.379 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.380 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.380 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.380 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.380 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.380 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.380 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.381 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.381 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.381 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.059604+0000" 2024-09-16T07:46:36.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.381 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.381 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.381 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.381 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.382 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.382 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.382 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.382 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.382 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.382 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.382 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.382 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.382 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.382 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.382 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.382 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.382 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.383 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.061830+0000" 2024-09-16T07:46:36.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.383 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.383 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.383 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.383 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.383 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.384 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.384 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.384 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.169311+0000" 2024-09-16T07:46:36.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.384 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.384 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.384 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.385 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.385 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.385 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.385 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.385 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.385 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777278, 2024-09-16T07:46:36.386 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.386 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.386 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.069031+0000" 2024-09-16T07:46:36.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.386 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.386 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.069043+0000" 2024-09-16T07:46:36.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.386 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.386 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.387 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.387 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.069196+0000" 2024-09-16T07:46:36.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.387 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.387 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.387 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.387 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.387 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.388 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.388 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.388 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.069314+0000" 2024-09-16T07:46:36.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.388 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.388 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.388 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.389 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.073979+0000" 2024-09-16T07:46:36.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.389 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.389 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.389 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.389 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.389 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.389 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.389 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.389 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.389 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.390 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.390 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.390 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.188899+0000" 2024-09-16T07:46:36.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.390 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.390 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.390 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.074664+0000" 2024-09-16T07:46:36.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.390 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.390 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.390 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.391 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.391 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.391 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.391 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.391 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.391 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.075685+0000" 2024-09-16T07:46:36.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.391 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.392 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.392 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.392 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.392 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.392 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.392 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.393 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.393 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.393 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.393 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.393 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.393 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.393 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.394 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.394 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.394 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.077687+0000" 2024-09-16T07:46:36.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.394 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.394 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.394 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.394 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.394 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.394 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.395 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.395 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.395 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.395 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.395 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.395 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.395 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.396 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.096541+0000" 2024-09-16T07:46:36.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.396 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.396 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.396 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.396 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.396 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.397 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.397 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.397 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.397 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.186565+0000" 2024-09-16T07:46:36.397 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.397 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.397 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.397 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.397 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.397 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.398 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.398 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.398 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.398 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.398 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777279, 2024-09-16T07:46:36.398 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.398 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.398 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.398 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.069738+0000" 2024-09-16T07:46:36.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.398 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.399 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.069746+0000" 2024-09-16T07:46:36.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.399 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.399 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.399 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.399 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.069885+0000" 2024-09-16T07:46:36.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.399 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.399 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.400 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.400 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.400 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.400 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.400 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.400 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.400 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.400 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.400 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.070010+0000" 2024-09-16T07:46:36.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.401 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.401 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.401 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.401 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.076869+0000" 2024-09-16T07:46:36.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.401 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.401 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.401 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.402 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.402 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.402 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.402 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.402 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.217766+0000" 2024-09-16T07:46:36.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.402 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.403 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.079197+0000" 2024-09-16T07:46:36.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.403 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.403 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.403 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.403 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.403 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.403 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.404 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.404 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.404 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.085775+0000" 2024-09-16T07:46:36.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.404 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.404 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.404 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.404 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.404 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.404 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.405 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.405 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.405 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.405 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.405 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.405 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.405 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.405 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.405 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.405 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.406 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.406 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.406 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.406 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.406 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.089279+0000" 2024-09-16T07:46:36.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.406 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.406 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.407 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.408 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.408 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.408 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.408 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.408 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.102443+0000" 2024-09-16T07:46:36.408 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.408 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.408 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.408 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.408 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.408 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.408 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.409 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.409 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.409 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.409 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.409 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.409 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.409 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.216209+0000" 2024-09-16T07:46:36.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.409 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.410 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.410 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.410 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.410 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.410 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.410 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.410 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.410 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777281, 2024-09-16T07:46:36.410 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.410 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.411 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.076854+0000" 2024-09-16T07:46:36.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.411 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.411 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.076865+0000" 2024-09-16T07:46:36.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.411 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.411 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.411 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.411 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.076997+0000" 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.413 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.077121+0000" 2024-09-16T07:46:36.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.413 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.413 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.413 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.413 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.085591+0000" 2024-09-16T07:46:36.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.413 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.414 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.414 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.414 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.414 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.417 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.417 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.417 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.417 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.231618+0000" 2024-09-16T07:46:36.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.417 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.417 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.090108+0000" 2024-09-16T07:46:36.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.418 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.418 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.418 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.418 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.418 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.418 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.419 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.419 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.093571+0000" 2024-09-16T07:46:36.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.419 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.419 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.419 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.419 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.420 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.420 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.420 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.420 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.420 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.420 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.420 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.421 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.421 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.421 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.421 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.421 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.097792+0000" 2024-09-16T07:46:36.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.421 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.421 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.422 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.422 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.422 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.422 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.422 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.422 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.422 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.422 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.422 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.423 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.423 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.423 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.423 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.116020+0000" 2024-09-16T07:46:36.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.423 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.423 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.423 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.424 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.424 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.424 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.424 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.424 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.424 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.424 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.424 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.424 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.424 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.228064+0000" 2024-09-16T07:46:36.424 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.424 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.424 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.425 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.425 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.425 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.425 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.425 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.425 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.425 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.425 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.425 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.425 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.425 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777282, 2024-09-16T07:46:36.425 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.425 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.426 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.077730+0000" 2024-09-16T07:46:36.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.426 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.426 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.077738+0000" 2024-09-16T07:46:36.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.426 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.426 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.426 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.427 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.077942+0000" 2024-09-16T07:46:36.427 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.427 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.427 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.427 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.427 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.427 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.427 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.427 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.427 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.427 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.427 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.427 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.428 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.428 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.428 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.428 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.078059+0000" 2024-09-16T07:46:36.428 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.428 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.428 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.428 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.428 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.428 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.428 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.428 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.089255+0000" 2024-09-16T07:46:36.428 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.429 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.429 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.429 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.429 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.429 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.429 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.429 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.430 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.235705+0000" 2024-09-16T07:46:36.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.430 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.430 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.094119+0000" 2024-09-16T07:46:36.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.430 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.430 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.430 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.431 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.431 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.431 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.431 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.431 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.095619+0000" 2024-09-16T07:46:36.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.431 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.431 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.432 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.432 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.432 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.432 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.432 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.432 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.433 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.433 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.433 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.433 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.433 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.433 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.433 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.433 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.433 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.433 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.434 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.103599+0000" 2024-09-16T07:46:36.434 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.434 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.434 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.434 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.434 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.434 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.434 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.434 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.434 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.434 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.434 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.434 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.435 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.435 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.435 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.435 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.435 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.435 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.126132+0000" 2024-09-16T07:46:36.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.436 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.436 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.436 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.436 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.436 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.436 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.436 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.436 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.436 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.437 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.437 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.437 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.234831+0000" 2024-09-16T07:46:36.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.437 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.437 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.437 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.437 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.437 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.437 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.437 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.437 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.438 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.438 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.438 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777287, 2024-09-16T07:46:36.438 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.438 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.438 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.190402+0000" 2024-09-16T07:46:36.438 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.438 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.438 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.190421+0000" 2024-09-16T07:46:36.438 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.438 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.439 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.439 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.439 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.190593+0000" 2024-09-16T07:46:36.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.439 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.439 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.439 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.440 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.440 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.440 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.440 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.440 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.440 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.440 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.190708+0000" 2024-09-16T07:46:36.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.440 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.440 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.440 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.441 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.441 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.441 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.441 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.191202+0000" 2024-09-16T07:46:36.441 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.441 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.441 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.441 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.441 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.441 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.441 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.441 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.441 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.442 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.442 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.442 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.442 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.442 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.238208+0000" 2024-09-16T07:46:36.442 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.442 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.442 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.191655+0000" 2024-09-16T07:46:36.442 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.442 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.443 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.443 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.443 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.443 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.443 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.443 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.444 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.191909+0000" 2024-09-16T07:46:36.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.444 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.444 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.444 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.444 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.444 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.444 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.444 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.444 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.445 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.445 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.445 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.445 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.445 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.445 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.445 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.445 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.445 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.445 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.446 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.446 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.446 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.446 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.446 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.446 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.446 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.446 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.192987+0000" 2024-09-16T07:46:36.446 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.446 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.446 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.446 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.446 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.447 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.447 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.447 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.447 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.447 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.447 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.448 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.448 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.448 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.448 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.196129+0000" 2024-09-16T07:46:36.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.448 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.448 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.448 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.449 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.449 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.449 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.449 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.449 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.236747+0000" 2024-09-16T07:46:36.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.449 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.449 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.450 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.450 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.450 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.450 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.450 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.450 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.450 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.450 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.450 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777283, 2024-09-16T07:46:36.450 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.450 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.451 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.079077+0000" 2024-09-16T07:46:36.451 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.451 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.451 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.079086+0000" 2024-09-16T07:46:36.451 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.451 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.451 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.451 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.451 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.451 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.079207+0000" 2024-09-16T07:46:36.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.452 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.452 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.452 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.452 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.452 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.452 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.452 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.452 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.452 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.453 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.453 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.453 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.079320+0000" 2024-09-16T07:46:36.453 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.453 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.453 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.453 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.453 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.453 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.453 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.453 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.092385+0000" 2024-09-16T07:46:36.453 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.453 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.454 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.454 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.454 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.454 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.454 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.454 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.455 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.239220+0000" 2024-09-16T07:46:36.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.455 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.455 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.098493+0000" 2024-09-16T07:46:36.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.455 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.455 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.455 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.455 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.456 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.456 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.456 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.456 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.456 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.456 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.103983+0000" 2024-09-16T07:46:36.456 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.456 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.456 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.457 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.457 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.457 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.457 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.457 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.457 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.457 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.457 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.457 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.458 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.458 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.458 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.458 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.458 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.458 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.458 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.458 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.458 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.458 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.459 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.459 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.116061+0000" 2024-09-16T07:46:36.459 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.459 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.459 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.459 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.459 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.459 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.459 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.459 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.459 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.459 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.459 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.460 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.460 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.460 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.460 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.460 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.460 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.460 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.460 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.460 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.460 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.460 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.460 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.460 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.133774+0000" 2024-09-16T07:46:36.461 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.461 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.461 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.461 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.461 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.461 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.461 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.461 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.461 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.461 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.461 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.461 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.461 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.462 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.462 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.462 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.238362+0000" 2024-09-16T07:46:36.462 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.462 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.462 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.462 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.462 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.462 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.462 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.462 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.462 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.462 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.463 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.463 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.463 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.463 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777284, 2024-09-16T07:46:36.463 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.463 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.463 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.463 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.082847+0000" 2024-09-16T07:46:36.463 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.463 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.463 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.463 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.082867+0000" 2024-09-16T07:46:36.463 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.463 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.464 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.464 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.464 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.464 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.464 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.464 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.083361+0000" 2024-09-16T07:46:36.464 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.464 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.464 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.464 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.464 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.464 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.464 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.465 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.465 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.465 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.465 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.465 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.465 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.465 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.465 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.465 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.083473+0000" 2024-09-16T07:46:36.465 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.465 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.465 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.465 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.466 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.466 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.466 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.466 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.093309+0000" 2024-09-16T07:46:36.466 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.466 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.466 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.466 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.466 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.466 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.466 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.466 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.466 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.466 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.467 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.467 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.467 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.467 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.467 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.467 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.246413+0000" 2024-09-16T07:46:36.467 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.467 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.467 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.467 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.108746+0000" 2024-09-16T07:46:36.467 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.467 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.467 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.468 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.468 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.468 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.468 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.468 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.468 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.468 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.468 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.468 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.468 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.468 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.468 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.468 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.112433+0000" 2024-09-16T07:46:36.469 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.469 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.469 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.469 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.469 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.469 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.469 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.469 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.469 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.469 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.469 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.469 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.469 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.469 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.470 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.470 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.470 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.470 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.470 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.470 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.118208+0000" 2024-09-16T07:46:36.470 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.470 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.470 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.470 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.470 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.470 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.470 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.471 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.471 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.471 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.471 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.471 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.119454+0000" 2024-09-16T07:46:36.471 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.471 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.471 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.471 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.471 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.471 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.471 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.471 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.471 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.472 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.472 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.472 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.472 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.472 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.472 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.472 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.472 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.472 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.472 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.472 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.130537+0000" 2024-09-16T07:46:36.472 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.473 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.473 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.473 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.139108+0000" 2024-09-16T07:46:36.473 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.473 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.473 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.473 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.473 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.473 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.473 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.473 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.473 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.473 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.473 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.474 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.474 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.474 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.474 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.474 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.244147+0000" 2024-09-16T07:46:36.474 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.474 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.474 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.474 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.474 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.474 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.474 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.474 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.475 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.475 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.475 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.475 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.475 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.475 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777288, 2024-09-16T07:46:36.475 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.475 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.475 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.475 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.207258+0000" 2024-09-16T07:46:36.475 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.475 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.475 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.475 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.207279+0000" 2024-09-16T07:46:36.476 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.476 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.476 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.476 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.476 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.476 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.476 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.476 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.207481+0000" 2024-09-16T07:46:36.476 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.476 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.476 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.476 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.477 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.477 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.477 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.477 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.477 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.477 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.477 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.477 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.477 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.477 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.477 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.477 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.207593+0000" 2024-09-16T07:46:36.477 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.477 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.478 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.478 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.478 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.478 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.478 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.478 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.210119+0000" 2024-09-16T07:46:36.478 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.478 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.478 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.478 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.478 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.478 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.478 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.479 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.479 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.479 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.479 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.479 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.479 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.479 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.479 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.479 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.247428+0000" 2024-09-16T07:46:36.479 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.479 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.479 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.479 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.211193+0000" 2024-09-16T07:46:36.479 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.480 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.480 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.480 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.480 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.480 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.480 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.480 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.480 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.481 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.481 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.481 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.481 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.481 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.481 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.481 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.213199+0000" 2024-09-16T07:46:36.481 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.481 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.481 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.481 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.481 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.482 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.482 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.482 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.482 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.482 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.482 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.482 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.482 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.482 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.482 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.483 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.483 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.483 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.483 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.483 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.483 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.483 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.483 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.483 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.483 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.483 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.483 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.483 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.484 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.484 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.484 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.484 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.213731+0000" 2024-09-16T07:46:36.484 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.484 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.484 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.484 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.484 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.484 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.484 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.484 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.485 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.485 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.485 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.485 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.485 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.485 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.485 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.485 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.485 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.485 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.485 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.485 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.485 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.486 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.486 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.486 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.217297+0000" 2024-09-16T07:46:36.486 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.486 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.486 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.486 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.486 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.486 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.486 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.486 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.486 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.486 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.486 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.487 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.487 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.487 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.487 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.487 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.244897+0000" 2024-09-16T07:46:36.487 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.487 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.487 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.487 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.487 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.487 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.487 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.487 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.488 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.488 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.488 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.488 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.488 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.488 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777286, 2024-09-16T07:46:36.488 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.488 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.488 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.488 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.172205+0000" 2024-09-16T07:46:36.488 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.488 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.488 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.489 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.172228+0000" 2024-09-16T07:46:36.489 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.489 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.489 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.489 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.489 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.489 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.489 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.489 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.172425+0000" 2024-09-16T07:46:36.489 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.489 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.489 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.489 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.489 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.490 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.490 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.490 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.490 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.490 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.490 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.490 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.490 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.490 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.490 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.490 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.172622+0000" 2024-09-16T07:46:36.490 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.490 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.491 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.491 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.491 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.491 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.491 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.491 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.175164+0000" 2024-09-16T07:46:36.491 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.491 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.491 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.491 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.491 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.491 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.491 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.492 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.492 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.492 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.492 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.492 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.492 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.492 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.492 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.492 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.262564+0000" 2024-09-16T07:46:36.492 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.492 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.492 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.492 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.175617+0000" 2024-09-16T07:46:36.492 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.493 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.493 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.493 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.493 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.493 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.493 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.493 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.493 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.493 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.493 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.493 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.493 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.493 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.494 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.494 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.176693+0000" 2024-09-16T07:46:36.494 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.494 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.494 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.494 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.494 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.494 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.494 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.494 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.494 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.494 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.495 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.495 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.495 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.495 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.495 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.495 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.495 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.495 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.495 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.495 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.495 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.495 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.495 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.496 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.496 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.496 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.496 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.496 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.496 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.496 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.496 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.496 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.177539+0000" 2024-09-16T07:46:36.496 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.496 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.496 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.497 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.497 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.497 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.497 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.497 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.497 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.497 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.497 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.497 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.497 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.497 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.497 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.497 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.498 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.498 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.498 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.498 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.498 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.498 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.498 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.498 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.180049+0000" 2024-09-16T07:46:36.498 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.498 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.498 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.498 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.498 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.499 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.499 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.499 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.499 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.499 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.499 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.499 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.499 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.499 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.499 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.499 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.257765+0000" 2024-09-16T07:46:36.499 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.499 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.499 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.500 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.500 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.500 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.500 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.500 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.500 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.500 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.500 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.500 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.500 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.500 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777270, 2024-09-16T07:46:36.500 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.500 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.047770+0000" 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.047782+0000" 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.502 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.048047+0000" 2024-09-16T07:46:36.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.502 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.502 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.502 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.502 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.502 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.502 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.502 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.502 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.502 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.503 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.503 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.503 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.048225+0000" 2024-09-16T07:46:36.503 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.503 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.503 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.503 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.503 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.503 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.503 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.503 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.048347+0000" 2024-09-16T07:46:36.503 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.503 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.504 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.504 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.504 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.504 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.504 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.504 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.504 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.504 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.504 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.504 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.504 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.504 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.504 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.505 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.050646+0000" 2024-09-16T07:46:36.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.505 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.505 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.505 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.048917+0000" 2024-09-16T07:46:36.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.505 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.505 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.505 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.505 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.505 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.505 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.506 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.506 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.506 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.506 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.506 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.506 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.506 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.506 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.049131+0000" 2024-09-16T07:46:36.506 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.506 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.506 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.506 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.506 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.506 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.507 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.507 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.507 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.507 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.507 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.507 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.507 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.507 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.507 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.507 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.507 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.507 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.508 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.508 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.508 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.508 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.508 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.508 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.508 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.508 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.508 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.508 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.508 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.508 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.509 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.509 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.049759+0000" 2024-09-16T07:46:36.509 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.509 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.509 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.509 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.509 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.509 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.509 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.509 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.509 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.509 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.509 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.510 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.510 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.510 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.510 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.510 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.510 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.510 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.510 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.510 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.510 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.510 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.510 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.510 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.511 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.511 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.511 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.511 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.511 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.511 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.511 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.511 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.511 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.511 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.511 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.511 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.511 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.512 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.512 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.512 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.512 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.512 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.512 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.512 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.512 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.512 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.512 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.512 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.512 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.512 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.513 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.513 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.513 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.513 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777273, 2024-09-16T07:46:36.513 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.513 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.513 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.513 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.053687+0000" 2024-09-16T07:46:36.513 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.513 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.513 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.513 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.053700+0000" 2024-09-16T07:46:36.513 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.514 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.514 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.514 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.514 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.514 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.514 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.514 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.053931+0000" 2024-09-16T07:46:36.514 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.514 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.514 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.514 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.514 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.514 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.515 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.515 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.515 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.515 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.515 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.515 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.515 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.515 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.515 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.515 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.054148+0000" 2024-09-16T07:46:36.515 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.515 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.515 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.515 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.516 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.516 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.516 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.516 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.054399+0000" 2024-09-16T07:46:36.516 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.516 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.516 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.516 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.516 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.516 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.516 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.516 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.516 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.517 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.517 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.517 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.517 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.517 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.517 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.517 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.179136+0000" 2024-09-16T07:46:36.517 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.517 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.517 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.517 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.054970+0000" 2024-09-16T07:46:36.517 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.517 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.518 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.518 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.518 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.518 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.518 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.518 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.518 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.518 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.518 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.518 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.518 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.518 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.518 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.519 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.055381+0000" 2024-09-16T07:46:36.519 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.519 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.519 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.519 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.519 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.519 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.519 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.519 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.519 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.519 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.519 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.519 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.520 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.520 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.520 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.520 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.520 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.520 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.520 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.520 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.520 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.521 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.521 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.521 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.521 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.521 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.521 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.521 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.055865+0000" 2024-09-16T07:46:36.521 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.521 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.521 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.521 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.521 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.521 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.522 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.522 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.522 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.522 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.522 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.522 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.522 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.522 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.522 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.522 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.522 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.522 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.522 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.523 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.523 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.523 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.523 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.523 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.059419+0000" 2024-09-16T07:46:36.523 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.523 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.523 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.523 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.523 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.523 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.523 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.523 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.524 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.524 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.524 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.524 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.524 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.524 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.524 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.524 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.178441+0000" 2024-09-16T07:46:36.524 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.524 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.524 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.524 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.524 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.525 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.525 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.525 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.525 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.525 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.525 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.525 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.525 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.525 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777276, 2024-09-16T07:46:36.525 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.525 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.525 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.525 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.063101+0000" 2024-09-16T07:46:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.063113+0000" 2024-09-16T07:46:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.063297+0000" 2024-09-16T07:46:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.528 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.063417+0000" 2024-09-16T07:46:36.528 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.528 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.528 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.528 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.528 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.528 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.528 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.528 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.063530+0000" 2024-09-16T07:46:36.528 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.528 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.528 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.528 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.529 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.529 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.529 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.529 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.529 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.529 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.529 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.529 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.529 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.529 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.529 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.529 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.180430+0000" 2024-09-16T07:46:36.529 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.530 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.530 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.530 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.064139+0000" 2024-09-16T07:46:36.530 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.530 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.530 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.530 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.530 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.530 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.530 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.530 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.530 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.530 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.531 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.531 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.531 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.531 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.531 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.531 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.064379+0000" 2024-09-16T07:46:36.531 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.531 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.531 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.531 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.531 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.531 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.531 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.532 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.532 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.532 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.532 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.532 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.532 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.532 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.532 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.532 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.532 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.532 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.532 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.532 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.533 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.533 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.533 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.533 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.533 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.533 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.533 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.533 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.533 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.533 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.533 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.533 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.064806+0000" 2024-09-16T07:46:36.533 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.534 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.534 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.534 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.534 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.534 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.534 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.534 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.534 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.534 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.534 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.534 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.534 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.534 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.534 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.535 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.535 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.535 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.535 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.535 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.535 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.535 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.535 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.535 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.068806+0000" 2024-09-16T07:46:36.535 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.535 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.535 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.535 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.536 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.536 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.536 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.536 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.536 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.536 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.536 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.536 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.536 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.536 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.536 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.536 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.179795+0000" 2024-09-16T07:46:36.536 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.537 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.537 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.537 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.537 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.537 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.537 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.537 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.537 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.537 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.537 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.537 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.537 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.537 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777277, 2024-09-16T07:46:36.537 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.538 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.538 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.538 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.065591+0000" 2024-09-16T07:46:36.538 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.538 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.538 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.538 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.065603+0000" 2024-09-16T07:46:36.538 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.538 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.538 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.538 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.538 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.538 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.539 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.539 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.065846+0000" 2024-09-16T07:46:36.539 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.539 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.539 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.539 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.539 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.539 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.539 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.539 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.539 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.539 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.539 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.540 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.540 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.540 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.540 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.540 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.066007+0000" 2024-09-16T07:46:36.540 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.540 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.540 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.540 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.540 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.540 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.540 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.540 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.066123+0000" 2024-09-16T07:46:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.541 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.542 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.542 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.186071+0000" 2024-09-16T07:46:36.542 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.542 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.542 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.542 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.066578+0000" 2024-09-16T07:46:36.542 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.542 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.542 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.542 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.542 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.542 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.543 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.543 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.543 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.543 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.543 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.543 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.543 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.543 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.543 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.543 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.066780+0000" 2024-09-16T07:46:36.543 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.543 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.543 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.543 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.544 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.544 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.544 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.544 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.544 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.544 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.544 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.544 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.544 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.544 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.544 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.544 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.544 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.545 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.545 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.545 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.545 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.545 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.545 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.545 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.545 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.545 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.545 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.545 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.545 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.545 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.545 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.546 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.067329+0000" 2024-09-16T07:46:36.546 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.546 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.546 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.546 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.546 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.546 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.546 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.546 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.546 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.546 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.546 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.546 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.547 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.547 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.547 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.547 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.547 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.547 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.547 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.547 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.547 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.547 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.547 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.547 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.071490+0000" 2024-09-16T07:46:36.547 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.548 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.548 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.548 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.548 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.548 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.548 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.548 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.548 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.548 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.548 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.548 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.548 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.548 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.548 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.549 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.185375+0000" 2024-09-16T07:46:36.549 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.549 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.549 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.549 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.549 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.549 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.549 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.549 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.549 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.549 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.549 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.549 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777280, 2024-09-16T07:46:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.074663+0000" 2024-09-16T07:46:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.074674+0000" 2024-09-16T07:46:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.551 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.551 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.551 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.551 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.551 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.074828+0000" 2024-09-16T07:46:36.551 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.551 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.551 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.551 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.551 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.551 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.551 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.551 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.551 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.552 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.552 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.552 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.552 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.552 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.552 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.552 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.075011+0000" 2024-09-16T07:46:36.552 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.552 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.552 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.552 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.552 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.552 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.553 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.553 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.075118+0000" 2024-09-16T07:46:36.553 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.553 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.553 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.553 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.553 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.553 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.553 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.553 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.553 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.553 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.553 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.554 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.554 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.554 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.554 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.554 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.206272+0000" 2024-09-16T07:46:36.554 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.554 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.554 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.554 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.075522+0000" 2024-09-16T07:46:36.554 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.554 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.554 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.554 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.555 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.555 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.555 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.555 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.555 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.555 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.555 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.555 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.555 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.555 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.555 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.555 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.075743+0000" 2024-09-16T07:46:36.555 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.555 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.556 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.556 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.556 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.556 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.556 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.556 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.556 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.556 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.556 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.556 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.556 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.556 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.556 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.557 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.557 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.557 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.557 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.557 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.557 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.557 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.557 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.557 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.557 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.557 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.557 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.557 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.558 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.558 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.558 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.558 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.076186+0000" 2024-09-16T07:46:36.558 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.558 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.558 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.558 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.558 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.558 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.558 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.558 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.558 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.559 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.559 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.559 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.559 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.559 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.559 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.559 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.559 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.559 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.559 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.559 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.078842+0000" 2024-09-16T07:46:36.559 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.559 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.560 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.560 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.079752+0000" 2024-09-16T07:46:36.560 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.560 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.560 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.560 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.560 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.560 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.560 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.560 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.560 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.560 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.560 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.561 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.561 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.561 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.561 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.561 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.205509+0000" 2024-09-16T07:46:36.561 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.561 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.561 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.561 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.561 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.561 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.561 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.561 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.562 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.562 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.562 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.562 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.562 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.562 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777285, 2024-09-16T07:46:36.562 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.562 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.562 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.562 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.153819+0000" 2024-09-16T07:46:36.562 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.562 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.562 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.562 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.153854+0000" 2024-09-16T07:46:36.563 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.563 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.563 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.563 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.563 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.563 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.563 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.563 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.154135+0000" 2024-09-16T07:46:36.563 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.563 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.563 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.563 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.563 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.564 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.564 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.564 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.564 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.564 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.564 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.564 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.564 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.564 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.564 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.564 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.154298+0000" 2024-09-16T07:46:36.564 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.564 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.565 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.565 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.565 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.565 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.565 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.565 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.154467+0000" 2024-09-16T07:46:36.565 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.565 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.565 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.565 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.565 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.565 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.565 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.566 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.566 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.566 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.566 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.566 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.566 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.566 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.566 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.566 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.251271+0000" 2024-09-16T07:46:36.566 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.566 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.566 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.566 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.155255+0000" 2024-09-16T07:46:36.567 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.567 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.567 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.567 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.567 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.567 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.567 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.567 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.567 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.567 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.567 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.567 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.567 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.568 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.568 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.568 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.155592+0000" 2024-09-16T07:46:36.568 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.568 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.568 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.568 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.568 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.568 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.568 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.568 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.568 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.568 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.569 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.569 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.569 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.569 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.569 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.569 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.569 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.569 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.569 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.569 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.569 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.569 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.569 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.570 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.570 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.570 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.570 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.570 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.570 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.570 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.570 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.570 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.156281+0000" 2024-09-16T07:46:36.570 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.570 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.570 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.571 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.571 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.571 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.571 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.571 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.571 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.571 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.571 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.571 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.571 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.571 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.571 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.572 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.572 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.572 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.572 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.572 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.572 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.572 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.572 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.572 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.160559+0000" 2024-09-16T07:46:36.572 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.572 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.572 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.573 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.573 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.573 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.573 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.573 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.573 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.573 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.573 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.573 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.573 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.573 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.573 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.573 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.246254+0000" 2024-09-16T07:46:36.574 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.574 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.574 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.574 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.574 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.574 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.574 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.574 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.574 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.574 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.574 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.574 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.575 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.575 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777289, 2024-09-16T07:46:36.575 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.575 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.575 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.575 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.253075+0000" 2024-09-16T07:46:36.575 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.575 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.575 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.575 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.253102+0000" 2024-09-16T07:46:36.575 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.575 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.576 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.576 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.576 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.576 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.576 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.576 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.253376+0000" 2024-09-16T07:46:36.576 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.576 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.576 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.576 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.576 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.576 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.577 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.577 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.577 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.577 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.577 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.577 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.577 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.577 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.577 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.577 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.253548+0000" 2024-09-16T07:46:36.577 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.577 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.577 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.253914+0000" 2024-09-16T07:46:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.578 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.579 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.254342+0000" 2024-09-16T07:46:36.580 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.580 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.580 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.580 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.580 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.580 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.580 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.580 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.580 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.580 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.580 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.580 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.581 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.581 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.581 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.581 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.254573+0000" 2024-09-16T07:46:36.581 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.581 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.581 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.581 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.581 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.581 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.581 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.581 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.581 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.582 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.582 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.582 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.582 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.582 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.582 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.582 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.582 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.582 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.582 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.582 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.582 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.582 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.583 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.583 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.583 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.583 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.583 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.583 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.583 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.583 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.583 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.583 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.254990+0000" 2024-09-16T07:46:36.583 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.583 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.583 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.584 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.584 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.584 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.584 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.584 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.584 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.584 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.584 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.584 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.584 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.584 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.584 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.584 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.584 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.585 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.585 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.585 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.585 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.585 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.585 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.585 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.258481+0000" 2024-09-16T07:46:36.585 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.585 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.585 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.585 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.585 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.585 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.586 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.586 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.586 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.586 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.586 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.586 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.586 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.586 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.586 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.586 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.586 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.586 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.586 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.587 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.587 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.587 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.587 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.587 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.587 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.587 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.587 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.587 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.587 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.587 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777291, 2024-09-16T07:46:36.587 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.587 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.587 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.588 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.273721+0000" 2024-09-16T07:46:36.588 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.588 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.588 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.588 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.273740+0000" 2024-09-16T07:46:36.588 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.588 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.588 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.588 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.588 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.588 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.588 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.588 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.274002+0000" 2024-09-16T07:46:36.589 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.589 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.589 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.589 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.589 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.589 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.589 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.589 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.589 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.589 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.589 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.589 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.590 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.590 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.590 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.590 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.274182+0000" 2024-09-16T07:46:36.590 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.590 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.590 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.590 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.590 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.590 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.590 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.590 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.276004+0000" 2024-09-16T07:46:36.590 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.590 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.591 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.591 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.591 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.591 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.591 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.591 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.591 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.591 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.591 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.591 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.591 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.591 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.591 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.591 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.592 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.592 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.592 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.592 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.276466+0000" 2024-09-16T07:46:36.592 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.592 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.592 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.592 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.592 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.592 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.592 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.592 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.592 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.593 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.593 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.593 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.593 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.593 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.593 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.593 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.276725+0000" 2024-09-16T07:46:36.593 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.593 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.593 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.593 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.593 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.593 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.594 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.594 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.594 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.594 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.594 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.594 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.594 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.594 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.594 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.594 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.594 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.594 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.594 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.595 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.595 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.595 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.595 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.595 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.595 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.595 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.595 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.595 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.595 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.595 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.595 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.595 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.277390+0000" 2024-09-16T07:46:36.596 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.596 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.596 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.596 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.596 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.596 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.596 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.596 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.596 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.596 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.596 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.596 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.596 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.596 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.597 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.597 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.597 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.597 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.597 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.597 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.597 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.597 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.597 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.597 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.279536+0000" 2024-09-16T07:46:36.597 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.597 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.598 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.598 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.598 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.598 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.598 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.598 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.598 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.598 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.598 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.598 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.598 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.598 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.598 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.598 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.599 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.599 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.599 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.599 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.599 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.599 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.599 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.599 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.599 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.599 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.599 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.599 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.599 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "replicated_request", 2024-09-16T07:46:36.599 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 223, 2024-09-16T07:46:36.600 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.600 INFO:teuthology.orchestra.run.smithi003.stdout: "RepRequest": { 2024-09-16T07:46:36.600 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.4238.0:7476", 2024-09-16T07:46:36.600 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "3.2", 2024-09-16T07:46:36.600 INFO:teuthology.orchestra.run.smithi003.stdout: "map_epoch": 28, 2024-09-16T07:46:36.600 INFO:teuthology.orchestra.run.smithi003.stdout: "min_epoch": 27, 2024-09-16T07:46:36.600 INFO:teuthology.orchestra.run.smithi003.stdout: "oid": "3:46b8b058:::benchmark_data_smithi003_30169_object7475:head", 2024-09-16T07:46:36.600 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "1" 2024-09-16T07:46:36.600 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.600 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.600 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.600 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:46:36.600 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:46:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777272, 2024-09-16T07:46:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:46:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:46:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.052695+0000" 2024-09-16T07:46:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:46:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.052709+0000" 2024-09-16T07:46:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.052929+0000" 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:46:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.053160+0000" 2024-09-16T07:46:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:46:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.054364+0000" 2024-09-16T07:46:36.604 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.604 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.604 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.604 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.604 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.604 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.604 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:46:36.604 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.604 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.604 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.604 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.604 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.604 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.604 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.605 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.605 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.056363+0000" 2024-09-16T07:46:36.605 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.605 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.605 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:46:36.605 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.055040+0000" 2024-09-16T07:46:36.605 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.605 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.605 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.605 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.605 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.605 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.605 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:46:36.605 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.055337+0000" 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.606 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:46:36.607 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.607 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.607 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.607 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.607 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.607 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.607 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.607 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:46:36.607 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.607 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.607 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.607 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.607 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.608 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.608 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:46:36.608 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.608 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.608 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.608 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.608 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.608 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:46:36.608 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:46:36.055974+0000" 2024-09-16T07:46:36.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.609 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.609 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.609 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.609 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.609 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.609 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:46:36.609 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.609 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.609 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.609 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.609 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.609 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.609 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.610 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:46:36.610 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.610 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.610 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.610 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.610 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.610 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.610 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.610 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:46:36.610 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.610 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.610 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.610 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.611 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.611 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.611 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.611 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:46:36.611 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.611 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.611 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.611 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.611 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.611 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.611 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:46:36.611 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:46:36.611 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.612 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.612 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.612 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:46:36.612 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.612 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:46:36.612 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:46:36.612 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:46:36.612 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:46:36.612 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.612 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.612 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:46:36.612 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:46:36.612 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T07:46:36.614 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 77 16 7524 7508 6.09349 0.425 0.0970094 0.164017 2024-09-16T07:46:37.500 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 78 16 7720 7704 6.1724 12.25 0.0701522 0.16192 2024-09-16T07:46:38.159 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:38.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:38.327+0000 7f2110151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:38.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:38.336+0000 7f2110151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:38.500 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 79 16 7922 7906 6.25406 12.625 0.0505201 0.159791 2024-09-16T07:46:39.500 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:46:39.502538+0000 min lat: 0.0163118 max lat: 23.4475 avg lat: 0.157899 2024-09-16T07:46:39.501 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:46:39.501 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 80 16 8119 8103 6.32978 12.3125 0.0643223 0.157899 2024-09-16T07:46:40.501 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 81 16 8315 8299 6.40285 12.25 0.0624393 0.156113 2024-09-16T07:46:40.748 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:40.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:40.905+0000 7f7b14d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:40.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:40.913+0000 7f7b14d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:41.501 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 82 16 8507 8491 6.4711 12 0.138861 0.154419 2024-09-16T07:46:41.615 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [1, 3, 2, 0] 2024-09-16T07:46:41.615 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:46:41.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:41.769+0000 7fcc33c7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:41.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:41.784+0000 7fcc33c7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:42.501 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 83 16 8707 8691 6.54372 12.5 0.0571452 0.152736 2024-09-16T07:46:42.582 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:46:42.603 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:46:42.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:42.762+0000 7f61bc391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:42.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:42.783+0000 7f61bc391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:43.466 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:43.501 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 84 16 8890 8874 6.60196 11.4375 0.0612242 0.151363 2024-09-16T07:46:43.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:43.634+0000 7f73a5ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:43.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:43.644+0000 7f73a5ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:43.940 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:46:43.965 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:46:44.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:44.167+0000 7f6385a23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:44.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:44.184+0000 7f6385a23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:44.501 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 85 16 9067 9051 6.65443 11.0625 0.0457429 0.150176 2024-09-16T07:46:44.945 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:46:44.967 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:46:45.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:45.134+0000 7fde97d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:45.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:45.152+0000 7fde97d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:45.501 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 86 16 9256 9240 6.71439 11.8125 0.0655818 0.148857 2024-09-16T07:46:45.931 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:45.946 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:46:45.973 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:46:45.973 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:46.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:46.098+0000 7f0795f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:46.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:46.111+0000 7f0795f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:46.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:46.166+0000 7f636a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:46.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:46.184+0000 7f636a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:46.492 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:46.492 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:46.501 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 87 16 9439 9423 6.76867 11.4375 0.0771237 0.14764 2024-09-16T07:46:46.510 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-09-16T07:46:46.307268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":457179688,"num_objects":6971,"num_object_clones":0,"num_object_copies":20913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7047,"num_write_kb":446995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7030,"ondisk_log_size":7030,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":225612,"kb_used_data":84488,"kb_used_omap":0,"kb_used_meta":141056,"kb_avail":377261748,"statfs":{"total":386547056640,"available":386316029952,"internally_reserved":0,"allocated":86515712,"data_stored":1369531529,"data_compressed":65021785,"data_compressed_allocated":85590016,"data_compressed_original":1369194496,"omap_allocated":0,"internal_metadata":144441344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000718"},"pg_stats":[{"pgid":"3.f","version":"25'395","reported_seq":427,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:12.954045+0000","last_change":"2024-09-16T07:45:44.535560+0000","last_active":"2024-09-16T07:46:12.954045+0000","last_peered":"2024-09-16T07:46:12.954045+0000","last_clean":"2024-09-16T07:46:12.954045+0000","last_became_active":"2024-09-16T07:45:44.523789+0000","last_became_peered":"2024-09-16T07:45:44.523789+0000","last_unstale":"2024-09-16T07:46:33.558424+0000","last_undegraded":"2024-09-16T07:46:12.954045+0000","last_fullsized":"2024-09-16T07:46:12.954045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'429","reported_seq":452,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.486362+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:46:18.486362+0000","last_peered":"2024-09-16T07:46:18.486362+0000","last_clean":"2024-09-16T07:46:18.486362+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:46:18.486362+0000","last_undegraded":"2024-09-16T07:46:18.486362+0000","last_fullsized":"2024-09-16T07:46:18.486362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'437","reported_seq":474,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.604809+0000","last_change":"2024-09-16T07:46:33.614981+0000","last_active":"2024-09-16T07:46:33.614981+0000","last_peered":"2024-09-16T07:46:20.807285+0000","last_clean":"2024-09-16T07:46:20.807285+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:34.604809+0000","last_undegraded":"2024-09-16T07:46:34.604809+0000","last_fullsized":"2024-09-16T07:46:34.604809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":437,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'342","reported_seq":375,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.292186+0000","last_change":"2024-09-16T07:45:50.902218+0000","last_active":"2024-09-16T07:46:13.292186+0000","last_peered":"2024-09-16T07:46:13.292186+0000","last_clean":"2024-09-16T07:46:13.292186+0000","last_became_active":"2024-09-16T07:45:50.691944+0000","last_became_peered":"2024-09-16T07:45:50.691944+0000","last_unstale":"2024-09-16T07:46:33.558428+0000","last_undegraded":"2024-09-16T07:46:13.292186+0000","last_fullsized":"2024-09-16T07:46:13.292186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'451","reported_seq":490,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.615849+0000","last_change":"2024-09-16T07:46:33.615849+0000","last_active":"2024-09-16T07:46:33.615849+0000","last_peered":"2024-09-16T07:46:20.759422+0000","last_clean":"2024-09-16T07:46:20.759422+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:33.615849+0000","last_undegraded":"2024-09-16T07:46:33.615849+0000","last_fullsized":"2024-09-16T07:46:33.615849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'355","reported_seq":381,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.308341+0000","last_change":"2024-09-16T07:45:50.666069+0000","last_active":"2024-09-16T07:46:13.308341+0000","last_peered":"2024-09-16T07:46:13.308341+0000","last_clean":"2024-09-16T07:46:13.308341+0000","last_became_active":"2024-09-16T07:45:50.653189+0000","last_became_peered":"2024-09-16T07:45:50.653189+0000","last_unstale":"2024-09-16T07:46:33.558430+0000","last_undegraded":"2024-09-16T07:46:13.308341+0000","last_fullsized":"2024-09-16T07:46:13.308341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'390","reported_seq":416,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.247682+0000","last_change":"2024-09-16T07:45:50.622899+0000","last_active":"2024-09-16T07:46:13.247682+0000","last_peered":"2024-09-16T07:46:13.247682+0000","last_clean":"2024-09-16T07:46:13.247682+0000","last_became_active":"2024-09-16T07:45:50.606399+0000","last_became_peered":"2024-09-16T07:45:50.606399+0000","last_unstale":"2024-09-16T07:46:33.558433+0000","last_undegraded":"2024-09-16T07:46:13.247682+0000","last_fullsized":"2024-09-16T07:46:13.247682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'440","reported_seq":485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.613447+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:34.613447+0000","last_peered":"2024-09-16T07:46:34.613447+0000","last_clean":"2024-09-16T07:46:34.613447+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:34.613447+0000","last_undegraded":"2024-09-16T07:46:34.613447+0000","last_fullsized":"2024-09-16T07:46:34.613447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":115,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.594594+0000","last_change":"2024-09-16T07:46:33.594594+0000","last_active":"2024-09-16T07:46:33.594594+0000","last_peered":"2024-09-16T07:45:51.484915+0000","last_clean":"2024-09-16T07:45:51.484915+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:46:33.594594+0000","last_undegraded":"2024-09-16T07:46:33.594594+0000","last_fullsized":"2024-09-16T07:46:33.594594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":45,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.608687+0000","last_change":"2024-09-16T07:46:33.608687+0000","last_active":"2024-09-16T07:46:33.608687+0000","last_peered":"2024-09-16T07:45:51.505238+0000","last_clean":"2024-09-16T07:45:51.505238+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:46:33.608687+0000","last_undegraded":"2024-09-16T07:46:33.608687+0000","last_fullsized":"2024-09-16T07:46:33.608687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'476","reported_seq":513,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.603544+0000","last_change":"2024-09-16T07:46:33.602602+0000","last_active":"2024-09-16T07:46:33.602602+0000","last_peered":"2024-09-16T07:46:20.769086+0000","last_clean":"2024-09-16T07:46:20.769086+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:34.603544+0000","last_undegraded":"2024-09-16T07:46:34.603544+0000","last_fullsized":"2024-09-16T07:46:34.603544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":476,"num_write_kb":30464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.513996+0000","last_change":"2024-09-16T07:45:51.521750+0000","last_active":"2024-09-16T07:45:51.513996+0000","last_peered":"2024-09-16T07:45:51.513996+0000","last_clean":"2024-09-16T07:45:51.513996+0000","last_became_active":"2024-09-16T07:45:50.665366+0000","last_became_peered":"2024-09-16T07:45:50.665366+0000","last_unstale":"2024-09-16T07:46:33.558437+0000","last_undegraded":"2024-09-16T07:45:51.513996+0000","last_fullsized":"2024-09-16T07:45:51.513996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'459","reported_seq":496,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.583420+0000","last_change":"2024-09-16T07:46:33.579664+0000","last_active":"2024-09-16T07:46:33.579664+0000","last_peered":"2024-09-16T07:46:20.817119+0000","last_clean":"2024-09-16T07:46:20.817119+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:34.583420+0000","last_undegraded":"2024-09-16T07:46:34.583420+0000","last_fullsized":"2024-09-16T07:46:34.583420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30081024,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":29376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.584979+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:34.584979+0000","last_peered":"2024-09-16T07:46:34.584979+0000","last_clean":"2024-09-16T07:46:34.584979+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:34.584979+0000","last_undegraded":"2024-09-16T07:46:34.584979+0000","last_fullsized":"2024-09-16T07:46:34.584979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'463","reported_seq":510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.602455+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:34.602455+0000","last_peered":"2024-09-16T07:46:34.602455+0000","last_clean":"2024-09-16T07:46:34.602455+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:34.602455+0000","last_undegraded":"2024-09-16T07:46:34.602455+0000","last_fullsized":"2024-09-16T07:46:34.602455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30343168,"num_objects":463,"num_object_clones":0,"num_object_copies":1389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":463,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":33,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.511360+0000","last_change":"2024-09-16T07:45:51.520543+0000","last_active":"2024-09-16T07:45:51.511360+0000","last_peered":"2024-09-16T07:45:51.511360+0000","last_clean":"2024-09-16T07:45:51.511360+0000","last_became_active":"2024-09-16T07:45:50.656425+0000","last_became_peered":"2024-09-16T07:45:50.656425+0000","last_unstale":"2024-09-16T07:46:33.558440+0000","last_undegraded":"2024-09-16T07:45:51.511360+0000","last_fullsized":"2024-09-16T07:45:51.511360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'440","reported_seq":463,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.600917+0000","last_change":"2024-09-16T07:45:50.662284+0000","last_active":"2024-09-16T07:46:18.600917+0000","last_peered":"2024-09-16T07:46:18.600917+0000","last_clean":"2024-09-16T07:46:18.600917+0000","last_became_active":"2024-09-16T07:45:50.648809+0000","last_became_peered":"2024-09-16T07:45:50.648809+0000","last_unstale":"2024-09-16T07:46:18.600917+0000","last_undegraded":"2024-09-16T07:46:18.600917+0000","last_fullsized":"2024-09-16T07:46:18.600917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"25'525","reported_seq":565,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.606029+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:34.606029+0000","last_peered":"2024-09-16T07:46:34.606029+0000","last_clean":"2024-09-16T07:46:34.606029+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:34.606029+0000","last_undegraded":"2024-09-16T07:46:34.606029+0000","last_fullsized":"2024-09-16T07:46:34.606029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.521563+0000","last_change":"2024-09-16T07:45:51.528912+0000","last_active":"2024-09-16T07:45:51.521563+0000","last_peered":"2024-09-16T07:45:51.521563+0000","last_clean":"2024-09-16T07:45:51.521563+0000","last_became_active":"2024-09-16T07:45:50.632911+0000","last_became_peered":"2024-09-16T07:45:50.632911+0000","last_unstale":"2024-09-16T07:45:51.521563+0000","last_undegraded":"2024-09-16T07:45:51.521563+0000","last_fullsized":"2024-09-16T07:45:51.521563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'447","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.755658+0000","last_change":"2024-09-16T07:45:50.704395+0000","last_active":"2024-09-16T07:46:18.755658+0000","last_peered":"2024-09-16T07:46:18.755658+0000","last_clean":"2024-09-16T07:46:18.755658+0000","last_became_active":"2024-09-16T07:45:50.690192+0000","last_became_peered":"2024-09-16T07:45:50.690192+0000","last_unstale":"2024-09-16T07:46:18.755658+0000","last_undegraded":"2024-09-16T07:46:18.755658+0000","last_fullsized":"2024-09-16T07:46:18.755658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29229056,"num_objects":446,"num_object_clones":0,"num_object_copies":1338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":446,"num_write_kb":28544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.613664+0000","last_change":"2024-09-16T07:46:33.613664+0000","last_active":"2024-09-16T07:46:33.613664+0000","last_peered":"2024-09-16T07:45:51.499250+0000","last_clean":"2024-09-16T07:45:51.499250+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:46:33.613664+0000","last_undegraded":"2024-09-16T07:46:33.613664+0000","last_fullsized":"2024-09-16T07:46:33.613664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'490","reported_seq":526,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.582711+0000","last_change":"2024-09-16T07:46:33.582711+0000","last_active":"2024-09-16T07:46:33.582711+0000","last_peered":"2024-09-16T07:46:20.729315+0000","last_clean":"2024-09-16T07:46:20.729315+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:33.582711+0000","last_undegraded":"2024-09-16T07:46:33.582711+0000","last_fullsized":"2024-09-16T07:46:33.582711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.524259+0000","last_change":"2024-09-16T07:45:51.527842+0000","last_active":"2024-09-16T07:45:51.524259+0000","last_peered":"2024-09-16T07:45:51.524259+0000","last_clean":"2024-09-16T07:45:51.524259+0000","last_became_active":"2024-09-16T07:45:50.692633+0000","last_became_peered":"2024-09-16T07:45:50.692633+0000","last_unstale":"2024-09-16T07:45:51.524259+0000","last_undegraded":"2024-09-16T07:45:51.524259+0000","last_fullsized":"2024-09-16T07:45:51.524259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"25'436","reported_seq":459,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.679738+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:46:18.679738+0000","last_peered":"2024-09-16T07:46:18.679738+0000","last_clean":"2024-09-16T07:46:18.679738+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:46:18.679738+0000","last_undegraded":"2024-09-16T07:46:18.679738+0000","last_fullsized":"2024-09-16T07:46:18.679738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.601073+0000","last_change":"2024-09-16T07:46:33.601073+0000","last_active":"2024-09-16T07:46:33.601073+0000","last_peered":"2024-09-16T07:45:51.507878+0000","last_clean":"2024-09-16T07:45:51.507878+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:46:33.601073+0000","last_undegraded":"2024-09-16T07:46:33.601073+0000","last_fullsized":"2024-09-16T07:46:33.601073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":456589312,"num_objects":6967,"num_object_clones":0,"num_object_copies":20901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6967,"num_write_kb":445888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86081536,"data_stored":1377304576,"data_compressed":65398462,"data_compressed_allocated":86081536,"data_compressed_original":1377304576,"omap_allocated":0,"internal_metadata":0},"log_size":6975,"ondisk_log_size":6975,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61476,"kb_used_data":26324,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310364,"statfs":{"total":96636764160,"available":96573812736,"internally_reserved":0,"allocated":26955776,"data_stored":427499720,"data_compressed":20297527,"data_compressed_allocated":26718208,"data_compressed_original":427409408,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50632,"kb_used_data":19380,"kb_used_omap":0,"kb_used_meta":31232,"kb_avail":94321208,"statfs":{"total":96636764160,"available":96584916992,"internally_reserved":0,"allocated":19845120,"data_stored":313791107,"data_compressed":14898446,"data_compressed_allocated":19611648,"data_compressed_original":313704448,"omap_allocated":0,"internal_metadata":31981568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53568,"kb_used_data":22576,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318272,"statfs":{"total":96636764160,"available":96581910528,"internally_reserved":0,"allocated":23117824,"data_stored":366419643,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":20,"seq":85899345949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59936,"kb_used_data":16208,"kb_used_omap":0,"kb_used_meta":43712,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":16596992,"data_stored":261821059,"data_compressed":12430614,"data_compressed_allocated":16363520,"data_compressed_original":261734400,"omap_allocated":0,"internal_metadata":44761088},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":268566528,"data_compressed":12752229,"data_compressed_allocated":16785408,"data_compressed_original":268566528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22896640,"data_stored":366346240,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19722240,"data_stored":315555840,"data_compressed":14983549,"data_compressed_allocated":19722240,"data_compressed_original":315555840,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26677248,"data_stored":426835968,"data_compressed":20267486,"data_compressed_allocated":26677248,"data_compressed_original":426835968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:46.512 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:46.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:46.710+0000 7eff59591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:46.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:46.723+0000 7eff59591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:47.041 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:47.042 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:47.060 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-09-16T07:46:46.307268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":457179688,"num_objects":6971,"num_object_clones":0,"num_object_copies":20913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7047,"num_write_kb":446995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7030,"ondisk_log_size":7030,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":225612,"kb_used_data":84488,"kb_used_omap":0,"kb_used_meta":141056,"kb_avail":377261748,"statfs":{"total":386547056640,"available":386316029952,"internally_reserved":0,"allocated":86515712,"data_stored":1369531529,"data_compressed":65021785,"data_compressed_allocated":85590016,"data_compressed_original":1369194496,"omap_allocated":0,"internal_metadata":144441344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000718"},"pg_stats":[{"pgid":"3.f","version":"25'395","reported_seq":427,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:12.954045+0000","last_change":"2024-09-16T07:45:44.535560+0000","last_active":"2024-09-16T07:46:12.954045+0000","last_peered":"2024-09-16T07:46:12.954045+0000","last_clean":"2024-09-16T07:46:12.954045+0000","last_became_active":"2024-09-16T07:45:44.523789+0000","last_became_peered":"2024-09-16T07:45:44.523789+0000","last_unstale":"2024-09-16T07:46:33.558424+0000","last_undegraded":"2024-09-16T07:46:12.954045+0000","last_fullsized":"2024-09-16T07:46:12.954045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'429","reported_seq":452,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.486362+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:46:18.486362+0000","last_peered":"2024-09-16T07:46:18.486362+0000","last_clean":"2024-09-16T07:46:18.486362+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:46:18.486362+0000","last_undegraded":"2024-09-16T07:46:18.486362+0000","last_fullsized":"2024-09-16T07:46:18.486362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'437","reported_seq":474,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.604809+0000","last_change":"2024-09-16T07:46:33.614981+0000","last_active":"2024-09-16T07:46:33.614981+0000","last_peered":"2024-09-16T07:46:20.807285+0000","last_clean":"2024-09-16T07:46:20.807285+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:34.604809+0000","last_undegraded":"2024-09-16T07:46:34.604809+0000","last_fullsized":"2024-09-16T07:46:34.604809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":437,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'342","reported_seq":375,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.292186+0000","last_change":"2024-09-16T07:45:50.902218+0000","last_active":"2024-09-16T07:46:13.292186+0000","last_peered":"2024-09-16T07:46:13.292186+0000","last_clean":"2024-09-16T07:46:13.292186+0000","last_became_active":"2024-09-16T07:45:50.691944+0000","last_became_peered":"2024-09-16T07:45:50.691944+0000","last_unstale":"2024-09-16T07:46:33.558428+0000","last_undegraded":"2024-09-16T07:46:13.292186+0000","last_fullsized":"2024-09-16T07:46:13.292186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'451","reported_seq":490,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.615849+0000","last_change":"2024-09-16T07:46:33.615849+0000","last_active":"2024-09-16T07:46:33.615849+0000","last_peered":"2024-09-16T07:46:20.759422+0000","last_clean":"2024-09-16T07:46:20.759422+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:33.615849+0000","last_undegraded":"2024-09-16T07:46:33.615849+0000","last_fullsized":"2024-09-16T07:46:33.615849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'355","reported_seq":381,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.308341+0000","last_change":"2024-09-16T07:45:50.666069+0000","last_active":"2024-09-16T07:46:13.308341+0000","last_peered":"2024-09-16T07:46:13.308341+0000","last_clean":"2024-09-16T07:46:13.308341+0000","last_became_active":"2024-09-16T07:45:50.653189+0000","last_became_peered":"2024-09-16T07:45:50.653189+0000","last_unstale":"2024-09-16T07:46:33.558430+0000","last_undegraded":"2024-09-16T07:46:13.308341+0000","last_fullsized":"2024-09-16T07:46:13.308341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'390","reported_seq":416,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.247682+0000","last_change":"2024-09-16T07:45:50.622899+0000","last_active":"2024-09-16T07:46:13.247682+0000","last_peered":"2024-09-16T07:46:13.247682+0000","last_clean":"2024-09-16T07:46:13.247682+0000","last_became_active":"2024-09-16T07:45:50.606399+0000","last_became_peered":"2024-09-16T07:45:50.606399+0000","last_unstale":"2024-09-16T07:46:33.558433+0000","last_undegraded":"2024-09-16T07:46:13.247682+0000","last_fullsized":"2024-09-16T07:46:13.247682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'440","reported_seq":485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.613447+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:34.613447+0000","last_peered":"2024-09-16T07:46:34.613447+0000","last_clean":"2024-09-16T07:46:34.613447+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:34.613447+0000","last_undegraded":"2024-09-16T07:46:34.613447+0000","last_fullsized":"2024-09-16T07:46:34.613447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":115,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.594594+0000","last_change":"2024-09-16T07:46:33.594594+0000","last_active":"2024-09-16T07:46:33.594594+0000","last_peered":"2024-09-16T07:45:51.484915+0000","last_clean":"2024-09-16T07:45:51.484915+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:46:33.594594+0000","last_undegraded":"2024-09-16T07:46:33.594594+0000","last_fullsized":"2024-09-16T07:46:33.594594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":45,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.608687+0000","last_change":"2024-09-16T07:46:33.608687+0000","last_active":"2024-09-16T07:46:33.608687+0000","last_peered":"2024-09-16T07:45:51.505238+0000","last_clean":"2024-09-16T07:45:51.505238+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:46:33.608687+0000","last_undegraded":"2024-09-16T07:46:33.608687+0000","last_fullsized":"2024-09-16T07:46:33.608687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'476","reported_seq":513,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.603544+0000","last_change":"2024-09-16T07:46:33.602602+0000","last_active":"2024-09-16T07:46:33.602602+0000","last_peered":"2024-09-16T07:46:20.769086+0000","last_clean":"2024-09-16T07:46:20.769086+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:34.603544+0000","last_undegraded":"2024-09-16T07:46:34.603544+0000","last_fullsized":"2024-09-16T07:46:34.603544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":476,"num_write_kb":30464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.513996+0000","last_change":"2024-09-16T07:45:51.521750+0000","last_active":"2024-09-16T07:45:51.513996+0000","last_peered":"2024-09-16T07:45:51.513996+0000","last_clean":"2024-09-16T07:45:51.513996+0000","last_became_active":"2024-09-16T07:45:50.665366+0000","last_became_peered":"2024-09-16T07:45:50.665366+0000","last_unstale":"2024-09-16T07:46:33.558437+0000","last_undegraded":"2024-09-16T07:45:51.513996+0000","last_fullsized":"2024-09-16T07:45:51.513996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'459","reported_seq":496,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.583420+0000","last_change":"2024-09-16T07:46:33.579664+0000","last_active":"2024-09-16T07:46:33.579664+0000","last_peered":"2024-09-16T07:46:20.817119+0000","last_clean":"2024-09-16T07:46:20.817119+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:34.583420+0000","last_undegraded":"2024-09-16T07:46:34.583420+0000","last_fullsized":"2024-09-16T07:46:34.583420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30081024,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":29376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.584979+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:34.584979+0000","last_peered":"2024-09-16T07:46:34.584979+0000","last_clean":"2024-09-16T07:46:34.584979+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:34.584979+0000","last_undegraded":"2024-09-16T07:46:34.584979+0000","last_fullsized":"2024-09-16T07:46:34.584979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'463","reported_seq":510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.602455+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:34.602455+0000","last_peered":"2024-09-16T07:46:34.602455+0000","last_clean":"2024-09-16T07:46:34.602455+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:34.602455+0000","last_undegraded":"2024-09-16T07:46:34.602455+0000","last_fullsized":"2024-09-16T07:46:34.602455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30343168,"num_objects":463,"num_object_clones":0,"num_object_copies":1389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":463,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":33,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.511360+0000","last_change":"2024-09-16T07:45:51.520543+0000","last_active":"2024-09-16T07:45:51.511360+0000","last_peered":"2024-09-16T07:45:51.511360+0000","last_clean":"2024-09-16T07:45:51.511360+0000","last_became_active":"2024-09-16T07:45:50.656425+0000","last_became_peered":"2024-09-16T07:45:50.656425+0000","last_unstale":"2024-09-16T07:46:33.558440+0000","last_undegraded":"2024-09-16T07:45:51.511360+0000","last_fullsized":"2024-09-16T07:45:51.511360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'440","reported_seq":463,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.600917+0000","last_change":"2024-09-16T07:45:50.662284+0000","last_active":"2024-09-16T07:46:18.600917+0000","last_peered":"2024-09-16T07:46:18.600917+0000","last_clean":"2024-09-16T07:46:18.600917+0000","last_became_active":"2024-09-16T07:45:50.648809+0000","last_became_peered":"2024-09-16T07:45:50.648809+0000","last_unstale":"2024-09-16T07:46:18.600917+0000","last_undegraded":"2024-09-16T07:46:18.600917+0000","last_fullsized":"2024-09-16T07:46:18.600917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"25'525","reported_seq":565,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.606029+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:34.606029+0000","last_peered":"2024-09-16T07:46:34.606029+0000","last_clean":"2024-09-16T07:46:34.606029+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:34.606029+0000","last_undegraded":"2024-09-16T07:46:34.606029+0000","last_fullsized":"2024-09-16T07:46:34.606029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.521563+0000","last_change":"2024-09-16T07:45:51.528912+0000","last_active":"2024-09-16T07:45:51.521563+0000","last_peered":"2024-09-16T07:45:51.521563+0000","last_clean":"2024-09-16T07:45:51.521563+0000","last_became_active":"2024-09-16T07:45:50.632911+0000","last_became_peered":"2024-09-16T07:45:50.632911+0000","last_unstale":"2024-09-16T07:45:51.521563+0000","last_undegraded":"2024-09-16T07:45:51.521563+0000","last_fullsized":"2024-09-16T07:45:51.521563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'447","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.755658+0000","last_change":"2024-09-16T07:45:50.704395+0000","last_active":"2024-09-16T07:46:18.755658+0000","last_peered":"2024-09-16T07:46:18.755658+0000","last_clean":"2024-09-16T07:46:18.755658+0000","last_became_active":"2024-09-16T07:45:50.690192+0000","last_became_peered":"2024-09-16T07:45:50.690192+0000","last_unstale":"2024-09-16T07:46:18.755658+0000","last_undegraded":"2024-09-16T07:46:18.755658+0000","last_fullsized":"2024-09-16T07:46:18.755658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29229056,"num_objects":446,"num_object_clones":0,"num_object_copies":1338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":446,"num_write_kb":28544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.613664+0000","last_change":"2024-09-16T07:46:33.613664+0000","last_active":"2024-09-16T07:46:33.613664+0000","last_peered":"2024-09-16T07:45:51.499250+0000","last_clean":"2024-09-16T07:45:51.499250+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:46:33.613664+0000","last_undegraded":"2024-09-16T07:46:33.613664+0000","last_fullsized":"2024-09-16T07:46:33.613664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'490","reported_seq":526,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.582711+0000","last_change":"2024-09-16T07:46:33.582711+0000","last_active":"2024-09-16T07:46:33.582711+0000","last_peered":"2024-09-16T07:46:20.729315+0000","last_clean":"2024-09-16T07:46:20.729315+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:33.582711+0000","last_undegraded":"2024-09-16T07:46:33.582711+0000","last_fullsized":"2024-09-16T07:46:33.582711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.524259+0000","last_change":"2024-09-16T07:45:51.527842+0000","last_active":"2024-09-16T07:45:51.524259+0000","last_peered":"2024-09-16T07:45:51.524259+0000","last_clean":"2024-09-16T07:45:51.524259+0000","last_became_active":"2024-09-16T07:45:50.692633+0000","last_became_peered":"2024-09-16T07:45:50.692633+0000","last_unstale":"2024-09-16T07:45:51.524259+0000","last_undegraded":"2024-09-16T07:45:51.524259+0000","last_fullsized":"2024-09-16T07:45:51.524259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"25'436","reported_seq":459,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.679738+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:46:18.679738+0000","last_peered":"2024-09-16T07:46:18.679738+0000","last_clean":"2024-09-16T07:46:18.679738+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:46:18.679738+0000","last_undegraded":"2024-09-16T07:46:18.679738+0000","last_fullsized":"2024-09-16T07:46:18.679738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.601073+0000","last_change":"2024-09-16T07:46:33.601073+0000","last_active":"2024-09-16T07:46:33.601073+0000","last_peered":"2024-09-16T07:45:51.507878+0000","last_clean":"2024-09-16T07:45:51.507878+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:46:33.601073+0000","last_undegraded":"2024-09-16T07:46:33.601073+0000","last_fullsized":"2024-09-16T07:46:33.601073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":456589312,"num_objects":6967,"num_object_clones":0,"num_object_copies":20901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6967,"num_write_kb":445888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86081536,"data_stored":1377304576,"data_compressed":65398462,"data_compressed_allocated":86081536,"data_compressed_original":1377304576,"omap_allocated":0,"internal_metadata":0},"log_size":6975,"ondisk_log_size":6975,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61476,"kb_used_data":26324,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310364,"statfs":{"total":96636764160,"available":96573812736,"internally_reserved":0,"allocated":26955776,"data_stored":427499720,"data_compressed":20297527,"data_compressed_allocated":26718208,"data_compressed_original":427409408,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50632,"kb_used_data":19380,"kb_used_omap":0,"kb_used_meta":31232,"kb_avail":94321208,"statfs":{"total":96636764160,"available":96584916992,"internally_reserved":0,"allocated":19845120,"data_stored":313791107,"data_compressed":14898446,"data_compressed_allocated":19611648,"data_compressed_original":313704448,"omap_allocated":0,"internal_metadata":31981568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53568,"kb_used_data":22576,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318272,"statfs":{"total":96636764160,"available":96581910528,"internally_reserved":0,"allocated":23117824,"data_stored":366419643,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":20,"seq":85899345949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59936,"kb_used_data":16208,"kb_used_omap":0,"kb_used_meta":43712,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":16596992,"data_stored":261821059,"data_compressed":12430614,"data_compressed_allocated":16363520,"data_compressed_original":261734400,"omap_allocated":0,"internal_metadata":44761088},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":268566528,"data_compressed":12752229,"data_compressed_allocated":16785408,"data_compressed_original":268566528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22896640,"data_stored":366346240,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19722240,"data_stored":315555840,"data_compressed":14983549,"data_compressed_allocated":19722240,"data_compressed_original":315555840,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26677248,"data_stored":426835968,"data_compressed":20267486,"data_compressed_allocated":26677248,"data_compressed_original":426835968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:47.066 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:46:47.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:47.214+0000 7f5248f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:47.225+0000 7f5248f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:47.501 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 88 16 9632 9616 6.82881 12.0625 0.0788519 0.146391 2024-09-16T07:46:47.607 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:47.607 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":109,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":32,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472794,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":10},{"state_name":"peering","count":9},{"state_name":"stale+active+clean","count":6}],"num_pgs":25,"num_pools":3,"num_objects":6971,"data_bytes":457179688,"bytes_used":231026688,"bytes_avail":386316029952,"bytes_total":386547056640,"inactive_pgs_ratio":0.36000001430511475},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:46:47.625 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:46:47.625 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:47.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:47.776+0000 7faeb6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:47.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:47.791+0000 7faeb6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:48.155 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:48.156 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:48.175 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-09-16T07:46:46.307268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":457179688,"num_objects":6971,"num_object_clones":0,"num_object_copies":20913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7047,"num_write_kb":446995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7030,"ondisk_log_size":7030,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":225612,"kb_used_data":84488,"kb_used_omap":0,"kb_used_meta":141056,"kb_avail":377261748,"statfs":{"total":386547056640,"available":386316029952,"internally_reserved":0,"allocated":86515712,"data_stored":1369531529,"data_compressed":65021785,"data_compressed_allocated":85590016,"data_compressed_original":1369194496,"omap_allocated":0,"internal_metadata":144441344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000718"},"pg_stats":[{"pgid":"3.f","version":"25'395","reported_seq":427,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:12.954045+0000","last_change":"2024-09-16T07:45:44.535560+0000","last_active":"2024-09-16T07:46:12.954045+0000","last_peered":"2024-09-16T07:46:12.954045+0000","last_clean":"2024-09-16T07:46:12.954045+0000","last_became_active":"2024-09-16T07:45:44.523789+0000","last_became_peered":"2024-09-16T07:45:44.523789+0000","last_unstale":"2024-09-16T07:46:33.558424+0000","last_undegraded":"2024-09-16T07:46:12.954045+0000","last_fullsized":"2024-09-16T07:46:12.954045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'429","reported_seq":452,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.486362+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:46:18.486362+0000","last_peered":"2024-09-16T07:46:18.486362+0000","last_clean":"2024-09-16T07:46:18.486362+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:46:18.486362+0000","last_undegraded":"2024-09-16T07:46:18.486362+0000","last_fullsized":"2024-09-16T07:46:18.486362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049408,"num_objects":428,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":27392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'437","reported_seq":474,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.604809+0000","last_change":"2024-09-16T07:46:33.614981+0000","last_active":"2024-09-16T07:46:33.614981+0000","last_peered":"2024-09-16T07:46:20.807285+0000","last_clean":"2024-09-16T07:46:20.807285+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:34.604809+0000","last_undegraded":"2024-09-16T07:46:34.604809+0000","last_fullsized":"2024-09-16T07:46:34.604809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":437,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'342","reported_seq":375,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.292186+0000","last_change":"2024-09-16T07:45:50.902218+0000","last_active":"2024-09-16T07:46:13.292186+0000","last_peered":"2024-09-16T07:46:13.292186+0000","last_clean":"2024-09-16T07:46:13.292186+0000","last_became_active":"2024-09-16T07:45:50.691944+0000","last_became_peered":"2024-09-16T07:45:50.691944+0000","last_unstale":"2024-09-16T07:46:33.558428+0000","last_undegraded":"2024-09-16T07:46:13.292186+0000","last_fullsized":"2024-09-16T07:46:13.292186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'451","reported_seq":490,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.615849+0000","last_change":"2024-09-16T07:46:33.615849+0000","last_active":"2024-09-16T07:46:33.615849+0000","last_peered":"2024-09-16T07:46:20.759422+0000","last_clean":"2024-09-16T07:46:20.759422+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:33.615849+0000","last_undegraded":"2024-09-16T07:46:33.615849+0000","last_fullsized":"2024-09-16T07:46:33.615849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'355","reported_seq":381,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.308341+0000","last_change":"2024-09-16T07:45:50.666069+0000","last_active":"2024-09-16T07:46:13.308341+0000","last_peered":"2024-09-16T07:46:13.308341+0000","last_clean":"2024-09-16T07:46:13.308341+0000","last_became_active":"2024-09-16T07:45:50.653189+0000","last_became_peered":"2024-09-16T07:45:50.653189+0000","last_unstale":"2024-09-16T07:46:33.558430+0000","last_undegraded":"2024-09-16T07:46:13.308341+0000","last_fullsized":"2024-09-16T07:46:13.308341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'390","reported_seq":416,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.247682+0000","last_change":"2024-09-16T07:45:50.622899+0000","last_active":"2024-09-16T07:46:13.247682+0000","last_peered":"2024-09-16T07:46:13.247682+0000","last_clean":"2024-09-16T07:46:13.247682+0000","last_became_active":"2024-09-16T07:45:50.606399+0000","last_became_peered":"2024-09-16T07:45:50.606399+0000","last_unstale":"2024-09-16T07:46:33.558433+0000","last_undegraded":"2024-09-16T07:46:13.247682+0000","last_fullsized":"2024-09-16T07:46:13.247682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'440","reported_seq":485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.613447+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:34.613447+0000","last_peered":"2024-09-16T07:46:34.613447+0000","last_clean":"2024-09-16T07:46:34.613447+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:34.613447+0000","last_undegraded":"2024-09-16T07:46:34.613447+0000","last_fullsized":"2024-09-16T07:46:34.613447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":115,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.594594+0000","last_change":"2024-09-16T07:46:33.594594+0000","last_active":"2024-09-16T07:46:33.594594+0000","last_peered":"2024-09-16T07:45:51.484915+0000","last_clean":"2024-09-16T07:45:51.484915+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:46:33.594594+0000","last_undegraded":"2024-09-16T07:46:33.594594+0000","last_fullsized":"2024-09-16T07:46:33.594594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":45,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.608687+0000","last_change":"2024-09-16T07:46:33.608687+0000","last_active":"2024-09-16T07:46:33.608687+0000","last_peered":"2024-09-16T07:45:51.505238+0000","last_clean":"2024-09-16T07:45:51.505238+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:46:33.608687+0000","last_undegraded":"2024-09-16T07:46:33.608687+0000","last_fullsized":"2024-09-16T07:46:33.608687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'476","reported_seq":513,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.603544+0000","last_change":"2024-09-16T07:46:33.602602+0000","last_active":"2024-09-16T07:46:33.602602+0000","last_peered":"2024-09-16T07:46:20.769086+0000","last_clean":"2024-09-16T07:46:20.769086+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:34.603544+0000","last_undegraded":"2024-09-16T07:46:34.603544+0000","last_fullsized":"2024-09-16T07:46:34.603544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":476,"num_write_kb":30464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.513996+0000","last_change":"2024-09-16T07:45:51.521750+0000","last_active":"2024-09-16T07:45:51.513996+0000","last_peered":"2024-09-16T07:45:51.513996+0000","last_clean":"2024-09-16T07:45:51.513996+0000","last_became_active":"2024-09-16T07:45:50.665366+0000","last_became_peered":"2024-09-16T07:45:50.665366+0000","last_unstale":"2024-09-16T07:46:33.558437+0000","last_undegraded":"2024-09-16T07:45:51.513996+0000","last_fullsized":"2024-09-16T07:45:51.513996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'459","reported_seq":496,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.583420+0000","last_change":"2024-09-16T07:46:33.579664+0000","last_active":"2024-09-16T07:46:33.579664+0000","last_peered":"2024-09-16T07:46:20.817119+0000","last_clean":"2024-09-16T07:46:20.817119+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:34.583420+0000","last_undegraded":"2024-09-16T07:46:34.583420+0000","last_fullsized":"2024-09-16T07:46:34.583420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30081024,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":29376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.584979+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:34.584979+0000","last_peered":"2024-09-16T07:46:34.584979+0000","last_clean":"2024-09-16T07:46:34.584979+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:34.584979+0000","last_undegraded":"2024-09-16T07:46:34.584979+0000","last_fullsized":"2024-09-16T07:46:34.584979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'463","reported_seq":510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.602455+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:34.602455+0000","last_peered":"2024-09-16T07:46:34.602455+0000","last_clean":"2024-09-16T07:46:34.602455+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:34.602455+0000","last_undegraded":"2024-09-16T07:46:34.602455+0000","last_fullsized":"2024-09-16T07:46:34.602455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30343168,"num_objects":463,"num_object_clones":0,"num_object_copies":1389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":463,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":33,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.511360+0000","last_change":"2024-09-16T07:45:51.520543+0000","last_active":"2024-09-16T07:45:51.511360+0000","last_peered":"2024-09-16T07:45:51.511360+0000","last_clean":"2024-09-16T07:45:51.511360+0000","last_became_active":"2024-09-16T07:45:50.656425+0000","last_became_peered":"2024-09-16T07:45:50.656425+0000","last_unstale":"2024-09-16T07:46:33.558440+0000","last_undegraded":"2024-09-16T07:45:51.511360+0000","last_fullsized":"2024-09-16T07:45:51.511360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'440","reported_seq":463,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.600917+0000","last_change":"2024-09-16T07:45:50.662284+0000","last_active":"2024-09-16T07:46:18.600917+0000","last_peered":"2024-09-16T07:46:18.600917+0000","last_clean":"2024-09-16T07:46:18.600917+0000","last_became_active":"2024-09-16T07:45:50.648809+0000","last_became_peered":"2024-09-16T07:45:50.648809+0000","last_unstale":"2024-09-16T07:46:18.600917+0000","last_undegraded":"2024-09-16T07:46:18.600917+0000","last_fullsized":"2024-09-16T07:46:18.600917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"25'525","reported_seq":565,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.606029+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:34.606029+0000","last_peered":"2024-09-16T07:46:34.606029+0000","last_clean":"2024-09-16T07:46:34.606029+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:34.606029+0000","last_undegraded":"2024-09-16T07:46:34.606029+0000","last_fullsized":"2024-09-16T07:46:34.606029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.521563+0000","last_change":"2024-09-16T07:45:51.528912+0000","last_active":"2024-09-16T07:45:51.521563+0000","last_peered":"2024-09-16T07:45:51.521563+0000","last_clean":"2024-09-16T07:45:51.521563+0000","last_became_active":"2024-09-16T07:45:50.632911+0000","last_became_peered":"2024-09-16T07:45:50.632911+0000","last_unstale":"2024-09-16T07:45:51.521563+0000","last_undegraded":"2024-09-16T07:45:51.521563+0000","last_fullsized":"2024-09-16T07:45:51.521563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'447","reported_seq":470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.755658+0000","last_change":"2024-09-16T07:45:50.704395+0000","last_active":"2024-09-16T07:46:18.755658+0000","last_peered":"2024-09-16T07:46:18.755658+0000","last_clean":"2024-09-16T07:46:18.755658+0000","last_became_active":"2024-09-16T07:45:50.690192+0000","last_became_peered":"2024-09-16T07:45:50.690192+0000","last_unstale":"2024-09-16T07:46:18.755658+0000","last_undegraded":"2024-09-16T07:46:18.755658+0000","last_fullsized":"2024-09-16T07:46:18.755658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29229056,"num_objects":446,"num_object_clones":0,"num_object_copies":1338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":446,"num_write_kb":28544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.613664+0000","last_change":"2024-09-16T07:46:33.613664+0000","last_active":"2024-09-16T07:46:33.613664+0000","last_peered":"2024-09-16T07:45:51.499250+0000","last_clean":"2024-09-16T07:45:51.499250+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:46:33.613664+0000","last_undegraded":"2024-09-16T07:46:33.613664+0000","last_fullsized":"2024-09-16T07:46:33.613664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'490","reported_seq":526,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.582711+0000","last_change":"2024-09-16T07:46:33.582711+0000","last_active":"2024-09-16T07:46:33.582711+0000","last_peered":"2024-09-16T07:46:20.729315+0000","last_clean":"2024-09-16T07:46:20.729315+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:33.582711+0000","last_undegraded":"2024-09-16T07:46:33.582711+0000","last_fullsized":"2024-09-16T07:46:33.582711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:45:51.524259+0000","last_change":"2024-09-16T07:45:51.527842+0000","last_active":"2024-09-16T07:45:51.524259+0000","last_peered":"2024-09-16T07:45:51.524259+0000","last_clean":"2024-09-16T07:45:51.524259+0000","last_became_active":"2024-09-16T07:45:50.692633+0000","last_became_peered":"2024-09-16T07:45:50.692633+0000","last_unstale":"2024-09-16T07:45:51.524259+0000","last_undegraded":"2024-09-16T07:45:51.524259+0000","last_fullsized":"2024-09-16T07:45:51.524259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"25'436","reported_seq":459,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:46:18.679738+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:46:18.679738+0000","last_peered":"2024-09-16T07:46:18.679738+0000","last_clean":"2024-09-16T07:46:18.679738+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:46:18.679738+0000","last_undegraded":"2024-09-16T07:46:18.679738+0000","last_fullsized":"2024-09-16T07:46:18.679738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.601073+0000","last_change":"2024-09-16T07:46:33.601073+0000","last_active":"2024-09-16T07:46:33.601073+0000","last_peered":"2024-09-16T07:45:51.507878+0000","last_clean":"2024-09-16T07:45:51.507878+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:46:33.601073+0000","last_undegraded":"2024-09-16T07:46:33.601073+0000","last_fullsized":"2024-09-16T07:46:33.601073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":456589312,"num_objects":6967,"num_object_clones":0,"num_object_copies":20901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6967,"num_write_kb":445888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86081536,"data_stored":1377304576,"data_compressed":65398462,"data_compressed_allocated":86081536,"data_compressed_original":1377304576,"omap_allocated":0,"internal_metadata":0},"log_size":6975,"ondisk_log_size":6975,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61476,"kb_used_data":26324,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310364,"statfs":{"total":96636764160,"available":96573812736,"internally_reserved":0,"allocated":26955776,"data_stored":427499720,"data_compressed":20297527,"data_compressed_allocated":26718208,"data_compressed_original":427409408,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50632,"kb_used_data":19380,"kb_used_omap":0,"kb_used_meta":31232,"kb_avail":94321208,"statfs":{"total":96636764160,"available":96584916992,"internally_reserved":0,"allocated":19845120,"data_stored":313791107,"data_compressed":14898446,"data_compressed_allocated":19611648,"data_compressed_original":313704448,"omap_allocated":0,"internal_metadata":31981568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53568,"kb_used_data":22576,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318272,"statfs":{"total":96636764160,"available":96581910528,"internally_reserved":0,"allocated":23117824,"data_stored":366419643,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":20,"seq":85899345949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59936,"kb_used_data":16208,"kb_used_omap":0,"kb_used_meta":43712,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":16596992,"data_stored":261821059,"data_compressed":12430614,"data_compressed_allocated":16363520,"data_compressed_original":261734400,"omap_allocated":0,"internal_metadata":44761088},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":268566528,"data_compressed":12752229,"data_compressed_allocated":16785408,"data_compressed_original":268566528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22896640,"data_stored":366346240,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19722240,"data_stored":315555840,"data_compressed":14983549,"data_compressed_allocated":19722240,"data_compressed_original":315555840,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26677248,"data_stored":426835968,"data_compressed":20267486,"data_compressed_allocated":26677248,"data_compressed_original":426835968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:48.501 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 89 16 9821 9805 6.88479 11.8125 0.0925374 0.145185 2024-09-16T07:46:48.505 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:48.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:48.660+0000 7f5a97991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:48.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:48.670+0000 7f5a97991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:49.501 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 90 14 10015 10001 6.94439 12.25 0.0642927 0.143928 2024-09-16T07:46:50.502 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Total time run: 90.052 2024-09-16T07:46:50.502 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Total writes made: 10015 2024-09-16T07:46:50.502 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Write size: 65536 2024-09-16T07:46:50.502 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Object size: 65536 2024-09-16T07:46:50.502 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Bandwidth (MB/sec): 6.95084 2024-09-16T07:46:50.502 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev Bandwidth: 6.01747 2024-09-16T07:46:50.502 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max bandwidth (MB/sec): 13.1875 2024-09-16T07:46:50.502 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min bandwidth (MB/sec): 0 2024-09-16T07:46:50.503 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Average IOPS: 111 2024-09-16T07:46:50.503 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev IOPS: 96.2895 2024-09-16T07:46:50.503 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max IOPS: 211 2024-09-16T07:46:50.503 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min IOPS: 0 2024-09-16T07:46:50.503 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Average Latency(s): 0.14383 2024-09-16T07:46:50.503 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev Latency(s): 1.10943 2024-09-16T07:46:50.503 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max latency(s): 23.4475 2024-09-16T07:46:50.503 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min latency(s): 0.0163118 2024-09-16T07:46:50.529 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T07:46:51.142 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:51.177 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:51.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:51.296+0000 7f07d06d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:51.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:51.316+0000 7f07d06d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:51.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:51.353+0000 7f16f2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:51.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:51.367+0000 7f16f2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:51.664 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:51.665 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:51.685 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-09-16T07:46:50.308109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":504037928,"num_objects":7686,"num_object_clones":0,"num_object_copies":23058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7762,"num_write_kb":492755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":851968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7745,"ondisk_log_size":7745,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":241784,"kb_used_data":92344,"kb_used_omap":0,"kb_used_meta":149376,"kb_avail":377245576,"statfs":{"total":386547056640,"available":386299469824,"internally_reserved":0,"allocated":94560256,"data_stored":1497350716,"data_compressed":71090185,"data_compressed_allocated":93577216,"data_compressed_original":1496989696,"omap_allocated":0,"internal_metadata":152961024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46858240,"num_objects":715,"num_object_clones":0,"num_object_copies":2145,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":45760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.362991"},"pg_stats":[{"pgid":"3.f","version":"25'395","reported_seq":427,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:12.954045+0000","last_change":"2024-09-16T07:45:44.535560+0000","last_active":"2024-09-16T07:46:12.954045+0000","last_peered":"2024-09-16T07:46:12.954045+0000","last_clean":"2024-09-16T07:46:12.954045+0000","last_became_active":"2024-09-16T07:45:44.523789+0000","last_became_peered":"2024-09-16T07:45:44.523789+0000","last_unstale":"2024-09-16T07:46:33.558424+0000","last_undegraded":"2024-09-16T07:46:12.954045+0000","last_fullsized":"2024-09-16T07:46:12.954045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'604","reported_seq":648,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.651531+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:46:48.651531+0000","last_peered":"2024-09-16T07:46:48.651531+0000","last_clean":"2024-09-16T07:46:48.651531+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:46:48.651531+0000","last_undegraded":"2024-09-16T07:46:48.651531+0000","last_fullsized":"2024-09-16T07:46:48.651531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'437","reported_seq":474,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.604809+0000","last_change":"2024-09-16T07:46:33.614981+0000","last_active":"2024-09-16T07:46:33.614981+0000","last_peered":"2024-09-16T07:46:20.807285+0000","last_clean":"2024-09-16T07:46:20.807285+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:34.604809+0000","last_undegraded":"2024-09-16T07:46:34.604809+0000","last_fullsized":"2024-09-16T07:46:34.604809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":437,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'342","reported_seq":375,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.292186+0000","last_change":"2024-09-16T07:45:50.902218+0000","last_active":"2024-09-16T07:46:13.292186+0000","last_peered":"2024-09-16T07:46:13.292186+0000","last_clean":"2024-09-16T07:46:13.292186+0000","last_became_active":"2024-09-16T07:45:50.691944+0000","last_became_peered":"2024-09-16T07:45:50.691944+0000","last_unstale":"2024-09-16T07:46:33.558428+0000","last_undegraded":"2024-09-16T07:46:13.292186+0000","last_fullsized":"2024-09-16T07:46:13.292186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'451","reported_seq":490,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.615849+0000","last_change":"2024-09-16T07:46:33.615849+0000","last_active":"2024-09-16T07:46:33.615849+0000","last_peered":"2024-09-16T07:46:20.759422+0000","last_clean":"2024-09-16T07:46:20.759422+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:33.615849+0000","last_undegraded":"2024-09-16T07:46:33.615849+0000","last_fullsized":"2024-09-16T07:46:33.615849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'355","reported_seq":381,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.308341+0000","last_change":"2024-09-16T07:45:50.666069+0000","last_active":"2024-09-16T07:46:13.308341+0000","last_peered":"2024-09-16T07:46:13.308341+0000","last_clean":"2024-09-16T07:46:13.308341+0000","last_became_active":"2024-09-16T07:45:50.653189+0000","last_became_peered":"2024-09-16T07:45:50.653189+0000","last_unstale":"2024-09-16T07:46:33.558430+0000","last_undegraded":"2024-09-16T07:46:13.308341+0000","last_fullsized":"2024-09-16T07:46:13.308341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'390","reported_seq":416,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.247682+0000","last_change":"2024-09-16T07:45:50.622899+0000","last_active":"2024-09-16T07:46:13.247682+0000","last_peered":"2024-09-16T07:46:13.247682+0000","last_clean":"2024-09-16T07:46:13.247682+0000","last_became_active":"2024-09-16T07:45:50.606399+0000","last_became_peered":"2024-09-16T07:45:50.606399+0000","last_unstale":"2024-09-16T07:46:33.558433+0000","last_undegraded":"2024-09-16T07:46:13.247682+0000","last_fullsized":"2024-09-16T07:46:13.247682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'440","reported_seq":485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.613447+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:34.613447+0000","last_peered":"2024-09-16T07:46:34.613447+0000","last_clean":"2024-09-16T07:46:34.613447+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:34.613447+0000","last_undegraded":"2024-09-16T07:46:34.613447+0000","last_fullsized":"2024-09-16T07:46:34.613447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":115,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.594594+0000","last_change":"2024-09-16T07:46:33.594594+0000","last_active":"2024-09-16T07:46:33.594594+0000","last_peered":"2024-09-16T07:45:51.484915+0000","last_clean":"2024-09-16T07:45:51.484915+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:46:33.594594+0000","last_undegraded":"2024-09-16T07:46:33.594594+0000","last_fullsized":"2024-09-16T07:46:33.594594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":45,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.608687+0000","last_change":"2024-09-16T07:46:33.608687+0000","last_active":"2024-09-16T07:46:33.608687+0000","last_peered":"2024-09-16T07:45:51.505238+0000","last_clean":"2024-09-16T07:45:51.505238+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:46:33.608687+0000","last_undegraded":"2024-09-16T07:46:33.608687+0000","last_fullsized":"2024-09-16T07:46:33.608687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'476","reported_seq":513,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.603544+0000","last_change":"2024-09-16T07:46:33.602602+0000","last_active":"2024-09-16T07:46:33.602602+0000","last_peered":"2024-09-16T07:46:20.769086+0000","last_clean":"2024-09-16T07:46:20.769086+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:34.603544+0000","last_undegraded":"2024-09-16T07:46:34.603544+0000","last_fullsized":"2024-09-16T07:46:34.603544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":476,"num_write_kb":30464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.513996+0000","last_change":"2024-09-16T07:45:51.521750+0000","last_active":"2024-09-16T07:45:51.513996+0000","last_peered":"2024-09-16T07:45:51.513996+0000","last_clean":"2024-09-16T07:45:51.513996+0000","last_became_active":"2024-09-16T07:45:50.665366+0000","last_became_peered":"2024-09-16T07:45:50.665366+0000","last_unstale":"2024-09-16T07:46:33.558437+0000","last_undegraded":"2024-09-16T07:45:51.513996+0000","last_fullsized":"2024-09-16T07:45:51.513996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'459","reported_seq":496,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.583420+0000","last_change":"2024-09-16T07:46:33.579664+0000","last_active":"2024-09-16T07:46:33.579664+0000","last_peered":"2024-09-16T07:46:20.817119+0000","last_clean":"2024-09-16T07:46:20.817119+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:34.583420+0000","last_undegraded":"2024-09-16T07:46:34.583420+0000","last_fullsized":"2024-09-16T07:46:34.583420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30081024,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":29376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.584979+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:34.584979+0000","last_peered":"2024-09-16T07:46:34.584979+0000","last_clean":"2024-09-16T07:46:34.584979+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:34.584979+0000","last_undegraded":"2024-09-16T07:46:34.584979+0000","last_fullsized":"2024-09-16T07:46:34.584979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'463","reported_seq":510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.602455+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:34.602455+0000","last_peered":"2024-09-16T07:46:34.602455+0000","last_clean":"2024-09-16T07:46:34.602455+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:34.602455+0000","last_undegraded":"2024-09-16T07:46:34.602455+0000","last_fullsized":"2024-09-16T07:46:34.602455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30343168,"num_objects":463,"num_object_clones":0,"num_object_copies":1389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":463,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":33,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.511360+0000","last_change":"2024-09-16T07:45:51.520543+0000","last_active":"2024-09-16T07:45:51.511360+0000","last_peered":"2024-09-16T07:45:51.511360+0000","last_clean":"2024-09-16T07:45:51.511360+0000","last_became_active":"2024-09-16T07:45:50.656425+0000","last_became_peered":"2024-09-16T07:45:50.656425+0000","last_unstale":"2024-09-16T07:46:33.558440+0000","last_undegraded":"2024-09-16T07:45:51.511360+0000","last_fullsized":"2024-09-16T07:45:51.511360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'593","reported_seq":638,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.680405+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:46:48.680405+0000","last_peered":"2024-09-16T07:46:48.680405+0000","last_clean":"2024-09-16T07:46:48.680405+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:46:48.680405+0000","last_undegraded":"2024-09-16T07:46:48.680405+0000","last_fullsized":"2024-09-16T07:46:48.680405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"25'525","reported_seq":565,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.606029+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:34.606029+0000","last_peered":"2024-09-16T07:46:34.606029+0000","last_clean":"2024-09-16T07:46:34.606029+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:34.606029+0000","last_undegraded":"2024-09-16T07:46:34.606029+0000","last_fullsized":"2024-09-16T07:46:34.606029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'647","reported_seq":705,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.629129+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:46:48.629129+0000","last_peered":"2024-09-16T07:46:48.629129+0000","last_clean":"2024-09-16T07:46:48.629129+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:46:48.629129+0000","last_undegraded":"2024-09-16T07:46:48.629129+0000","last_fullsized":"2024-09-16T07:46:48.629129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.613664+0000","last_change":"2024-09-16T07:46:33.613664+0000","last_active":"2024-09-16T07:46:33.613664+0000","last_peered":"2024-09-16T07:45:51.499250+0000","last_clean":"2024-09-16T07:45:51.499250+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:46:33.613664+0000","last_undegraded":"2024-09-16T07:46:33.613664+0000","last_fullsized":"2024-09-16T07:46:33.613664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'490","reported_seq":526,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.582711+0000","last_change":"2024-09-16T07:46:33.582711+0000","last_active":"2024-09-16T07:46:33.582711+0000","last_peered":"2024-09-16T07:46:20.729315+0000","last_clean":"2024-09-16T07:46:20.729315+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:33.582711+0000","last_undegraded":"2024-09-16T07:46:33.582711+0000","last_fullsized":"2024-09-16T07:46:33.582711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'623","reported_seq":667,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.609305+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:46:48.609305+0000","last_peered":"2024-09-16T07:46:48.609305+0000","last_clean":"2024-09-16T07:46:48.609305+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:46:48.609305+0000","last_undegraded":"2024-09-16T07:46:48.609305+0000","last_fullsized":"2024-09-16T07:46:48.609305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40763392,"num_objects":622,"num_object_clones":0,"num_object_copies":1866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":39808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.601073+0000","last_change":"2024-09-16T07:46:33.601073+0000","last_active":"2024-09-16T07:46:33.601073+0000","last_peered":"2024-09-16T07:45:51.507878+0000","last_clean":"2024-09-16T07:45:51.507878+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:46:33.601073+0000","last_undegraded":"2024-09-16T07:46:33.601073+0000","last_fullsized":"2024-09-16T07:46:33.601073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":503447552,"num_objects":7682,"num_object_clones":0,"num_object_copies":23046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7682,"num_write_kb":491648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":851968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94031872,"data_stored":1504509952,"data_compressed":71438854,"data_compressed_allocated":94031872,"data_compressed_original":1504509952,"omap_allocated":0,"internal_metadata":0},"log_size":7690,"ondisk_log_size":7690,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61476,"kb_used_data":26324,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310364,"statfs":{"total":96636764160,"available":96573812736,"internally_reserved":0,"allocated":26955776,"data_stored":427499720,"data_compressed":20297527,"data_compressed_allocated":26718208,"data_compressed_original":427409408,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66804,"kb_used_data":27236,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94305036,"statfs":{"total":96636764160,"available":96568356864,"internally_reserved":0,"allocated":27889664,"data_stored":441610294,"data_compressed":20966846,"data_compressed_allocated":27598848,"data_compressed_original":441499648,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53568,"kb_used_data":22576,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318272,"statfs":{"total":96636764160,"available":96581910528,"internally_reserved":0,"allocated":23117824,"data_stored":366419643,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":20,"seq":85899345949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59936,"kb_used_data":16208,"kb_used_omap":0,"kb_used_meta":43712,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":16596992,"data_stored":261821059,"data_compressed":12430614,"data_compressed_allocated":16363520,"data_compressed_original":261734400,"omap_allocated":0,"internal_metadata":44761088},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":268566528,"data_compressed":12752229,"data_compressed_allocated":16785408,"data_compressed_original":268566528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22896640,"data_stored":366346240,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27672576,"data_stored":442761216,"data_compressed":21023941,"data_compressed_allocated":27672576,"data_compressed_original":442761216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26677248,"data_stored":426835968,"data_compressed":20267486,"data_compressed_allocated":26677248,"data_compressed_original":426835968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:51.687 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:46:51.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:51.859+0000 7f23faefd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:51.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:51.871+0000 7f23faefd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:52.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:52.339 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":114,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":32,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472794,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":10},{"state_name":"peering","count":9},{"state_name":"stale+active+clean","count":6}],"num_pgs":25,"num_pools":3,"num_objects":7686,"data_bytes":504037928,"bytes_used":247586816,"bytes_avail":386299469824,"bytes_total":386547056640,"inactive_pgs_ratio":0.36000001430511475,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":51497,"recovering_keys_per_sec":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"write_bytes_sec":7364183,"read_op_per_sec":0,"write_op_per_sec":112},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:46:52.363 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:46:52.363 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:52.523+0000 7f0813a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:52.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:52.538+0000 7f0813a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:52.921 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:52.921 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:52.936 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-09-16T07:46:52.308811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":504037928,"num_objects":7686,"num_object_clones":0,"num_object_copies":23058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7762,"num_write_kb":492755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":851968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7745,"ondisk_log_size":7745,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":241784,"kb_used_data":92344,"kb_used_omap":0,"kb_used_meta":149376,"kb_avail":377245576,"statfs":{"total":386547056640,"available":386299469824,"internally_reserved":0,"allocated":94560256,"data_stored":1497350716,"data_compressed":71090185,"data_compressed_allocated":93577216,"data_compressed_original":1496989696,"omap_allocated":0,"internal_metadata":152961024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46858240,"num_objects":715,"num_object_clones":0,"num_object_copies":2145,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":45760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001915"},"pg_stats":[{"pgid":"3.f","version":"25'395","reported_seq":427,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:12.954045+0000","last_change":"2024-09-16T07:45:44.535560+0000","last_active":"2024-09-16T07:46:12.954045+0000","last_peered":"2024-09-16T07:46:12.954045+0000","last_clean":"2024-09-16T07:46:12.954045+0000","last_became_active":"2024-09-16T07:45:44.523789+0000","last_became_peered":"2024-09-16T07:45:44.523789+0000","last_unstale":"2024-09-16T07:46:33.558424+0000","last_undegraded":"2024-09-16T07:46:12.954045+0000","last_fullsized":"2024-09-16T07:46:12.954045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'604","reported_seq":648,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.651531+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:46:48.651531+0000","last_peered":"2024-09-16T07:46:48.651531+0000","last_clean":"2024-09-16T07:46:48.651531+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:46:48.651531+0000","last_undegraded":"2024-09-16T07:46:48.651531+0000","last_fullsized":"2024-09-16T07:46:48.651531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'437","reported_seq":474,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.604809+0000","last_change":"2024-09-16T07:46:33.614981+0000","last_active":"2024-09-16T07:46:33.614981+0000","last_peered":"2024-09-16T07:46:20.807285+0000","last_clean":"2024-09-16T07:46:20.807285+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:34.604809+0000","last_undegraded":"2024-09-16T07:46:34.604809+0000","last_fullsized":"2024-09-16T07:46:34.604809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":437,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'342","reported_seq":375,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.292186+0000","last_change":"2024-09-16T07:45:50.902218+0000","last_active":"2024-09-16T07:46:13.292186+0000","last_peered":"2024-09-16T07:46:13.292186+0000","last_clean":"2024-09-16T07:46:13.292186+0000","last_became_active":"2024-09-16T07:45:50.691944+0000","last_became_peered":"2024-09-16T07:45:50.691944+0000","last_unstale":"2024-09-16T07:46:33.558428+0000","last_undegraded":"2024-09-16T07:46:13.292186+0000","last_fullsized":"2024-09-16T07:46:13.292186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'451","reported_seq":490,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.615849+0000","last_change":"2024-09-16T07:46:33.615849+0000","last_active":"2024-09-16T07:46:33.615849+0000","last_peered":"2024-09-16T07:46:20.759422+0000","last_clean":"2024-09-16T07:46:20.759422+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:33.615849+0000","last_undegraded":"2024-09-16T07:46:33.615849+0000","last_fullsized":"2024-09-16T07:46:33.615849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'355","reported_seq":381,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.308341+0000","last_change":"2024-09-16T07:45:50.666069+0000","last_active":"2024-09-16T07:46:13.308341+0000","last_peered":"2024-09-16T07:46:13.308341+0000","last_clean":"2024-09-16T07:46:13.308341+0000","last_became_active":"2024-09-16T07:45:50.653189+0000","last_became_peered":"2024-09-16T07:45:50.653189+0000","last_unstale":"2024-09-16T07:46:33.558430+0000","last_undegraded":"2024-09-16T07:46:13.308341+0000","last_fullsized":"2024-09-16T07:46:13.308341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'390","reported_seq":416,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.247682+0000","last_change":"2024-09-16T07:45:50.622899+0000","last_active":"2024-09-16T07:46:13.247682+0000","last_peered":"2024-09-16T07:46:13.247682+0000","last_clean":"2024-09-16T07:46:13.247682+0000","last_became_active":"2024-09-16T07:45:50.606399+0000","last_became_peered":"2024-09-16T07:45:50.606399+0000","last_unstale":"2024-09-16T07:46:33.558433+0000","last_undegraded":"2024-09-16T07:46:13.247682+0000","last_fullsized":"2024-09-16T07:46:13.247682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'440","reported_seq":485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.613447+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:34.613447+0000","last_peered":"2024-09-16T07:46:34.613447+0000","last_clean":"2024-09-16T07:46:34.613447+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:34.613447+0000","last_undegraded":"2024-09-16T07:46:34.613447+0000","last_fullsized":"2024-09-16T07:46:34.613447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":115,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.594594+0000","last_change":"2024-09-16T07:46:33.594594+0000","last_active":"2024-09-16T07:46:33.594594+0000","last_peered":"2024-09-16T07:45:51.484915+0000","last_clean":"2024-09-16T07:45:51.484915+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:46:33.594594+0000","last_undegraded":"2024-09-16T07:46:33.594594+0000","last_fullsized":"2024-09-16T07:46:33.594594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":45,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.608687+0000","last_change":"2024-09-16T07:46:33.608687+0000","last_active":"2024-09-16T07:46:33.608687+0000","last_peered":"2024-09-16T07:45:51.505238+0000","last_clean":"2024-09-16T07:45:51.505238+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:46:33.608687+0000","last_undegraded":"2024-09-16T07:46:33.608687+0000","last_fullsized":"2024-09-16T07:46:33.608687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'476","reported_seq":513,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.603544+0000","last_change":"2024-09-16T07:46:33.602602+0000","last_active":"2024-09-16T07:46:33.602602+0000","last_peered":"2024-09-16T07:46:20.769086+0000","last_clean":"2024-09-16T07:46:20.769086+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:34.603544+0000","last_undegraded":"2024-09-16T07:46:34.603544+0000","last_fullsized":"2024-09-16T07:46:34.603544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":476,"num_write_kb":30464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.513996+0000","last_change":"2024-09-16T07:45:51.521750+0000","last_active":"2024-09-16T07:45:51.513996+0000","last_peered":"2024-09-16T07:45:51.513996+0000","last_clean":"2024-09-16T07:45:51.513996+0000","last_became_active":"2024-09-16T07:45:50.665366+0000","last_became_peered":"2024-09-16T07:45:50.665366+0000","last_unstale":"2024-09-16T07:46:33.558437+0000","last_undegraded":"2024-09-16T07:45:51.513996+0000","last_fullsized":"2024-09-16T07:45:51.513996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'459","reported_seq":496,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.583420+0000","last_change":"2024-09-16T07:46:33.579664+0000","last_active":"2024-09-16T07:46:33.579664+0000","last_peered":"2024-09-16T07:46:20.817119+0000","last_clean":"2024-09-16T07:46:20.817119+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:34.583420+0000","last_undegraded":"2024-09-16T07:46:34.583420+0000","last_fullsized":"2024-09-16T07:46:34.583420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30081024,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":29376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.584979+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:34.584979+0000","last_peered":"2024-09-16T07:46:34.584979+0000","last_clean":"2024-09-16T07:46:34.584979+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:34.584979+0000","last_undegraded":"2024-09-16T07:46:34.584979+0000","last_fullsized":"2024-09-16T07:46:34.584979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'463","reported_seq":510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.602455+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:34.602455+0000","last_peered":"2024-09-16T07:46:34.602455+0000","last_clean":"2024-09-16T07:46:34.602455+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:34.602455+0000","last_undegraded":"2024-09-16T07:46:34.602455+0000","last_fullsized":"2024-09-16T07:46:34.602455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30343168,"num_objects":463,"num_object_clones":0,"num_object_copies":1389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":463,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":33,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.511360+0000","last_change":"2024-09-16T07:45:51.520543+0000","last_active":"2024-09-16T07:45:51.511360+0000","last_peered":"2024-09-16T07:45:51.511360+0000","last_clean":"2024-09-16T07:45:51.511360+0000","last_became_active":"2024-09-16T07:45:50.656425+0000","last_became_peered":"2024-09-16T07:45:50.656425+0000","last_unstale":"2024-09-16T07:46:33.558440+0000","last_undegraded":"2024-09-16T07:45:51.511360+0000","last_fullsized":"2024-09-16T07:45:51.511360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'593","reported_seq":638,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.680405+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:46:48.680405+0000","last_peered":"2024-09-16T07:46:48.680405+0000","last_clean":"2024-09-16T07:46:48.680405+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:46:48.680405+0000","last_undegraded":"2024-09-16T07:46:48.680405+0000","last_fullsized":"2024-09-16T07:46:48.680405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"25'525","reported_seq":565,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.606029+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:34.606029+0000","last_peered":"2024-09-16T07:46:34.606029+0000","last_clean":"2024-09-16T07:46:34.606029+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:34.606029+0000","last_undegraded":"2024-09-16T07:46:34.606029+0000","last_fullsized":"2024-09-16T07:46:34.606029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'647","reported_seq":705,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.629129+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:46:48.629129+0000","last_peered":"2024-09-16T07:46:48.629129+0000","last_clean":"2024-09-16T07:46:48.629129+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:46:48.629129+0000","last_undegraded":"2024-09-16T07:46:48.629129+0000","last_fullsized":"2024-09-16T07:46:48.629129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.613664+0000","last_change":"2024-09-16T07:46:33.613664+0000","last_active":"2024-09-16T07:46:33.613664+0000","last_peered":"2024-09-16T07:45:51.499250+0000","last_clean":"2024-09-16T07:45:51.499250+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:46:33.613664+0000","last_undegraded":"2024-09-16T07:46:33.613664+0000","last_fullsized":"2024-09-16T07:46:33.613664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'490","reported_seq":526,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.582711+0000","last_change":"2024-09-16T07:46:33.582711+0000","last_active":"2024-09-16T07:46:33.582711+0000","last_peered":"2024-09-16T07:46:20.729315+0000","last_clean":"2024-09-16T07:46:20.729315+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:33.582711+0000","last_undegraded":"2024-09-16T07:46:33.582711+0000","last_fullsized":"2024-09-16T07:46:33.582711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'623","reported_seq":667,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.609305+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:46:48.609305+0000","last_peered":"2024-09-16T07:46:48.609305+0000","last_clean":"2024-09-16T07:46:48.609305+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:46:48.609305+0000","last_undegraded":"2024-09-16T07:46:48.609305+0000","last_fullsized":"2024-09-16T07:46:48.609305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40763392,"num_objects":622,"num_object_clones":0,"num_object_copies":1866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":39808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.601073+0000","last_change":"2024-09-16T07:46:33.601073+0000","last_active":"2024-09-16T07:46:33.601073+0000","last_peered":"2024-09-16T07:45:51.507878+0000","last_clean":"2024-09-16T07:45:51.507878+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:46:33.601073+0000","last_undegraded":"2024-09-16T07:46:33.601073+0000","last_fullsized":"2024-09-16T07:46:33.601073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":503447552,"num_objects":7682,"num_object_clones":0,"num_object_copies":23046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7682,"num_write_kb":491648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":851968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94031872,"data_stored":1504509952,"data_compressed":71438854,"data_compressed_allocated":94031872,"data_compressed_original":1504509952,"omap_allocated":0,"internal_metadata":0},"log_size":7690,"ondisk_log_size":7690,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61476,"kb_used_data":26324,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310364,"statfs":{"total":96636764160,"available":96573812736,"internally_reserved":0,"allocated":26955776,"data_stored":427499720,"data_compressed":20297527,"data_compressed_allocated":26718208,"data_compressed_original":427409408,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66804,"kb_used_data":27236,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94305036,"statfs":{"total":96636764160,"available":96568356864,"internally_reserved":0,"allocated":27889664,"data_stored":441610294,"data_compressed":20966846,"data_compressed_allocated":27598848,"data_compressed_original":441499648,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53568,"kb_used_data":22576,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318272,"statfs":{"total":96636764160,"available":96581910528,"internally_reserved":0,"allocated":23117824,"data_stored":366419643,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":20,"seq":85899345949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59936,"kb_used_data":16208,"kb_used_omap":0,"kb_used_meta":43712,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":16596992,"data_stored":261821059,"data_compressed":12430614,"data_compressed_allocated":16363520,"data_compressed_original":261734400,"omap_allocated":0,"internal_metadata":44761088},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":268566528,"data_compressed":12752229,"data_compressed_allocated":16785408,"data_compressed_original":268566528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22896640,"data_stored":366346240,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27672576,"data_stored":442761216,"data_compressed":21023941,"data_compressed_allocated":27672576,"data_compressed_original":442761216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26677248,"data_stored":426835968,"data_compressed":20267486,"data_compressed_allocated":26677248,"data_compressed_original":426835968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:53.603 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:53.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:53.774+0000 7f560a2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:53.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:53.786+0000 7f560a2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:55.939 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:56.083 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:56.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:56.104+0000 7ff57a4a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:56.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:56.121+0000 7ff57a4a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:56.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:56.263+0000 7f33948fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:56.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:56.276+0000 7f33948fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:56.430 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:56.430 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:56.444 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-09-16T07:46:56.309758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":504037928,"num_objects":7686,"num_object_clones":0,"num_object_copies":23058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7762,"num_write_kb":492755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":851968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7745,"ondisk_log_size":7745,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":241784,"kb_used_data":92344,"kb_used_omap":0,"kb_used_meta":149376,"kb_avail":377245576,"statfs":{"total":386547056640,"available":386299469824,"internally_reserved":0,"allocated":94560256,"data_stored":1497350716,"data_compressed":71090185,"data_compressed_allocated":93577216,"data_compressed_original":1496989696,"omap_allocated":0,"internal_metadata":152961024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46858240,"num_objects":715,"num_object_clones":0,"num_object_copies":2145,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":45760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.359392"},"pg_stats":[{"pgid":"3.f","version":"25'395","reported_seq":427,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:12.954045+0000","last_change":"2024-09-16T07:45:44.535560+0000","last_active":"2024-09-16T07:46:12.954045+0000","last_peered":"2024-09-16T07:46:12.954045+0000","last_clean":"2024-09-16T07:46:12.954045+0000","last_became_active":"2024-09-16T07:45:44.523789+0000","last_became_peered":"2024-09-16T07:45:44.523789+0000","last_unstale":"2024-09-16T07:46:33.558424+0000","last_undegraded":"2024-09-16T07:46:12.954045+0000","last_fullsized":"2024-09-16T07:46:12.954045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'604","reported_seq":648,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.651531+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:46:48.651531+0000","last_peered":"2024-09-16T07:46:48.651531+0000","last_clean":"2024-09-16T07:46:48.651531+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:46:48.651531+0000","last_undegraded":"2024-09-16T07:46:48.651531+0000","last_fullsized":"2024-09-16T07:46:48.651531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'437","reported_seq":474,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.604809+0000","last_change":"2024-09-16T07:46:33.614981+0000","last_active":"2024-09-16T07:46:33.614981+0000","last_peered":"2024-09-16T07:46:20.807285+0000","last_clean":"2024-09-16T07:46:20.807285+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:34.604809+0000","last_undegraded":"2024-09-16T07:46:34.604809+0000","last_fullsized":"2024-09-16T07:46:34.604809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":437,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'342","reported_seq":375,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.292186+0000","last_change":"2024-09-16T07:45:50.902218+0000","last_active":"2024-09-16T07:46:13.292186+0000","last_peered":"2024-09-16T07:46:13.292186+0000","last_clean":"2024-09-16T07:46:13.292186+0000","last_became_active":"2024-09-16T07:45:50.691944+0000","last_became_peered":"2024-09-16T07:45:50.691944+0000","last_unstale":"2024-09-16T07:46:33.558428+0000","last_undegraded":"2024-09-16T07:46:13.292186+0000","last_fullsized":"2024-09-16T07:46:13.292186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'451","reported_seq":490,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.615849+0000","last_change":"2024-09-16T07:46:33.615849+0000","last_active":"2024-09-16T07:46:33.615849+0000","last_peered":"2024-09-16T07:46:20.759422+0000","last_clean":"2024-09-16T07:46:20.759422+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:33.615849+0000","last_undegraded":"2024-09-16T07:46:33.615849+0000","last_fullsized":"2024-09-16T07:46:33.615849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'355","reported_seq":381,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.308341+0000","last_change":"2024-09-16T07:45:50.666069+0000","last_active":"2024-09-16T07:46:13.308341+0000","last_peered":"2024-09-16T07:46:13.308341+0000","last_clean":"2024-09-16T07:46:13.308341+0000","last_became_active":"2024-09-16T07:45:50.653189+0000","last_became_peered":"2024-09-16T07:45:50.653189+0000","last_unstale":"2024-09-16T07:46:33.558430+0000","last_undegraded":"2024-09-16T07:46:13.308341+0000","last_fullsized":"2024-09-16T07:46:13.308341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'390","reported_seq":416,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.247682+0000","last_change":"2024-09-16T07:45:50.622899+0000","last_active":"2024-09-16T07:46:13.247682+0000","last_peered":"2024-09-16T07:46:13.247682+0000","last_clean":"2024-09-16T07:46:13.247682+0000","last_became_active":"2024-09-16T07:45:50.606399+0000","last_became_peered":"2024-09-16T07:45:50.606399+0000","last_unstale":"2024-09-16T07:46:33.558433+0000","last_undegraded":"2024-09-16T07:46:13.247682+0000","last_fullsized":"2024-09-16T07:46:13.247682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'440","reported_seq":485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.613447+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:34.613447+0000","last_peered":"2024-09-16T07:46:34.613447+0000","last_clean":"2024-09-16T07:46:34.613447+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:34.613447+0000","last_undegraded":"2024-09-16T07:46:34.613447+0000","last_fullsized":"2024-09-16T07:46:34.613447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":115,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.594594+0000","last_change":"2024-09-16T07:46:33.594594+0000","last_active":"2024-09-16T07:46:33.594594+0000","last_peered":"2024-09-16T07:45:51.484915+0000","last_clean":"2024-09-16T07:45:51.484915+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:46:33.594594+0000","last_undegraded":"2024-09-16T07:46:33.594594+0000","last_fullsized":"2024-09-16T07:46:33.594594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":45,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.608687+0000","last_change":"2024-09-16T07:46:33.608687+0000","last_active":"2024-09-16T07:46:33.608687+0000","last_peered":"2024-09-16T07:45:51.505238+0000","last_clean":"2024-09-16T07:45:51.505238+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:46:33.608687+0000","last_undegraded":"2024-09-16T07:46:33.608687+0000","last_fullsized":"2024-09-16T07:46:33.608687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'476","reported_seq":513,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.603544+0000","last_change":"2024-09-16T07:46:33.602602+0000","last_active":"2024-09-16T07:46:33.602602+0000","last_peered":"2024-09-16T07:46:20.769086+0000","last_clean":"2024-09-16T07:46:20.769086+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:34.603544+0000","last_undegraded":"2024-09-16T07:46:34.603544+0000","last_fullsized":"2024-09-16T07:46:34.603544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":476,"num_write_kb":30464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.513996+0000","last_change":"2024-09-16T07:45:51.521750+0000","last_active":"2024-09-16T07:45:51.513996+0000","last_peered":"2024-09-16T07:45:51.513996+0000","last_clean":"2024-09-16T07:45:51.513996+0000","last_became_active":"2024-09-16T07:45:50.665366+0000","last_became_peered":"2024-09-16T07:45:50.665366+0000","last_unstale":"2024-09-16T07:46:33.558437+0000","last_undegraded":"2024-09-16T07:45:51.513996+0000","last_fullsized":"2024-09-16T07:45:51.513996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'459","reported_seq":496,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.583420+0000","last_change":"2024-09-16T07:46:33.579664+0000","last_active":"2024-09-16T07:46:33.579664+0000","last_peered":"2024-09-16T07:46:20.817119+0000","last_clean":"2024-09-16T07:46:20.817119+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:34.583420+0000","last_undegraded":"2024-09-16T07:46:34.583420+0000","last_fullsized":"2024-09-16T07:46:34.583420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30081024,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":29376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.584979+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:34.584979+0000","last_peered":"2024-09-16T07:46:34.584979+0000","last_clean":"2024-09-16T07:46:34.584979+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:34.584979+0000","last_undegraded":"2024-09-16T07:46:34.584979+0000","last_fullsized":"2024-09-16T07:46:34.584979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'463","reported_seq":510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.602455+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:34.602455+0000","last_peered":"2024-09-16T07:46:34.602455+0000","last_clean":"2024-09-16T07:46:34.602455+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:34.602455+0000","last_undegraded":"2024-09-16T07:46:34.602455+0000","last_fullsized":"2024-09-16T07:46:34.602455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30343168,"num_objects":463,"num_object_clones":0,"num_object_copies":1389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":463,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":33,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.511360+0000","last_change":"2024-09-16T07:45:51.520543+0000","last_active":"2024-09-16T07:45:51.511360+0000","last_peered":"2024-09-16T07:45:51.511360+0000","last_clean":"2024-09-16T07:45:51.511360+0000","last_became_active":"2024-09-16T07:45:50.656425+0000","last_became_peered":"2024-09-16T07:45:50.656425+0000","last_unstale":"2024-09-16T07:46:33.558440+0000","last_undegraded":"2024-09-16T07:45:51.511360+0000","last_fullsized":"2024-09-16T07:45:51.511360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'593","reported_seq":638,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.680405+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:46:48.680405+0000","last_peered":"2024-09-16T07:46:48.680405+0000","last_clean":"2024-09-16T07:46:48.680405+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:46:48.680405+0000","last_undegraded":"2024-09-16T07:46:48.680405+0000","last_fullsized":"2024-09-16T07:46:48.680405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"25'525","reported_seq":565,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.606029+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:34.606029+0000","last_peered":"2024-09-16T07:46:34.606029+0000","last_clean":"2024-09-16T07:46:34.606029+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:34.606029+0000","last_undegraded":"2024-09-16T07:46:34.606029+0000","last_fullsized":"2024-09-16T07:46:34.606029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'647","reported_seq":705,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.629129+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:46:48.629129+0000","last_peered":"2024-09-16T07:46:48.629129+0000","last_clean":"2024-09-16T07:46:48.629129+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:46:48.629129+0000","last_undegraded":"2024-09-16T07:46:48.629129+0000","last_fullsized":"2024-09-16T07:46:48.629129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.613664+0000","last_change":"2024-09-16T07:46:33.613664+0000","last_active":"2024-09-16T07:46:33.613664+0000","last_peered":"2024-09-16T07:45:51.499250+0000","last_clean":"2024-09-16T07:45:51.499250+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:46:33.613664+0000","last_undegraded":"2024-09-16T07:46:33.613664+0000","last_fullsized":"2024-09-16T07:46:33.613664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'490","reported_seq":526,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.582711+0000","last_change":"2024-09-16T07:46:33.582711+0000","last_active":"2024-09-16T07:46:33.582711+0000","last_peered":"2024-09-16T07:46:20.729315+0000","last_clean":"2024-09-16T07:46:20.729315+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:33.582711+0000","last_undegraded":"2024-09-16T07:46:33.582711+0000","last_fullsized":"2024-09-16T07:46:33.582711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'623","reported_seq":667,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.609305+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:46:48.609305+0000","last_peered":"2024-09-16T07:46:48.609305+0000","last_clean":"2024-09-16T07:46:48.609305+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:46:48.609305+0000","last_undegraded":"2024-09-16T07:46:48.609305+0000","last_fullsized":"2024-09-16T07:46:48.609305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40763392,"num_objects":622,"num_object_clones":0,"num_object_copies":1866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":39808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.601073+0000","last_change":"2024-09-16T07:46:33.601073+0000","last_active":"2024-09-16T07:46:33.601073+0000","last_peered":"2024-09-16T07:45:51.507878+0000","last_clean":"2024-09-16T07:45:51.507878+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:46:33.601073+0000","last_undegraded":"2024-09-16T07:46:33.601073+0000","last_fullsized":"2024-09-16T07:46:33.601073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":503447552,"num_objects":7682,"num_object_clones":0,"num_object_copies":23046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7682,"num_write_kb":491648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":851968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94031872,"data_stored":1504509952,"data_compressed":71438854,"data_compressed_allocated":94031872,"data_compressed_original":1504509952,"omap_allocated":0,"internal_metadata":0},"log_size":7690,"ondisk_log_size":7690,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61476,"kb_used_data":26324,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310364,"statfs":{"total":96636764160,"available":96573812736,"internally_reserved":0,"allocated":26955776,"data_stored":427499720,"data_compressed":20297527,"data_compressed_allocated":26718208,"data_compressed_original":427409408,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66804,"kb_used_data":27236,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94305036,"statfs":{"total":96636764160,"available":96568356864,"internally_reserved":0,"allocated":27889664,"data_stored":441610294,"data_compressed":20966846,"data_compressed_allocated":27598848,"data_compressed_original":441499648,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53568,"kb_used_data":22576,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318272,"statfs":{"total":96636764160,"available":96581910528,"internally_reserved":0,"allocated":23117824,"data_stored":366419643,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":20,"seq":85899345949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59936,"kb_used_data":16208,"kb_used_omap":0,"kb_used_meta":43712,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":16596992,"data_stored":261821059,"data_compressed":12430614,"data_compressed_allocated":16363520,"data_compressed_original":261734400,"omap_allocated":0,"internal_metadata":44761088},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":268566528,"data_compressed":12752229,"data_compressed_allocated":16785408,"data_compressed_original":268566528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22896640,"data_stored":366346240,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27672576,"data_stored":442761216,"data_compressed":21023941,"data_compressed_allocated":27672576,"data_compressed_original":442761216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26677248,"data_stored":426835968,"data_compressed":20267486,"data_compressed_allocated":26677248,"data_compressed_original":426835968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:56.446 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:46:56.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:56.651+0000 7fed51391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:56.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:56.662+0000 7fed4bfff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:57.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:57.053 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 4 pgs peering","count":4},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":119,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":32,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472794,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":10},{"state_name":"peering","count":9},{"state_name":"stale+active+clean","count":6}],"num_pgs":25,"num_pools":3,"num_objects":7686,"data_bytes":504037928,"bytes_used":247586816,"bytes_avail":386299469824,"bytes_total":386547056640,"inactive_pgs_ratio":0.36000001430511475,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":31631,"recovering_keys_per_sec":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"write_bytes_sec":4523261,"read_op_per_sec":0,"write_op_per_sec":69},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:46:57.073 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:46:57.073 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:57.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:57.231+0000 7f495fe9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:57.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:57.243+0000 7f495fe9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:57.577 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:46:57.577 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:46:57.596 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-09-16T07:46:56.309758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":504037928,"num_objects":7686,"num_object_clones":0,"num_object_copies":23058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7762,"num_write_kb":492755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":851968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7745,"ondisk_log_size":7745,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":241784,"kb_used_data":92344,"kb_used_omap":0,"kb_used_meta":149376,"kb_avail":377245576,"statfs":{"total":386547056640,"available":386299469824,"internally_reserved":0,"allocated":94560256,"data_stored":1497350716,"data_compressed":71090185,"data_compressed_allocated":93577216,"data_compressed_original":1496989696,"omap_allocated":0,"internal_metadata":152961024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46858240,"num_objects":715,"num_object_clones":0,"num_object_copies":2145,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":45760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.359392"},"pg_stats":[{"pgid":"3.f","version":"25'395","reported_seq":427,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:12.954045+0000","last_change":"2024-09-16T07:45:44.535560+0000","last_active":"2024-09-16T07:46:12.954045+0000","last_peered":"2024-09-16T07:46:12.954045+0000","last_clean":"2024-09-16T07:46:12.954045+0000","last_became_active":"2024-09-16T07:45:44.523789+0000","last_became_peered":"2024-09-16T07:45:44.523789+0000","last_unstale":"2024-09-16T07:46:33.558424+0000","last_undegraded":"2024-09-16T07:46:12.954045+0000","last_fullsized":"2024-09-16T07:46:12.954045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'604","reported_seq":648,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.651531+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:46:48.651531+0000","last_peered":"2024-09-16T07:46:48.651531+0000","last_clean":"2024-09-16T07:46:48.651531+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:46:48.651531+0000","last_undegraded":"2024-09-16T07:46:48.651531+0000","last_fullsized":"2024-09-16T07:46:48.651531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'437","reported_seq":474,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.604809+0000","last_change":"2024-09-16T07:46:33.614981+0000","last_active":"2024-09-16T07:46:33.614981+0000","last_peered":"2024-09-16T07:46:20.807285+0000","last_clean":"2024-09-16T07:46:20.807285+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:34.604809+0000","last_undegraded":"2024-09-16T07:46:34.604809+0000","last_fullsized":"2024-09-16T07:46:34.604809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":437,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'342","reported_seq":375,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.292186+0000","last_change":"2024-09-16T07:45:50.902218+0000","last_active":"2024-09-16T07:46:13.292186+0000","last_peered":"2024-09-16T07:46:13.292186+0000","last_clean":"2024-09-16T07:46:13.292186+0000","last_became_active":"2024-09-16T07:45:50.691944+0000","last_became_peered":"2024-09-16T07:45:50.691944+0000","last_unstale":"2024-09-16T07:46:33.558428+0000","last_undegraded":"2024-09-16T07:46:13.292186+0000","last_fullsized":"2024-09-16T07:46:13.292186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'451","reported_seq":490,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.615849+0000","last_change":"2024-09-16T07:46:33.615849+0000","last_active":"2024-09-16T07:46:33.615849+0000","last_peered":"2024-09-16T07:46:20.759422+0000","last_clean":"2024-09-16T07:46:20.759422+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:33.615849+0000","last_undegraded":"2024-09-16T07:46:33.615849+0000","last_fullsized":"2024-09-16T07:46:33.615849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'355","reported_seq":381,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.308341+0000","last_change":"2024-09-16T07:45:50.666069+0000","last_active":"2024-09-16T07:46:13.308341+0000","last_peered":"2024-09-16T07:46:13.308341+0000","last_clean":"2024-09-16T07:46:13.308341+0000","last_became_active":"2024-09-16T07:45:50.653189+0000","last_became_peered":"2024-09-16T07:45:50.653189+0000","last_unstale":"2024-09-16T07:46:33.558430+0000","last_undegraded":"2024-09-16T07:46:13.308341+0000","last_fullsized":"2024-09-16T07:46:13.308341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'390","reported_seq":416,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.247682+0000","last_change":"2024-09-16T07:45:50.622899+0000","last_active":"2024-09-16T07:46:13.247682+0000","last_peered":"2024-09-16T07:46:13.247682+0000","last_clean":"2024-09-16T07:46:13.247682+0000","last_became_active":"2024-09-16T07:45:50.606399+0000","last_became_peered":"2024-09-16T07:45:50.606399+0000","last_unstale":"2024-09-16T07:46:33.558433+0000","last_undegraded":"2024-09-16T07:46:13.247682+0000","last_fullsized":"2024-09-16T07:46:13.247682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'440","reported_seq":485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.613447+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:34.613447+0000","last_peered":"2024-09-16T07:46:34.613447+0000","last_clean":"2024-09-16T07:46:34.613447+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:34.613447+0000","last_undegraded":"2024-09-16T07:46:34.613447+0000","last_fullsized":"2024-09-16T07:46:34.613447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":115,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.594594+0000","last_change":"2024-09-16T07:46:33.594594+0000","last_active":"2024-09-16T07:46:33.594594+0000","last_peered":"2024-09-16T07:45:51.484915+0000","last_clean":"2024-09-16T07:45:51.484915+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:46:33.594594+0000","last_undegraded":"2024-09-16T07:46:33.594594+0000","last_fullsized":"2024-09-16T07:46:33.594594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":45,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.608687+0000","last_change":"2024-09-16T07:46:33.608687+0000","last_active":"2024-09-16T07:46:33.608687+0000","last_peered":"2024-09-16T07:45:51.505238+0000","last_clean":"2024-09-16T07:45:51.505238+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:46:33.608687+0000","last_undegraded":"2024-09-16T07:46:33.608687+0000","last_fullsized":"2024-09-16T07:46:33.608687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'476","reported_seq":513,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.603544+0000","last_change":"2024-09-16T07:46:33.602602+0000","last_active":"2024-09-16T07:46:33.602602+0000","last_peered":"2024-09-16T07:46:20.769086+0000","last_clean":"2024-09-16T07:46:20.769086+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:34.603544+0000","last_undegraded":"2024-09-16T07:46:34.603544+0000","last_fullsized":"2024-09-16T07:46:34.603544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":476,"num_write_kb":30464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.513996+0000","last_change":"2024-09-16T07:45:51.521750+0000","last_active":"2024-09-16T07:45:51.513996+0000","last_peered":"2024-09-16T07:45:51.513996+0000","last_clean":"2024-09-16T07:45:51.513996+0000","last_became_active":"2024-09-16T07:45:50.665366+0000","last_became_peered":"2024-09-16T07:45:50.665366+0000","last_unstale":"2024-09-16T07:46:33.558437+0000","last_undegraded":"2024-09-16T07:45:51.513996+0000","last_fullsized":"2024-09-16T07:45:51.513996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'459","reported_seq":496,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.583420+0000","last_change":"2024-09-16T07:46:33.579664+0000","last_active":"2024-09-16T07:46:33.579664+0000","last_peered":"2024-09-16T07:46:20.817119+0000","last_clean":"2024-09-16T07:46:20.817119+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:34.583420+0000","last_undegraded":"2024-09-16T07:46:34.583420+0000","last_fullsized":"2024-09-16T07:46:34.583420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30081024,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":29376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.584979+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:34.584979+0000","last_peered":"2024-09-16T07:46:34.584979+0000","last_clean":"2024-09-16T07:46:34.584979+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:34.584979+0000","last_undegraded":"2024-09-16T07:46:34.584979+0000","last_fullsized":"2024-09-16T07:46:34.584979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'463","reported_seq":510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.602455+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:34.602455+0000","last_peered":"2024-09-16T07:46:34.602455+0000","last_clean":"2024-09-16T07:46:34.602455+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:34.602455+0000","last_undegraded":"2024-09-16T07:46:34.602455+0000","last_fullsized":"2024-09-16T07:46:34.602455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30343168,"num_objects":463,"num_object_clones":0,"num_object_copies":1389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":463,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":33,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.511360+0000","last_change":"2024-09-16T07:45:51.520543+0000","last_active":"2024-09-16T07:45:51.511360+0000","last_peered":"2024-09-16T07:45:51.511360+0000","last_clean":"2024-09-16T07:45:51.511360+0000","last_became_active":"2024-09-16T07:45:50.656425+0000","last_became_peered":"2024-09-16T07:45:50.656425+0000","last_unstale":"2024-09-16T07:46:33.558440+0000","last_undegraded":"2024-09-16T07:45:51.511360+0000","last_fullsized":"2024-09-16T07:45:51.511360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'593","reported_seq":638,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.680405+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:46:48.680405+0000","last_peered":"2024-09-16T07:46:48.680405+0000","last_clean":"2024-09-16T07:46:48.680405+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:46:48.680405+0000","last_undegraded":"2024-09-16T07:46:48.680405+0000","last_fullsized":"2024-09-16T07:46:48.680405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"25'525","reported_seq":565,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.606029+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:34.606029+0000","last_peered":"2024-09-16T07:46:34.606029+0000","last_clean":"2024-09-16T07:46:34.606029+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:34.606029+0000","last_undegraded":"2024-09-16T07:46:34.606029+0000","last_fullsized":"2024-09-16T07:46:34.606029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'647","reported_seq":705,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.629129+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:46:48.629129+0000","last_peered":"2024-09-16T07:46:48.629129+0000","last_clean":"2024-09-16T07:46:48.629129+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:46:48.629129+0000","last_undegraded":"2024-09-16T07:46:48.629129+0000","last_fullsized":"2024-09-16T07:46:48.629129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.613664+0000","last_change":"2024-09-16T07:46:33.613664+0000","last_active":"2024-09-16T07:46:33.613664+0000","last_peered":"2024-09-16T07:45:51.499250+0000","last_clean":"2024-09-16T07:45:51.499250+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:46:33.613664+0000","last_undegraded":"2024-09-16T07:46:33.613664+0000","last_fullsized":"2024-09-16T07:46:33.613664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'490","reported_seq":526,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.582711+0000","last_change":"2024-09-16T07:46:33.582711+0000","last_active":"2024-09-16T07:46:33.582711+0000","last_peered":"2024-09-16T07:46:20.729315+0000","last_clean":"2024-09-16T07:46:20.729315+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:33.582711+0000","last_undegraded":"2024-09-16T07:46:33.582711+0000","last_fullsized":"2024-09-16T07:46:33.582711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'623","reported_seq":667,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.609305+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:46:48.609305+0000","last_peered":"2024-09-16T07:46:48.609305+0000","last_clean":"2024-09-16T07:46:48.609305+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:46:48.609305+0000","last_undegraded":"2024-09-16T07:46:48.609305+0000","last_fullsized":"2024-09-16T07:46:48.609305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40763392,"num_objects":622,"num_object_clones":0,"num_object_copies":1866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":39808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.601073+0000","last_change":"2024-09-16T07:46:33.601073+0000","last_active":"2024-09-16T07:46:33.601073+0000","last_peered":"2024-09-16T07:45:51.507878+0000","last_clean":"2024-09-16T07:45:51.507878+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:46:33.601073+0000","last_undegraded":"2024-09-16T07:46:33.601073+0000","last_fullsized":"2024-09-16T07:46:33.601073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":503447552,"num_objects":7682,"num_object_clones":0,"num_object_copies":23046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7682,"num_write_kb":491648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":851968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94031872,"data_stored":1504509952,"data_compressed":71438854,"data_compressed_allocated":94031872,"data_compressed_original":1504509952,"omap_allocated":0,"internal_metadata":0},"log_size":7690,"ondisk_log_size":7690,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61476,"kb_used_data":26324,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310364,"statfs":{"total":96636764160,"available":96573812736,"internally_reserved":0,"allocated":26955776,"data_stored":427499720,"data_compressed":20297527,"data_compressed_allocated":26718208,"data_compressed_original":427409408,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66804,"kb_used_data":27236,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94305036,"statfs":{"total":96636764160,"available":96568356864,"internally_reserved":0,"allocated":27889664,"data_stored":441610294,"data_compressed":20966846,"data_compressed_allocated":27598848,"data_compressed_original":441499648,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53568,"kb_used_data":22576,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318272,"statfs":{"total":96636764160,"available":96581910528,"internally_reserved":0,"allocated":23117824,"data_stored":366419643,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":20,"seq":85899345949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59936,"kb_used_data":16208,"kb_used_omap":0,"kb_used_meta":43712,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":16596992,"data_stored":261821059,"data_compressed":12430614,"data_compressed_allocated":16363520,"data_compressed_original":261734400,"omap_allocated":0,"internal_metadata":44761088},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":268566528,"data_compressed":12752229,"data_compressed_allocated":16785408,"data_compressed_original":268566528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22896640,"data_stored":366346240,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27672576,"data_stored":442761216,"data_compressed":21023941,"data_compressed_allocated":27672576,"data_compressed_original":442761216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26677248,"data_stored":426835968,"data_compressed":20267486,"data_compressed_allocated":26677248,"data_compressed_original":426835968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:58.555 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:58.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:58.711+0000 7f6e3e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:58.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:46:58.720+0000 7f6e3e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:00.598 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:00.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:00.738+0000 7f9f2fec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:00.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:00.753+0000 7f9f2fec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:01.028 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:01.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:01.079 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:01.101 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-16T07:47:00.310660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":504037928,"num_objects":7686,"num_object_clones":0,"num_object_copies":23058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7762,"num_write_kb":492755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":851968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7745,"ondisk_log_size":7745,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":241784,"kb_used_data":92344,"kb_used_omap":0,"kb_used_meta":149376,"kb_avail":377245576,"statfs":{"total":386547056640,"available":386299469824,"internally_reserved":0,"allocated":94560256,"data_stored":1497350716,"data_compressed":71090185,"data_compressed_allocated":93577216,"data_compressed_original":1496989696,"omap_allocated":0,"internal_metadata":152961024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46858240,"num_objects":715,"num_object_clones":0,"num_object_copies":2145,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":45760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002967"},"pg_stats":[{"pgid":"3.f","version":"25'395","reported_seq":427,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:12.954045+0000","last_change":"2024-09-16T07:45:44.535560+0000","last_active":"2024-09-16T07:46:12.954045+0000","last_peered":"2024-09-16T07:46:12.954045+0000","last_clean":"2024-09-16T07:46:12.954045+0000","last_became_active":"2024-09-16T07:45:44.523789+0000","last_became_peered":"2024-09-16T07:45:44.523789+0000","last_unstale":"2024-09-16T07:46:33.558424+0000","last_undegraded":"2024-09-16T07:46:12.954045+0000","last_fullsized":"2024-09-16T07:46:12.954045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'604","reported_seq":648,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.651531+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:46:48.651531+0000","last_peered":"2024-09-16T07:46:48.651531+0000","last_clean":"2024-09-16T07:46:48.651531+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:46:48.651531+0000","last_undegraded":"2024-09-16T07:46:48.651531+0000","last_fullsized":"2024-09-16T07:46:48.651531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'437","reported_seq":474,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.604809+0000","last_change":"2024-09-16T07:46:33.614981+0000","last_active":"2024-09-16T07:46:33.614981+0000","last_peered":"2024-09-16T07:46:20.807285+0000","last_clean":"2024-09-16T07:46:20.807285+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:34.604809+0000","last_undegraded":"2024-09-16T07:46:34.604809+0000","last_fullsized":"2024-09-16T07:46:34.604809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":437,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'342","reported_seq":375,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.292186+0000","last_change":"2024-09-16T07:45:50.902218+0000","last_active":"2024-09-16T07:46:13.292186+0000","last_peered":"2024-09-16T07:46:13.292186+0000","last_clean":"2024-09-16T07:46:13.292186+0000","last_became_active":"2024-09-16T07:45:50.691944+0000","last_became_peered":"2024-09-16T07:45:50.691944+0000","last_unstale":"2024-09-16T07:46:33.558428+0000","last_undegraded":"2024-09-16T07:46:13.292186+0000","last_fullsized":"2024-09-16T07:46:13.292186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'451","reported_seq":490,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.615849+0000","last_change":"2024-09-16T07:46:33.615849+0000","last_active":"2024-09-16T07:46:33.615849+0000","last_peered":"2024-09-16T07:46:20.759422+0000","last_clean":"2024-09-16T07:46:20.759422+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:33.615849+0000","last_undegraded":"2024-09-16T07:46:33.615849+0000","last_fullsized":"2024-09-16T07:46:33.615849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'355","reported_seq":381,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.308341+0000","last_change":"2024-09-16T07:45:50.666069+0000","last_active":"2024-09-16T07:46:13.308341+0000","last_peered":"2024-09-16T07:46:13.308341+0000","last_clean":"2024-09-16T07:46:13.308341+0000","last_became_active":"2024-09-16T07:45:50.653189+0000","last_became_peered":"2024-09-16T07:45:50.653189+0000","last_unstale":"2024-09-16T07:46:33.558430+0000","last_undegraded":"2024-09-16T07:46:13.308341+0000","last_fullsized":"2024-09-16T07:46:13.308341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'390","reported_seq":416,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.247682+0000","last_change":"2024-09-16T07:45:50.622899+0000","last_active":"2024-09-16T07:46:13.247682+0000","last_peered":"2024-09-16T07:46:13.247682+0000","last_clean":"2024-09-16T07:46:13.247682+0000","last_became_active":"2024-09-16T07:45:50.606399+0000","last_became_peered":"2024-09-16T07:45:50.606399+0000","last_unstale":"2024-09-16T07:46:33.558433+0000","last_undegraded":"2024-09-16T07:46:13.247682+0000","last_fullsized":"2024-09-16T07:46:13.247682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'440","reported_seq":485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.613447+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:34.613447+0000","last_peered":"2024-09-16T07:46:34.613447+0000","last_clean":"2024-09-16T07:46:34.613447+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:34.613447+0000","last_undegraded":"2024-09-16T07:46:34.613447+0000","last_fullsized":"2024-09-16T07:46:34.613447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":115,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.594594+0000","last_change":"2024-09-16T07:46:33.594594+0000","last_active":"2024-09-16T07:46:33.594594+0000","last_peered":"2024-09-16T07:45:51.484915+0000","last_clean":"2024-09-16T07:45:51.484915+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:46:33.594594+0000","last_undegraded":"2024-09-16T07:46:33.594594+0000","last_fullsized":"2024-09-16T07:46:33.594594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":45,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.608687+0000","last_change":"2024-09-16T07:46:33.608687+0000","last_active":"2024-09-16T07:46:33.608687+0000","last_peered":"2024-09-16T07:45:51.505238+0000","last_clean":"2024-09-16T07:45:51.505238+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:46:33.608687+0000","last_undegraded":"2024-09-16T07:46:33.608687+0000","last_fullsized":"2024-09-16T07:46:33.608687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'476","reported_seq":513,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.603544+0000","last_change":"2024-09-16T07:46:33.602602+0000","last_active":"2024-09-16T07:46:33.602602+0000","last_peered":"2024-09-16T07:46:20.769086+0000","last_clean":"2024-09-16T07:46:20.769086+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:34.603544+0000","last_undegraded":"2024-09-16T07:46:34.603544+0000","last_fullsized":"2024-09-16T07:46:34.603544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":476,"num_write_kb":30464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.513996+0000","last_change":"2024-09-16T07:45:51.521750+0000","last_active":"2024-09-16T07:45:51.513996+0000","last_peered":"2024-09-16T07:45:51.513996+0000","last_clean":"2024-09-16T07:45:51.513996+0000","last_became_active":"2024-09-16T07:45:50.665366+0000","last_became_peered":"2024-09-16T07:45:50.665366+0000","last_unstale":"2024-09-16T07:46:33.558437+0000","last_undegraded":"2024-09-16T07:45:51.513996+0000","last_fullsized":"2024-09-16T07:45:51.513996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'459","reported_seq":496,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.583420+0000","last_change":"2024-09-16T07:46:33.579664+0000","last_active":"2024-09-16T07:46:33.579664+0000","last_peered":"2024-09-16T07:46:20.817119+0000","last_clean":"2024-09-16T07:46:20.817119+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:34.583420+0000","last_undegraded":"2024-09-16T07:46:34.583420+0000","last_fullsized":"2024-09-16T07:46:34.583420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30081024,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":29376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.584979+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:34.584979+0000","last_peered":"2024-09-16T07:46:34.584979+0000","last_clean":"2024-09-16T07:46:34.584979+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:34.584979+0000","last_undegraded":"2024-09-16T07:46:34.584979+0000","last_fullsized":"2024-09-16T07:46:34.584979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'463","reported_seq":510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.602455+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:34.602455+0000","last_peered":"2024-09-16T07:46:34.602455+0000","last_clean":"2024-09-16T07:46:34.602455+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:34.602455+0000","last_undegraded":"2024-09-16T07:46:34.602455+0000","last_fullsized":"2024-09-16T07:46:34.602455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30343168,"num_objects":463,"num_object_clones":0,"num_object_copies":1389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":463,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":33,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.511360+0000","last_change":"2024-09-16T07:45:51.520543+0000","last_active":"2024-09-16T07:45:51.511360+0000","last_peered":"2024-09-16T07:45:51.511360+0000","last_clean":"2024-09-16T07:45:51.511360+0000","last_became_active":"2024-09-16T07:45:50.656425+0000","last_became_peered":"2024-09-16T07:45:50.656425+0000","last_unstale":"2024-09-16T07:46:33.558440+0000","last_undegraded":"2024-09-16T07:45:51.511360+0000","last_fullsized":"2024-09-16T07:45:51.511360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'593","reported_seq":638,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.680405+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:46:48.680405+0000","last_peered":"2024-09-16T07:46:48.680405+0000","last_clean":"2024-09-16T07:46:48.680405+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:46:48.680405+0000","last_undegraded":"2024-09-16T07:46:48.680405+0000","last_fullsized":"2024-09-16T07:46:48.680405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"25'525","reported_seq":565,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.606029+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:34.606029+0000","last_peered":"2024-09-16T07:46:34.606029+0000","last_clean":"2024-09-16T07:46:34.606029+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:34.606029+0000","last_undegraded":"2024-09-16T07:46:34.606029+0000","last_fullsized":"2024-09-16T07:46:34.606029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'647","reported_seq":705,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.629129+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:46:48.629129+0000","last_peered":"2024-09-16T07:46:48.629129+0000","last_clean":"2024-09-16T07:46:48.629129+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:46:48.629129+0000","last_undegraded":"2024-09-16T07:46:48.629129+0000","last_fullsized":"2024-09-16T07:46:48.629129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.613664+0000","last_change":"2024-09-16T07:46:33.613664+0000","last_active":"2024-09-16T07:46:33.613664+0000","last_peered":"2024-09-16T07:45:51.499250+0000","last_clean":"2024-09-16T07:45:51.499250+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:46:33.613664+0000","last_undegraded":"2024-09-16T07:46:33.613664+0000","last_fullsized":"2024-09-16T07:46:33.613664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'490","reported_seq":526,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.582711+0000","last_change":"2024-09-16T07:46:33.582711+0000","last_active":"2024-09-16T07:46:33.582711+0000","last_peered":"2024-09-16T07:46:20.729315+0000","last_clean":"2024-09-16T07:46:20.729315+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:33.582711+0000","last_undegraded":"2024-09-16T07:46:33.582711+0000","last_fullsized":"2024-09-16T07:46:33.582711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'623","reported_seq":667,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.609305+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:46:48.609305+0000","last_peered":"2024-09-16T07:46:48.609305+0000","last_clean":"2024-09-16T07:46:48.609305+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:46:48.609305+0000","last_undegraded":"2024-09-16T07:46:48.609305+0000","last_fullsized":"2024-09-16T07:46:48.609305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40763392,"num_objects":622,"num_object_clones":0,"num_object_copies":1866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":39808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.601073+0000","last_change":"2024-09-16T07:46:33.601073+0000","last_active":"2024-09-16T07:46:33.601073+0000","last_peered":"2024-09-16T07:45:51.507878+0000","last_clean":"2024-09-16T07:45:51.507878+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:46:33.601073+0000","last_undegraded":"2024-09-16T07:46:33.601073+0000","last_fullsized":"2024-09-16T07:46:33.601073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":503447552,"num_objects":7682,"num_object_clones":0,"num_object_copies":23046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7682,"num_write_kb":491648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":851968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94031872,"data_stored":1504509952,"data_compressed":71438854,"data_compressed_allocated":94031872,"data_compressed_original":1504509952,"omap_allocated":0,"internal_metadata":0},"log_size":7690,"ondisk_log_size":7690,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61476,"kb_used_data":26324,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310364,"statfs":{"total":96636764160,"available":96573812736,"internally_reserved":0,"allocated":26955776,"data_stored":427499720,"data_compressed":20297527,"data_compressed_allocated":26718208,"data_compressed_original":427409408,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66804,"kb_used_data":27236,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94305036,"statfs":{"total":96636764160,"available":96568356864,"internally_reserved":0,"allocated":27889664,"data_stored":441610294,"data_compressed":20966846,"data_compressed_allocated":27598848,"data_compressed_original":441499648,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53568,"kb_used_data":22576,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318272,"statfs":{"total":96636764160,"available":96581910528,"internally_reserved":0,"allocated":23117824,"data_stored":366419643,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":20,"seq":85899345949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59936,"kb_used_data":16208,"kb_used_omap":0,"kb_used_meta":43712,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":16596992,"data_stored":261821059,"data_compressed":12430614,"data_compressed_allocated":16363520,"data_compressed_original":261734400,"omap_allocated":0,"internal_metadata":44761088},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":268566528,"data_compressed":12752229,"data_compressed_allocated":16785408,"data_compressed_original":268566528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22896640,"data_stored":366346240,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27672576,"data_stored":442761216,"data_compressed":21023941,"data_compressed_allocated":27672576,"data_compressed_original":442761216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26677248,"data_stored":426835968,"data_compressed":20267486,"data_compressed_allocated":26677248,"data_compressed_original":426835968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:01.102 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:47:01.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:01.196+0000 7f9219551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:01.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:01.209+0000 7f9219551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:01.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:01.267+0000 7ff643148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:01.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:01.280+0000 7ff643148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:01.652 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:01.652 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 4 pgs peering","count":4},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":123,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":32,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472794,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":10},{"state_name":"peering","count":9},{"state_name":"stale+active+clean","count":6}],"num_pgs":25,"num_pools":3,"num_objects":7686,"data_bytes":504037928,"bytes_used":247586816,"bytes_avail":386299469824,"bytes_total":386547056640,"inactive_pgs_ratio":0.36000001430511475,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":27299,"recovering_keys_per_sec":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"write_bytes_sec":3903887,"read_op_per_sec":0,"write_op_per_sec":59},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:47:01.670 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:47:01.671 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:01.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:01.807+0000 7fd231f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:01.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:01.823+0000 7fd231f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:02.087 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:02.088 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:02.105 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-16T07:47:00.310660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":504037928,"num_objects":7686,"num_object_clones":0,"num_object_copies":23058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7762,"num_write_kb":492755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":851968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7745,"ondisk_log_size":7745,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":241784,"kb_used_data":92344,"kb_used_omap":0,"kb_used_meta":149376,"kb_avail":377245576,"statfs":{"total":386547056640,"available":386299469824,"internally_reserved":0,"allocated":94560256,"data_stored":1497350716,"data_compressed":71090185,"data_compressed_allocated":93577216,"data_compressed_original":1496989696,"omap_allocated":0,"internal_metadata":152961024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46858240,"num_objects":715,"num_object_clones":0,"num_object_copies":2145,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":715,"num_write_kb":45760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002967"},"pg_stats":[{"pgid":"3.f","version":"25'395","reported_seq":427,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:12.954045+0000","last_change":"2024-09-16T07:45:44.535560+0000","last_active":"2024-09-16T07:46:12.954045+0000","last_peered":"2024-09-16T07:46:12.954045+0000","last_clean":"2024-09-16T07:46:12.954045+0000","last_became_active":"2024-09-16T07:45:44.523789+0000","last_became_peered":"2024-09-16T07:45:44.523789+0000","last_unstale":"2024-09-16T07:46:33.558424+0000","last_undegraded":"2024-09-16T07:46:12.954045+0000","last_fullsized":"2024-09-16T07:46:12.954045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25821184,"num_objects":394,"num_object_clones":0,"num_object_copies":1182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":25216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'604","reported_seq":648,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.651531+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:46:48.651531+0000","last_peered":"2024-09-16T07:46:48.651531+0000","last_clean":"2024-09-16T07:46:48.651531+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:46:48.651531+0000","last_undegraded":"2024-09-16T07:46:48.651531+0000","last_fullsized":"2024-09-16T07:46:48.651531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'437","reported_seq":474,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.604809+0000","last_change":"2024-09-16T07:46:33.614981+0000","last_active":"2024-09-16T07:46:33.614981+0000","last_peered":"2024-09-16T07:46:20.807285+0000","last_clean":"2024-09-16T07:46:20.807285+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:34.604809+0000","last_undegraded":"2024-09-16T07:46:34.604809+0000","last_fullsized":"2024-09-16T07:46:34.604809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":437,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'342","reported_seq":375,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.292186+0000","last_change":"2024-09-16T07:45:50.902218+0000","last_active":"2024-09-16T07:46:13.292186+0000","last_peered":"2024-09-16T07:46:13.292186+0000","last_clean":"2024-09-16T07:46:13.292186+0000","last_became_active":"2024-09-16T07:45:50.691944+0000","last_became_peered":"2024-09-16T07:45:50.691944+0000","last_unstale":"2024-09-16T07:46:33.558428+0000","last_undegraded":"2024-09-16T07:46:13.292186+0000","last_fullsized":"2024-09-16T07:46:13.292186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'451","reported_seq":490,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.615849+0000","last_change":"2024-09-16T07:46:33.615849+0000","last_active":"2024-09-16T07:46:33.615849+0000","last_peered":"2024-09-16T07:46:20.759422+0000","last_clean":"2024-09-16T07:46:20.759422+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:33.615849+0000","last_undegraded":"2024-09-16T07:46:33.615849+0000","last_fullsized":"2024-09-16T07:46:33.615849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'355","reported_seq":381,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.308341+0000","last_change":"2024-09-16T07:45:50.666069+0000","last_active":"2024-09-16T07:46:13.308341+0000","last_peered":"2024-09-16T07:46:13.308341+0000","last_clean":"2024-09-16T07:46:13.308341+0000","last_became_active":"2024-09-16T07:45:50.653189+0000","last_became_peered":"2024-09-16T07:45:50.653189+0000","last_unstale":"2024-09-16T07:46:33.558430+0000","last_undegraded":"2024-09-16T07:46:13.308341+0000","last_fullsized":"2024-09-16T07:46:13.308341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23199744,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":22656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'390","reported_seq":416,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:13.247682+0000","last_change":"2024-09-16T07:45:50.622899+0000","last_active":"2024-09-16T07:46:13.247682+0000","last_peered":"2024-09-16T07:46:13.247682+0000","last_clean":"2024-09-16T07:46:13.247682+0000","last_became_active":"2024-09-16T07:45:50.606399+0000","last_became_peered":"2024-09-16T07:45:50.606399+0000","last_unstale":"2024-09-16T07:46:33.558433+0000","last_undegraded":"2024-09-16T07:46:13.247682+0000","last_fullsized":"2024-09-16T07:46:13.247682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'440","reported_seq":485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.613447+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:34.613447+0000","last_peered":"2024-09-16T07:46:34.613447+0000","last_clean":"2024-09-16T07:46:34.613447+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:34.613447+0000","last_undegraded":"2024-09-16T07:46:34.613447+0000","last_fullsized":"2024-09-16T07:46:34.613447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":115,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.594594+0000","last_change":"2024-09-16T07:46:33.594594+0000","last_active":"2024-09-16T07:46:33.594594+0000","last_peered":"2024-09-16T07:45:51.484915+0000","last_clean":"2024-09-16T07:45:51.484915+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:46:33.594594+0000","last_undegraded":"2024-09-16T07:46:33.594594+0000","last_fullsized":"2024-09-16T07:46:33.594594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":45,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.608687+0000","last_change":"2024-09-16T07:46:33.608687+0000","last_active":"2024-09-16T07:46:33.608687+0000","last_peered":"2024-09-16T07:45:51.505238+0000","last_clean":"2024-09-16T07:45:51.505238+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:46:33.608687+0000","last_undegraded":"2024-09-16T07:46:33.608687+0000","last_fullsized":"2024-09-16T07:46:33.608687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'476","reported_seq":513,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.603544+0000","last_change":"2024-09-16T07:46:33.602602+0000","last_active":"2024-09-16T07:46:33.602602+0000","last_peered":"2024-09-16T07:46:20.769086+0000","last_clean":"2024-09-16T07:46:20.769086+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:34.603544+0000","last_undegraded":"2024-09-16T07:46:34.603544+0000","last_fullsized":"2024-09-16T07:46:34.603544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":476,"num_write_kb":30464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.513996+0000","last_change":"2024-09-16T07:45:51.521750+0000","last_active":"2024-09-16T07:45:51.513996+0000","last_peered":"2024-09-16T07:45:51.513996+0000","last_clean":"2024-09-16T07:45:51.513996+0000","last_became_active":"2024-09-16T07:45:50.665366+0000","last_became_peered":"2024-09-16T07:45:50.665366+0000","last_unstale":"2024-09-16T07:46:33.558437+0000","last_undegraded":"2024-09-16T07:45:51.513996+0000","last_fullsized":"2024-09-16T07:45:51.513996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'459","reported_seq":496,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.583420+0000","last_change":"2024-09-16T07:46:33.579664+0000","last_active":"2024-09-16T07:46:33.579664+0000","last_peered":"2024-09-16T07:46:20.817119+0000","last_clean":"2024-09-16T07:46:20.817119+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:34.583420+0000","last_undegraded":"2024-09-16T07:46:34.583420+0000","last_fullsized":"2024-09-16T07:46:34.583420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30081024,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":29376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.584979+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:34.584979+0000","last_peered":"2024-09-16T07:46:34.584979+0000","last_clean":"2024-09-16T07:46:34.584979+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:34.584979+0000","last_undegraded":"2024-09-16T07:46:34.584979+0000","last_fullsized":"2024-09-16T07:46:34.584979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'463","reported_seq":510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.602455+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:34.602455+0000","last_peered":"2024-09-16T07:46:34.602455+0000","last_clean":"2024-09-16T07:46:34.602455+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:34.602455+0000","last_undegraded":"2024-09-16T07:46:34.602455+0000","last_fullsized":"2024-09-16T07:46:34.602455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30343168,"num_objects":463,"num_object_clones":0,"num_object_copies":1389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":463,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":33,"reported_epoch":25,"state":"stale+active+clean","last_fresh":"2024-09-16T07:45:51.511360+0000","last_change":"2024-09-16T07:45:51.520543+0000","last_active":"2024-09-16T07:45:51.511360+0000","last_peered":"2024-09-16T07:45:51.511360+0000","last_clean":"2024-09-16T07:45:51.511360+0000","last_became_active":"2024-09-16T07:45:50.656425+0000","last_became_peered":"2024-09-16T07:45:50.656425+0000","last_unstale":"2024-09-16T07:46:33.558440+0000","last_undegraded":"2024-09-16T07:45:51.511360+0000","last_fullsized":"2024-09-16T07:45:51.511360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'593","reported_seq":638,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.680405+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:46:48.680405+0000","last_peered":"2024-09-16T07:46:48.680405+0000","last_clean":"2024-09-16T07:46:48.680405+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:46:48.680405+0000","last_undegraded":"2024-09-16T07:46:48.680405+0000","last_fullsized":"2024-09-16T07:46:48.680405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"25'525","reported_seq":565,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.606029+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:34.606029+0000","last_peered":"2024-09-16T07:46:34.606029+0000","last_clean":"2024-09-16T07:46:34.606029+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:34.606029+0000","last_undegraded":"2024-09-16T07:46:34.606029+0000","last_fullsized":"2024-09-16T07:46:34.606029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'647","reported_seq":705,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.629129+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:46:48.629129+0000","last_peered":"2024-09-16T07:46:48.629129+0000","last_clean":"2024-09-16T07:46:48.629129+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:46:48.629129+0000","last_undegraded":"2024-09-16T07:46:48.629129+0000","last_fullsized":"2024-09-16T07:46:48.629129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.613664+0000","last_change":"2024-09-16T07:46:33.613664+0000","last_active":"2024-09-16T07:46:33.613664+0000","last_peered":"2024-09-16T07:45:51.499250+0000","last_clean":"2024-09-16T07:45:51.499250+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:46:33.613664+0000","last_undegraded":"2024-09-16T07:46:33.613664+0000","last_fullsized":"2024-09-16T07:46:33.613664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'490","reported_seq":526,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.582711+0000","last_change":"2024-09-16T07:46:33.582711+0000","last_active":"2024-09-16T07:46:33.582711+0000","last_peered":"2024-09-16T07:46:20.729315+0000","last_clean":"2024-09-16T07:46:20.729315+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:33.582711+0000","last_undegraded":"2024-09-16T07:46:33.582711+0000","last_fullsized":"2024-09-16T07:46:33.582711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'623","reported_seq":667,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.609305+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:46:48.609305+0000","last_peered":"2024-09-16T07:46:48.609305+0000","last_clean":"2024-09-16T07:46:48.609305+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:46:48.609305+0000","last_undegraded":"2024-09-16T07:46:48.609305+0000","last_fullsized":"2024-09-16T07:46:48.609305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40763392,"num_objects":622,"num_object_clones":0,"num_object_copies":1866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":39808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.601073+0000","last_change":"2024-09-16T07:46:33.601073+0000","last_active":"2024-09-16T07:46:33.601073+0000","last_peered":"2024-09-16T07:45:51.507878+0000","last_clean":"2024-09-16T07:45:51.507878+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:46:33.601073+0000","last_undegraded":"2024-09-16T07:46:33.601073+0000","last_fullsized":"2024-09-16T07:46:33.601073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":503447552,"num_objects":7682,"num_object_clones":0,"num_object_copies":23046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7682,"num_write_kb":491648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":851968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94031872,"data_stored":1504509952,"data_compressed":71438854,"data_compressed_allocated":94031872,"data_compressed_original":1504509952,"omap_allocated":0,"internal_metadata":0},"log_size":7690,"ondisk_log_size":7690,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61476,"kb_used_data":26324,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310364,"statfs":{"total":96636764160,"available":96573812736,"internally_reserved":0,"allocated":26955776,"data_stored":427499720,"data_compressed":20297527,"data_compressed_allocated":26718208,"data_compressed_original":427409408,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66804,"kb_used_data":27236,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94305036,"statfs":{"total":96636764160,"available":96568356864,"internally_reserved":0,"allocated":27889664,"data_stored":441610294,"data_compressed":20966846,"data_compressed_allocated":27598848,"data_compressed_original":441499648,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53568,"kb_used_data":22576,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318272,"statfs":{"total":96636764160,"available":96581910528,"internally_reserved":0,"allocated":23117824,"data_stored":366419643,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":20,"seq":85899345949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59936,"kb_used_data":16208,"kb_used_omap":0,"kb_used_meta":43712,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":16596992,"data_stored":261821059,"data_compressed":12430614,"data_compressed_allocated":16363520,"data_compressed_original":261734400,"omap_allocated":0,"internal_metadata":44761088},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":268566528,"data_compressed":12752229,"data_compressed_allocated":16785408,"data_compressed_original":268566528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22896640,"data_stored":366346240,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27672576,"data_stored":442761216,"data_compressed":21023941,"data_compressed_allocated":27672576,"data_compressed_original":442761216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26677248,"data_stored":426835968,"data_compressed":20267486,"data_compressed_allocated":26677248,"data_compressed_original":426835968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:03.604 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:03.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:03.750+0000 7f8085888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:03.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:03.759+0000 7f8085888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:05.107 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:05.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:05.259+0000 7f5c294d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:05.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:05.272+0000 7f5c294d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:05.596 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:05.599 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:05.619 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-09-16T07:47:04.311658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":524091944,"num_objects":7992,"num_object_clones":0,"num_object_copies":23976,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9366,"num_write_kb":553875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":851968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9353,"ondisk_log_size":9353,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":230956,"kb_used_data":97388,"kb_used_omap":0,"kb_used_meta":133504,"kb_avail":377256404,"statfs":{"total":386547056640,"available":386310557696,"internally_reserved":0,"allocated":99725312,"data_stored":1579032583,"data_compressed":74968484,"data_compressed_allocated":98680832,"data_compressed_original":1578647552,"omap_allocated":0,"internal_metadata":136708096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20054016,"num_objects":306,"num_object_clones":0,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1604,"num_write_kb":61120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002847"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:03.272851+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'604","reported_seq":648,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.651531+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:46:48.651531+0000","last_peered":"2024-09-16T07:46:48.651531+0000","last_clean":"2024-09-16T07:46:48.651531+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:46:48.651531+0000","last_undegraded":"2024-09-16T07:46:48.651531+0000","last_fullsized":"2024-09-16T07:46:48.651531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'437","reported_seq":474,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.604809+0000","last_change":"2024-09-16T07:46:33.614981+0000","last_active":"2024-09-16T07:46:33.614981+0000","last_peered":"2024-09-16T07:46:20.807285+0000","last_clean":"2024-09-16T07:46:20.807285+0000","last_became_active":"2024-09-16T07:45:44.523778+0000","last_became_peered":"2024-09-16T07:45:44.523778+0000","last_unstale":"2024-09-16T07:46:34.604809+0000","last_undegraded":"2024-09-16T07:46:34.604809+0000","last_fullsized":"2024-09-16T07:46:34.604809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":437,"num_write_kb":27968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:03.505123+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'451","reported_seq":490,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.615849+0000","last_change":"2024-09-16T07:46:33.615849+0000","last_active":"2024-09-16T07:46:33.615849+0000","last_peered":"2024-09-16T07:46:20.759422+0000","last_clean":"2024-09-16T07:46:20.759422+0000","last_became_active":"2024-09-16T07:45:50.607261+0000","last_became_peered":"2024-09-16T07:45:50.607261+0000","last_unstale":"2024-09-16T07:46:33.615849+0000","last_undegraded":"2024-09-16T07:46:33.615849+0000","last_fullsized":"2024-09-16T07:46:33.615849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:03.561096+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:03.624369+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'440","reported_seq":485,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.613447+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:46:34.613447+0000","last_peered":"2024-09-16T07:46:34.613447+0000","last_clean":"2024-09-16T07:46:34.613447+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:46:34.613447+0000","last_undegraded":"2024-09-16T07:46:34.613447+0000","last_fullsized":"2024-09-16T07:46:34.613447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":115,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.594594+0000","last_change":"2024-09-16T07:46:33.594594+0000","last_active":"2024-09-16T07:46:33.594594+0000","last_peered":"2024-09-16T07:45:51.484915+0000","last_clean":"2024-09-16T07:45:51.484915+0000","last_became_active":"2024-09-16T07:45:50.561578+0000","last_became_peered":"2024-09-16T07:45:50.561578+0000","last_unstale":"2024-09-16T07:46:33.594594+0000","last_undegraded":"2024-09-16T07:46:33.594594+0000","last_fullsized":"2024-09-16T07:46:33.594594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":45,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.608687+0000","last_change":"2024-09-16T07:46:33.608687+0000","last_active":"2024-09-16T07:46:33.608687+0000","last_peered":"2024-09-16T07:45:51.505238+0000","last_clean":"2024-09-16T07:45:51.505238+0000","last_became_active":"2024-09-16T07:45:50.615549+0000","last_became_peered":"2024-09-16T07:45:50.615549+0000","last_unstale":"2024-09-16T07:46:33.608687+0000","last_undegraded":"2024-09-16T07:46:33.608687+0000","last_fullsized":"2024-09-16T07:46:33.608687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'476","reported_seq":513,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.603544+0000","last_change":"2024-09-16T07:46:33.602602+0000","last_active":"2024-09-16T07:46:33.602602+0000","last_peered":"2024-09-16T07:46:20.769086+0000","last_clean":"2024-09-16T07:46:20.769086+0000","last_became_active":"2024-09-16T07:45:44.515986+0000","last_became_peered":"2024-09-16T07:45:44.515986+0000","last_unstale":"2024-09-16T07:46:34.603544+0000","last_undegraded":"2024-09-16T07:46:34.603544+0000","last_fullsized":"2024-09-16T07:46:34.603544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":476,"num_write_kb":30464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:46:46.024074+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'459","reported_seq":496,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:34.583420+0000","last_change":"2024-09-16T07:46:33.579664+0000","last_active":"2024-09-16T07:46:33.579664+0000","last_peered":"2024-09-16T07:46:20.817119+0000","last_clean":"2024-09-16T07:46:20.817119+0000","last_became_active":"2024-09-16T07:45:44.523881+0000","last_became_peered":"2024-09-16T07:45:44.523881+0000","last_unstale":"2024-09-16T07:46:34.583420+0000","last_undegraded":"2024-09-16T07:46:34.583420+0000","last_fullsized":"2024-09-16T07:46:34.583420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30081024,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":29376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.584979+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:34.584979+0000","last_peered":"2024-09-16T07:46:34.584979+0000","last_clean":"2024-09-16T07:46:34.584979+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:34.584979+0000","last_undegraded":"2024-09-16T07:46:34.584979+0000","last_fullsized":"2024-09-16T07:46:34.584979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"25'463","reported_seq":510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.602455+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:46:34.602455+0000","last_peered":"2024-09-16T07:46:34.602455+0000","last_clean":"2024-09-16T07:46:34.602455+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:46:34.602455+0000","last_undegraded":"2024-09-16T07:46:34.602455+0000","last_fullsized":"2024-09-16T07:46:34.602455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30343168,"num_objects":463,"num_object_clones":0,"num_object_copies":1389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":463,"num_write_kb":29632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:46:46.023044+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'593","reported_seq":638,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.680405+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:46:48.680405+0000","last_peered":"2024-09-16T07:46:48.680405+0000","last_clean":"2024-09-16T07:46:48.680405+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:46:48.680405+0000","last_undegraded":"2024-09-16T07:46:48.680405+0000","last_fullsized":"2024-09-16T07:46:48.680405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"25'525","reported_seq":565,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-16T07:46:34.606029+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:46:34.606029+0000","last_peered":"2024-09-16T07:46:34.606029+0000","last_clean":"2024-09-16T07:46:34.606029+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:46:34.606029+0000","last_undegraded":"2024-09-16T07:46:34.606029+0000","last_fullsized":"2024-09-16T07:46:34.606029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34406400,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":33600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'647","reported_seq":705,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.629129+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:46:48.629129+0000","last_peered":"2024-09-16T07:46:48.629129+0000","last_clean":"2024-09-16T07:46:48.629129+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:46:48.629129+0000","last_undegraded":"2024-09-16T07:46:48.629129+0000","last_fullsized":"2024-09-16T07:46:48.629129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.613664+0000","last_change":"2024-09-16T07:46:33.613664+0000","last_active":"2024-09-16T07:46:33.613664+0000","last_peered":"2024-09-16T07:45:51.499250+0000","last_clean":"2024-09-16T07:45:51.499250+0000","last_became_active":"2024-09-16T07:45:50.577660+0000","last_became_peered":"2024-09-16T07:45:50.577660+0000","last_unstale":"2024-09-16T07:46:33.613664+0000","last_undegraded":"2024-09-16T07:46:33.613664+0000","last_fullsized":"2024-09-16T07:46:33.613664+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"25'490","reported_seq":526,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.582711+0000","last_change":"2024-09-16T07:46:33.582711+0000","last_active":"2024-09-16T07:46:33.582711+0000","last_peered":"2024-09-16T07:46:20.729315+0000","last_clean":"2024-09-16T07:46:20.729315+0000","last_became_active":"2024-09-16T07:45:44.534700+0000","last_became_peered":"2024-09-16T07:45:44.534700+0000","last_unstale":"2024-09-16T07:46:33.582711+0000","last_undegraded":"2024-09-16T07:46:33.582711+0000","last_fullsized":"2024-09-16T07:46:33.582711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'623","reported_seq":667,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.609305+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:46:48.609305+0000","last_peered":"2024-09-16T07:46:48.609305+0000","last_clean":"2024-09-16T07:46:48.609305+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:46:48.609305+0000","last_undegraded":"2024-09-16T07:46:48.609305+0000","last_fullsized":"2024-09-16T07:46:48.609305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40763392,"num_objects":622,"num_object_clones":0,"num_object_copies":1866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":39808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-16T07:46:33.601073+0000","last_change":"2024-09-16T07:46:33.601073+0000","last_active":"2024-09-16T07:46:33.601073+0000","last_peered":"2024-09-16T07:45:51.507878+0000","last_clean":"2024-09-16T07:45:51.507878+0000","last_became_active":"2024-09-16T07:45:50.581296+0000","last_became_peered":"2024-09-16T07:45:50.581296+0000","last_unstale":"2024-09-16T07:46:33.601073+0000","last_undegraded":"2024-09-16T07:46:33.601073+0000","last_fullsized":"2024-09-16T07:46:33.601073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":523501568,"num_objects":7988,"num_object_clones":0,"num_object_copies":23964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9286,"num_write_kb":552768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":851968,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98099200,"data_stored":1569521688,"data_compressed":74526705,"data_compressed_allocated":98095104,"data_compressed_original":1569521664,"omap_allocated":0,"internal_metadata":0},"log_size":9298,"ondisk_log_size":9298,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61476,"kb_used_data":26324,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310364,"statfs":{"total":96636764160,"available":96573812736,"internally_reserved":0,"allocated":26955776,"data_stored":427499720,"data_compressed":20297527,"data_compressed_allocated":26718208,"data_compressed_original":427409408,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66804,"kb_used_data":27236,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94305036,"statfs":{"total":96636764160,"available":96568356864,"internally_reserved":0,"allocated":27889664,"data_stored":441610294,"data_compressed":20966846,"data_compressed_allocated":27598848,"data_compressed_original":441499648,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53568,"kb_used_data":22576,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318272,"statfs":{"total":96636764160,"available":96581910528,"internally_reserved":0,"allocated":23117824,"data_stored":366419643,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22896640,"data_stored":366346240,"data_compressed":17395198,"data_compressed_allocated":22896640,"data_compressed_original":366346240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27672576,"data_stored":442761216,"data_compressed":21023941,"data_compressed_allocated":27672576,"data_compressed_original":442761216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26677248,"data_stored":426835968,"data_compressed":20267486,"data_compressed_allocated":26677248,"data_compressed_original":426835968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:05.621 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:47:05.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:05.783+0000 7fa4f3d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:05.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:05.796+0000 7fa4f3d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:06.205 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:06.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:06.278 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 4 pgs peering","count":4},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":128,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":32,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472794,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":16},{"state_name":"peering","count":9}],"num_pgs":25,"num_pools":3,"num_objects":7992,"data_bytes":524091944,"bytes_used":236498944,"bytes_avail":386310557696,"bytes_total":386547056640,"inactive_pgs_ratio":0.36000001430511475,"write_bytes_sec":5214336,"read_op_per_sec":0,"write_op_per_sec":133},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:47:06.299 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:47:06.300 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:06.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:06.380+0000 7f09e8511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:06.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:06.392+0000 7f09e8511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:06.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:06.454+0000 7f1b90446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:06.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:06.466+0000 7f1b90446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:06.830 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:06.831 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:06.846 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-16T07:47:06.312187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":509805120,"num_objects":7775,"num_object_clones":0,"num_object_copies":23325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12233,"num_write_kb":638612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12220,"ondisk_log_size":12220,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":233548,"kb_used_data":95812,"kb_used_omap":0,"kb_used_meta":137664,"kb_avail":377253812,"statfs":{"total":386547056640,"available":386307903488,"internally_reserved":0,"allocated":98111488,"data_stored":1551548141,"data_compressed":73663296,"data_compressed_allocated":96960512,"data_compressed_original":1551122432,"omap_allocated":0,"internal_metadata":140967936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5767192,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4471,"num_write_kb":145857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002893"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:03.272851+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'604","reported_seq":648,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.651531+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:46:48.651531+0000","last_peered":"2024-09-16T07:46:48.651531+0000","last_clean":"2024-09-16T07:46:48.651531+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:46:48.651531+0000","last_undegraded":"2024-09-16T07:46:48.651531+0000","last_fullsized":"2024-09-16T07:46:48.651531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'775","reported_seq":837,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.322614+0000","last_change":"2024-09-16T07:46:35.964084+0000","last_active":"2024-09-16T07:47:05.322614+0000","last_peered":"2024-09-16T07:47:05.322614+0000","last_clean":"2024-09-16T07:47:05.322614+0000","last_became_active":"2024-09-16T07:46:35.741381+0000","last_became_peered":"2024-09-16T07:46:35.741381+0000","last_unstale":"2024-09-16T07:47:05.322614+0000","last_undegraded":"2024-09-16T07:47:05.322614+0000","last_fullsized":"2024-09-16T07:47:05.322614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049432,"num_objects":429,"num_object_clones":0,"num_object_copies":1287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":775,"num_write_kb":38465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:03.505123+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'825","reported_seq":884,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.190721+0000","last_change":"2024-09-16T07:46:35.708878+0000","last_active":"2024-09-16T07:47:05.190721+0000","last_peered":"2024-09-16T07:47:05.190721+0000","last_clean":"2024-09-16T07:47:05.190721+0000","last_became_active":"2024-09-16T07:46:35.703030+0000","last_became_peered":"2024-09-16T07:46:35.703030+0000","last_unstale":"2024-09-16T07:47:05.190721+0000","last_undegraded":"2024-09-16T07:47:05.190721+0000","last_fullsized":"2024-09-16T07:47:05.190721+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:03.561096+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:03.624369+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'791","reported_seq":851,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.269537+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:47:05.269537+0000","last_peered":"2024-09-16T07:47:05.269537+0000","last_clean":"2024-09-16T07:47:05.269537+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:47:05.269537+0000","last_undegraded":"2024-09-16T07:47:05.269537+0000","last_fullsized":"2024-09-16T07:47:05.269537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27852800,"num_objects":425,"num_object_clones":0,"num_object_copies":1275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"32'827","reported_seq":888,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.216849+0000","last_change":"2024-09-16T07:46:35.923460+0000","last_active":"2024-09-16T07:47:05.216849+0000","last_peered":"2024-09-16T07:47:05.216849+0000","last_clean":"2024-09-16T07:47:05.216849+0000","last_became_active":"2024-09-16T07:46:35.730207+0000","last_became_peered":"2024-09-16T07:46:35.730207+0000","last_unstale":"2024-09-16T07:47:05.216849+0000","last_undegraded":"2024-09-16T07:47:05.216849+0000","last_fullsized":"2024-09-16T07:47:05.216849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:46:46.024074+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'820","reported_seq":883,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.326256+0000","last_change":"2024-09-16T07:46:35.882240+0000","last_active":"2024-09-16T07:47:05.326256+0000","last_peered":"2024-09-16T07:47:05.326256+0000","last_clean":"2024-09-16T07:47:05.326256+0000","last_became_active":"2024-09-16T07:46:35.673492+0000","last_became_peered":"2024-09-16T07:46:35.673492+0000","last_unstale":"2024-09-16T07:47:05.326256+0000","last_undegraded":"2024-09-16T07:47:05.326256+0000","last_fullsized":"2024-09-16T07:47:05.326256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28180480,"num_objects":430,"num_object_clones":0,"num_object_copies":1290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":820,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'805","reported_seq":867,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.163767+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:47:05.163767+0000","last_peered":"2024-09-16T07:47:05.163767+0000","last_clean":"2024-09-16T07:47:05.163767+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:47:05.163767+0000","last_undegraded":"2024-09-16T07:47:05.163767+0000","last_fullsized":"2024-09-16T07:47:05.163767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:46:46.023044+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'593","reported_seq":638,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.680405+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:46:48.680405+0000","last_peered":"2024-09-16T07:46:48.680405+0000","last_clean":"2024-09-16T07:46:48.680405+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:46:48.680405+0000","last_undegraded":"2024-09-16T07:46:48.680405+0000","last_fullsized":"2024-09-16T07:46:48.680405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'908","reported_seq":963,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.261365+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:47:05.261365+0000","last_peered":"2024-09-16T07:47:05.261365+0000","last_clean":"2024-09-16T07:47:05.261365+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:47:05.261365+0000","last_undegraded":"2024-09-16T07:47:05.261365+0000","last_fullsized":"2024-09-16T07:47:05.261365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29491200,"num_objects":450,"num_object_clones":0,"num_object_copies":1350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'647","reported_seq":705,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.629129+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:46:48.629129+0000","last_peered":"2024-09-16T07:46:48.629129+0000","last_clean":"2024-09-16T07:46:48.629129+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:46:48.629129+0000","last_undegraded":"2024-09-16T07:46:48.629129+0000","last_fullsized":"2024-09-16T07:46:48.629129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'857","reported_seq":913,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.151219+0000","last_change":"2024-09-16T07:46:35.714657+0000","last_active":"2024-09-16T07:47:05.151219+0000","last_peered":"2024-09-16T07:47:05.151219+0000","last_clean":"2024-09-16T07:47:05.151219+0000","last_became_active":"2024-09-16T07:46:35.703204+0000","last_became_peered":"2024-09-16T07:46:35.703204+0000","last_unstale":"2024-09-16T07:47:05.151219+0000","last_undegraded":"2024-09-16T07:47:05.151219+0000","last_fullsized":"2024-09-16T07:47:05.151219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'623","reported_seq":667,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.609305+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:46:48.609305+0000","last_peered":"2024-09-16T07:46:48.609305+0000","last_clean":"2024-09-16T07:46:48.609305+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:46:48.609305+0000","last_undegraded":"2024-09-16T07:46:48.609305+0000","last_fullsized":"2024-09-16T07:46:48.609305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40763392,"num_objects":622,"num_object_clones":0,"num_object_copies":1866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":39808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":509214744,"num_objects":7771,"num_object_clones":0,"num_object_copies":23313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12153,"num_write_kb":637505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95268864,"data_stored":1524105288,"data_compressed":72371941,"data_compressed_allocated":95256576,"data_compressed_original":1524105216,"omap_allocated":0,"internal_metadata":0},"log_size":12165,"ondisk_log_size":12165,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64828,"kb_used_data":25516,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94307012,"statfs":{"total":96636764160,"available":96570380288,"internally_reserved":0,"allocated":26128384,"data_stored":413429819,"data_compressed":19629417,"data_compressed_allocated":25837568,"data_compressed_original":413319168,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66804,"kb_used_data":27236,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94305036,"statfs":{"total":96636764160,"available":96568356864,"internally_reserved":0,"allocated":27889664,"data_stored":441610294,"data_compressed":20966846,"data_compressed_allocated":27598848,"data_compressed_original":441499648,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52808,"kb_used_data":21808,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94319032,"statfs":{"total":96636764160,"available":96582688768,"internally_reserved":0,"allocated":22331392,"data_stored":353005102,"data_compressed":16758120,"data_compressed_allocated":22056960,"data_compressed_original":352911360,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21532672,"data_stored":344457240,"data_compressed":16356672,"data_compressed_allocated":21528576,"data_compressed_original":344457216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27672576,"data_stored":442761216,"data_compressed":21023941,"data_compressed_allocated":27672576,"data_compressed_original":442761216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25210880,"data_stored":403308568,"data_compressed":19151248,"data_compressed_allocated":25206784,"data_compressed_original":403308544,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:08.857 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:09.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:09.034+0000 7f261febd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:09.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:09.045+0000 7f261febd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:09.849 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:10.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:09.997+0000 7f5ec8511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:10.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:10.010+0000 7f5ec8511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:10.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:10.285 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:10.303 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-09-16T07:47:08.312676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":509805120,"num_objects":7775,"num_object_clones":0,"num_object_copies":23325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12233,"num_write_kb":638612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12220,"ondisk_log_size":12220,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":233548,"kb_used_data":95812,"kb_used_omap":0,"kb_used_meta":137664,"kb_avail":377253812,"statfs":{"total":386547056640,"available":386307903488,"internally_reserved":0,"allocated":98111488,"data_stored":1551548141,"data_compressed":73663296,"data_compressed_allocated":96960512,"data_compressed_original":1551122432,"omap_allocated":0,"internal_metadata":140967936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5767192,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4471,"num_write_kb":145857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002917"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:03.272851+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'604","reported_seq":648,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.651531+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:46:48.651531+0000","last_peered":"2024-09-16T07:46:48.651531+0000","last_clean":"2024-09-16T07:46:48.651531+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:46:48.651531+0000","last_undegraded":"2024-09-16T07:46:48.651531+0000","last_fullsized":"2024-09-16T07:46:48.651531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'775","reported_seq":837,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.322614+0000","last_change":"2024-09-16T07:46:35.964084+0000","last_active":"2024-09-16T07:47:05.322614+0000","last_peered":"2024-09-16T07:47:05.322614+0000","last_clean":"2024-09-16T07:47:05.322614+0000","last_became_active":"2024-09-16T07:46:35.741381+0000","last_became_peered":"2024-09-16T07:46:35.741381+0000","last_unstale":"2024-09-16T07:47:05.322614+0000","last_undegraded":"2024-09-16T07:47:05.322614+0000","last_fullsized":"2024-09-16T07:47:05.322614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049432,"num_objects":429,"num_object_clones":0,"num_object_copies":1287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":775,"num_write_kb":38465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:03.505123+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'825","reported_seq":884,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.190721+0000","last_change":"2024-09-16T07:46:35.708878+0000","last_active":"2024-09-16T07:47:05.190721+0000","last_peered":"2024-09-16T07:47:05.190721+0000","last_clean":"2024-09-16T07:47:05.190721+0000","last_became_active":"2024-09-16T07:46:35.703030+0000","last_became_peered":"2024-09-16T07:46:35.703030+0000","last_unstale":"2024-09-16T07:47:05.190721+0000","last_undegraded":"2024-09-16T07:47:05.190721+0000","last_fullsized":"2024-09-16T07:47:05.190721+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:03.561096+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:03.624369+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'791","reported_seq":851,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.269537+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:47:05.269537+0000","last_peered":"2024-09-16T07:47:05.269537+0000","last_clean":"2024-09-16T07:47:05.269537+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:47:05.269537+0000","last_undegraded":"2024-09-16T07:47:05.269537+0000","last_fullsized":"2024-09-16T07:47:05.269537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27852800,"num_objects":425,"num_object_clones":0,"num_object_copies":1275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"32'827","reported_seq":888,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.216849+0000","last_change":"2024-09-16T07:46:35.923460+0000","last_active":"2024-09-16T07:47:05.216849+0000","last_peered":"2024-09-16T07:47:05.216849+0000","last_clean":"2024-09-16T07:47:05.216849+0000","last_became_active":"2024-09-16T07:46:35.730207+0000","last_became_peered":"2024-09-16T07:46:35.730207+0000","last_unstale":"2024-09-16T07:47:05.216849+0000","last_undegraded":"2024-09-16T07:47:05.216849+0000","last_fullsized":"2024-09-16T07:47:05.216849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:46:46.024074+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'820","reported_seq":883,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.326256+0000","last_change":"2024-09-16T07:46:35.882240+0000","last_active":"2024-09-16T07:47:05.326256+0000","last_peered":"2024-09-16T07:47:05.326256+0000","last_clean":"2024-09-16T07:47:05.326256+0000","last_became_active":"2024-09-16T07:46:35.673492+0000","last_became_peered":"2024-09-16T07:46:35.673492+0000","last_unstale":"2024-09-16T07:47:05.326256+0000","last_undegraded":"2024-09-16T07:47:05.326256+0000","last_fullsized":"2024-09-16T07:47:05.326256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28180480,"num_objects":430,"num_object_clones":0,"num_object_copies":1290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":820,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'805","reported_seq":867,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.163767+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:47:05.163767+0000","last_peered":"2024-09-16T07:47:05.163767+0000","last_clean":"2024-09-16T07:47:05.163767+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:47:05.163767+0000","last_undegraded":"2024-09-16T07:47:05.163767+0000","last_fullsized":"2024-09-16T07:47:05.163767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:46:46.023044+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'593","reported_seq":638,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.680405+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:46:48.680405+0000","last_peered":"2024-09-16T07:46:48.680405+0000","last_clean":"2024-09-16T07:46:48.680405+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:46:48.680405+0000","last_undegraded":"2024-09-16T07:46:48.680405+0000","last_fullsized":"2024-09-16T07:46:48.680405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'908","reported_seq":963,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.261365+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:47:05.261365+0000","last_peered":"2024-09-16T07:47:05.261365+0000","last_clean":"2024-09-16T07:47:05.261365+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:47:05.261365+0000","last_undegraded":"2024-09-16T07:47:05.261365+0000","last_fullsized":"2024-09-16T07:47:05.261365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29491200,"num_objects":450,"num_object_clones":0,"num_object_copies":1350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'647","reported_seq":705,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.629129+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:46:48.629129+0000","last_peered":"2024-09-16T07:46:48.629129+0000","last_clean":"2024-09-16T07:46:48.629129+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:46:48.629129+0000","last_undegraded":"2024-09-16T07:46:48.629129+0000","last_fullsized":"2024-09-16T07:46:48.629129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'857","reported_seq":913,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.151219+0000","last_change":"2024-09-16T07:46:35.714657+0000","last_active":"2024-09-16T07:47:05.151219+0000","last_peered":"2024-09-16T07:47:05.151219+0000","last_clean":"2024-09-16T07:47:05.151219+0000","last_became_active":"2024-09-16T07:46:35.703204+0000","last_became_peered":"2024-09-16T07:46:35.703204+0000","last_unstale":"2024-09-16T07:47:05.151219+0000","last_undegraded":"2024-09-16T07:47:05.151219+0000","last_fullsized":"2024-09-16T07:47:05.151219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'623","reported_seq":667,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.609305+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:46:48.609305+0000","last_peered":"2024-09-16T07:46:48.609305+0000","last_clean":"2024-09-16T07:46:48.609305+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:46:48.609305+0000","last_undegraded":"2024-09-16T07:46:48.609305+0000","last_fullsized":"2024-09-16T07:46:48.609305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40763392,"num_objects":622,"num_object_clones":0,"num_object_copies":1866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":39808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":509214744,"num_objects":7771,"num_object_clones":0,"num_object_copies":23313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12153,"num_write_kb":637505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95268864,"data_stored":1524105288,"data_compressed":72371941,"data_compressed_allocated":95256576,"data_compressed_original":1524105216,"omap_allocated":0,"internal_metadata":0},"log_size":12165,"ondisk_log_size":12165,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64828,"kb_used_data":25516,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94307012,"statfs":{"total":96636764160,"available":96570380288,"internally_reserved":0,"allocated":26128384,"data_stored":413429819,"data_compressed":19629417,"data_compressed_allocated":25837568,"data_compressed_original":413319168,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66804,"kb_used_data":27236,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94305036,"statfs":{"total":96636764160,"available":96568356864,"internally_reserved":0,"allocated":27889664,"data_stored":441610294,"data_compressed":20966846,"data_compressed_allocated":27598848,"data_compressed_original":441499648,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52808,"kb_used_data":21808,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94319032,"statfs":{"total":96636764160,"available":96582688768,"internally_reserved":0,"allocated":22331392,"data_stored":353005102,"data_compressed":16758120,"data_compressed_allocated":22056960,"data_compressed_original":352911360,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21532672,"data_stored":344457240,"data_compressed":16356672,"data_compressed_allocated":21528576,"data_compressed_original":344457216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27672576,"data_stored":442761216,"data_compressed":21023941,"data_compressed_allocated":27672576,"data_compressed_original":442761216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25210880,"data_stored":403308568,"data_compressed":19151248,"data_compressed_allocated":25206784,"data_compressed_original":403308544,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:10.305 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:47:10.305 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:47:10.305 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:10.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:10.480+0000 7f249c751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:10.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:10.497+0000 7f249c751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:10.891 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:10.892 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:10.910 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-09-16T07:47:10.313029+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":509805120,"num_objects":7775,"num_object_clones":0,"num_object_copies":23325,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12233,"num_write_kb":638612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12220,"ondisk_log_size":12220,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":233548,"kb_used_data":95812,"kb_used_omap":0,"kb_used_meta":137664,"kb_avail":377253812,"statfs":{"total":386547056640,"available":386307903488,"internally_reserved":0,"allocated":98111488,"data_stored":1551548141,"data_compressed":73663296,"data_compressed_allocated":96960512,"data_compressed_original":1551122432,"omap_allocated":0,"internal_metadata":140967936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5767192,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4471,"num_write_kb":145857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002885"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:03.272851+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'604","reported_seq":648,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.651531+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:46:48.651531+0000","last_peered":"2024-09-16T07:46:48.651531+0000","last_clean":"2024-09-16T07:46:48.651531+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:46:48.651531+0000","last_undegraded":"2024-09-16T07:46:48.651531+0000","last_fullsized":"2024-09-16T07:46:48.651531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'775","reported_seq":837,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.322614+0000","last_change":"2024-09-16T07:46:35.964084+0000","last_active":"2024-09-16T07:47:05.322614+0000","last_peered":"2024-09-16T07:47:05.322614+0000","last_clean":"2024-09-16T07:47:05.322614+0000","last_became_active":"2024-09-16T07:46:35.741381+0000","last_became_peered":"2024-09-16T07:46:35.741381+0000","last_unstale":"2024-09-16T07:47:05.322614+0000","last_undegraded":"2024-09-16T07:47:05.322614+0000","last_fullsized":"2024-09-16T07:47:05.322614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28049432,"num_objects":429,"num_object_clones":0,"num_object_copies":1287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":775,"num_write_kb":38465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:03.505123+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'825","reported_seq":884,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.190721+0000","last_change":"2024-09-16T07:46:35.708878+0000","last_active":"2024-09-16T07:47:05.190721+0000","last_peered":"2024-09-16T07:47:05.190721+0000","last_clean":"2024-09-16T07:47:05.190721+0000","last_became_active":"2024-09-16T07:46:35.703030+0000","last_became_peered":"2024-09-16T07:46:35.703030+0000","last_unstale":"2024-09-16T07:47:05.190721+0000","last_undegraded":"2024-09-16T07:47:05.190721+0000","last_fullsized":"2024-09-16T07:47:05.190721+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:03.561096+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:03.624369+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'791","reported_seq":851,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.269537+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:47:05.269537+0000","last_peered":"2024-09-16T07:47:05.269537+0000","last_clean":"2024-09-16T07:47:05.269537+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:47:05.269537+0000","last_undegraded":"2024-09-16T07:47:05.269537+0000","last_fullsized":"2024-09-16T07:47:05.269537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27852800,"num_objects":425,"num_object_clones":0,"num_object_copies":1275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"32'827","reported_seq":888,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.216849+0000","last_change":"2024-09-16T07:46:35.923460+0000","last_active":"2024-09-16T07:47:05.216849+0000","last_peered":"2024-09-16T07:47:05.216849+0000","last_clean":"2024-09-16T07:47:05.216849+0000","last_became_active":"2024-09-16T07:46:35.730207+0000","last_became_peered":"2024-09-16T07:46:35.730207+0000","last_unstale":"2024-09-16T07:47:05.216849+0000","last_undegraded":"2024-09-16T07:47:05.216849+0000","last_fullsized":"2024-09-16T07:47:05.216849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:46:46.024074+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'820","reported_seq":883,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.326256+0000","last_change":"2024-09-16T07:46:35.882240+0000","last_active":"2024-09-16T07:47:05.326256+0000","last_peered":"2024-09-16T07:47:05.326256+0000","last_clean":"2024-09-16T07:47:05.326256+0000","last_became_active":"2024-09-16T07:46:35.673492+0000","last_became_peered":"2024-09-16T07:46:35.673492+0000","last_unstale":"2024-09-16T07:47:05.326256+0000","last_undegraded":"2024-09-16T07:47:05.326256+0000","last_fullsized":"2024-09-16T07:47:05.326256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28180480,"num_objects":430,"num_object_clones":0,"num_object_copies":1290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":820,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'805","reported_seq":867,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.163767+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:47:05.163767+0000","last_peered":"2024-09-16T07:47:05.163767+0000","last_clean":"2024-09-16T07:47:05.163767+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:47:05.163767+0000","last_undegraded":"2024-09-16T07:47:05.163767+0000","last_fullsized":"2024-09-16T07:47:05.163767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:46:46.023044+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'593","reported_seq":638,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.680405+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:46:48.680405+0000","last_peered":"2024-09-16T07:46:48.680405+0000","last_clean":"2024-09-16T07:46:48.680405+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:46:48.680405+0000","last_undegraded":"2024-09-16T07:46:48.680405+0000","last_fullsized":"2024-09-16T07:46:48.680405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38797312,"num_objects":592,"num_object_clones":0,"num_object_copies":1776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":37888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'908","reported_seq":963,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.261365+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:47:05.261365+0000","last_peered":"2024-09-16T07:47:05.261365+0000","last_clean":"2024-09-16T07:47:05.261365+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:47:05.261365+0000","last_undegraded":"2024-09-16T07:47:05.261365+0000","last_fullsized":"2024-09-16T07:47:05.261365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29491200,"num_objects":450,"num_object_clones":0,"num_object_copies":1350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'647","reported_seq":705,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.629129+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:46:48.629129+0000","last_peered":"2024-09-16T07:46:48.629129+0000","last_clean":"2024-09-16T07:46:48.629129+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:46:48.629129+0000","last_undegraded":"2024-09-16T07:46:48.629129+0000","last_fullsized":"2024-09-16T07:46:48.629129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'857","reported_seq":913,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:05.151219+0000","last_change":"2024-09-16T07:46:35.714657+0000","last_active":"2024-09-16T07:47:05.151219+0000","last_peered":"2024-09-16T07:47:05.151219+0000","last_clean":"2024-09-16T07:47:05.151219+0000","last_became_active":"2024-09-16T07:46:35.703204+0000","last_became_peered":"2024-09-16T07:46:35.703204+0000","last_unstale":"2024-09-16T07:47:05.151219+0000","last_undegraded":"2024-09-16T07:47:05.151219+0000","last_fullsized":"2024-09-16T07:47:05.151219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'623","reported_seq":667,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:48.609305+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:46:48.609305+0000","last_peered":"2024-09-16T07:46:48.609305+0000","last_clean":"2024-09-16T07:46:48.609305+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:46:48.609305+0000","last_undegraded":"2024-09-16T07:46:48.609305+0000","last_fullsized":"2024-09-16T07:46:48.609305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40763392,"num_objects":622,"num_object_clones":0,"num_object_copies":1866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":39808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":509214744,"num_objects":7771,"num_object_clones":0,"num_object_copies":23313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12153,"num_write_kb":637505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95268864,"data_stored":1524105288,"data_compressed":72371941,"data_compressed_allocated":95256576,"data_compressed_original":1524105216,"omap_allocated":0,"internal_metadata":0},"log_size":12165,"ondisk_log_size":12165,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64828,"kb_used_data":25516,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94307012,"statfs":{"total":96636764160,"available":96570380288,"internally_reserved":0,"allocated":26128384,"data_stored":413429819,"data_compressed":19629417,"data_compressed_allocated":25837568,"data_compressed_original":413319168,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66804,"kb_used_data":27236,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94305036,"statfs":{"total":96636764160,"available":96568356864,"internally_reserved":0,"allocated":27889664,"data_stored":441610294,"data_compressed":20966846,"data_compressed_allocated":27598848,"data_compressed_original":441499648,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52808,"kb_used_data":21808,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94319032,"statfs":{"total":96636764160,"available":96582688768,"internally_reserved":0,"allocated":22331392,"data_stored":353005102,"data_compressed":16758120,"data_compressed_allocated":22056960,"data_compressed_original":352911360,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21532672,"data_stored":344457240,"data_compressed":16356672,"data_compressed_allocated":21528576,"data_compressed_original":344457216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27672576,"data_stored":442761216,"data_compressed":21023941,"data_compressed_allocated":27672576,"data_compressed_original":442761216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25210880,"data_stored":403308568,"data_compressed":19151248,"data_compressed_allocated":25206784,"data_compressed_original":403308544,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:11.412 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:11.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:11.565+0000 7f8b4ef11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:11.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:11.573+0000 7f8b4ef11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:14.067 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:14.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:14.234+0000 7f92640fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:14.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:14.245+0000 7f92640fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:15.912 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [1, 3, 2, 0] 2024-09-16T07:47:15.913 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:47:15.913 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [1, 3, 2, 0] 2024-09-16T07:47:15.913 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T07:47:15.914 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:47:16.649 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:16.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:16.768+0000 7f838b8c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:16.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:16.774+0000 7f838b8c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:20.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-16T07:47:22.013 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T07:47:27.015 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [1, 3, 2] 2024-09-16T07:47:27.015 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-16T07:47:27.015 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:47:27.015 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T07:47:27.019 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:47:27.019 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:47:27.135 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:47:27.138 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:27.139 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:47:27.186 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-16T07:47:32.140 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:47:32.246 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:47:32.249 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:32.250 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:47:35.374 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:47:35.567 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:47:35.568 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:47:37.251 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:47:37.368 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T07:47:37.368 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [] 2024-09-16T07:47:37.368 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T07:47:37.378 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:47:37.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:37.516+0000 7f3162711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:37.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:37.534+0000 7f3162711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:37.568 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:37.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:37.732+0000 7f31c5708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:37.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:37.741+0000 7f31c5708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:38.388 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:47:38.413 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:47:38.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:38.567+0000 7f782cefd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:38.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:38.587+0000 7f782cefd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:39.393 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:47:39.413 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:47:39.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:39.559+0000 7f9515f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:39.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:39.576+0000 7f9515f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:40.056 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:40.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:40.204+0000 7f3c8d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:40.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:40.214+0000 7f3c8d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:40.403 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:47:40.425 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:47:40.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:40.594+0000 7f5513591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:40.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:40.608+0000 7f5513591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:41.408 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:47:41.434 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:47:41.434 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:41.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:41.609+0000 7f1a13991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:41.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:41.624+0000 7f1a13991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:41.894 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:41.911 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-09-16T07:47:41.412602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":360776256,"num_objects":5501,"num_object_clones":0,"num_object_copies":16503,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":14591,"num_write_kb":641300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14578,"ondisk_log_size":14578,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":201132,"kb_used_data":67564,"kb_used_omap":0,"kb_used_meta":133504,"kb_avail":377286228,"statfs":{"total":386547056640,"available":386341097472,"internally_reserved":0,"allocated":69185536,"data_stored":1088732909,"data_compressed":51687083,"data_compressed_allocated":68034560,"data_compressed_original":1088307200,"omap_allocated":0,"internal_metadata":136708096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.028413"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:35.372240+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'927","reported_seq":971,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.795547+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:47:15.795547+0000","last_peered":"2024-09-16T07:47:15.795547+0000","last_clean":"2024-09-16T07:47:15.795547+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:47:15.795547+0000","last_undegraded":"2024-09-16T07:47:15.795547+0000","last_fullsized":"2024-09-16T07:47:15.795547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":926,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'908","reported_seq":970,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.758342+0000","last_change":"2024-09-16T07:46:35.964084+0000","last_active":"2024-09-16T07:47:15.758342+0000","last_peered":"2024-09-16T07:47:15.758342+0000","last_clean":"2024-09-16T07:47:15.758342+0000","last_became_active":"2024-09-16T07:46:35.741381+0000","last_became_peered":"2024-09-16T07:46:35.741381+0000","last_unstale":"2024-09-16T07:47:15.758342+0000","last_undegraded":"2024-09-16T07:47:15.758342+0000","last_fullsized":"2024-09-16T07:47:15.758342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333144,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":908,"num_write_kb":38465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:35.372244+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'945","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.914484+0000","last_change":"2024-09-16T07:46:35.708878+0000","last_active":"2024-09-16T07:47:15.914484+0000","last_peered":"2024-09-16T07:47:15.914484+0000","last_clean":"2024-09-16T07:47:15.914484+0000","last_became_active":"2024-09-16T07:46:35.703030+0000","last_became_peered":"2024-09-16T07:46:35.703030+0000","last_unstale":"2024-09-16T07:47:15.914484+0000","last_undegraded":"2024-09-16T07:47:15.914484+0000","last_fullsized":"2024-09-16T07:47:15.914484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:35.372246+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:35.372249+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'917","reported_seq":977,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.964561+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:47:15.964561+0000","last_peered":"2024-09-16T07:47:15.964561+0000","last_clean":"2024-09-16T07:47:15.964561+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:47:15.964561+0000","last_undegraded":"2024-09-16T07:47:15.964561+0000","last_fullsized":"2024-09-16T07:47:15.964561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"32'962","reported_seq":1023,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.571034+0000","last_change":"2024-09-16T07:46:35.923460+0000","last_active":"2024-09-16T07:47:15.571034+0000","last_peered":"2024-09-16T07:47:15.571034+0000","last_clean":"2024-09-16T07:47:15.571034+0000","last_became_active":"2024-09-16T07:46:35.730207+0000","last_became_peered":"2024-09-16T07:46:35.730207+0000","last_unstale":"2024-09-16T07:47:15.571034+0000","last_undegraded":"2024-09-16T07:47:15.571034+0000","last_fullsized":"2024-09-16T07:47:15.571034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":962,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:47:35.372252+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'941","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.018804+0000","last_change":"2024-09-16T07:46:35.882240+0000","last_active":"2024-09-16T07:47:16.018804+0000","last_peered":"2024-09-16T07:47:16.018804+0000","last_clean":"2024-09-16T07:47:16.018804+0000","last_became_active":"2024-09-16T07:46:35.673492+0000","last_became_peered":"2024-09-16T07:46:35.673492+0000","last_unstale":"2024-09-16T07:47:16.018804+0000","last_undegraded":"2024-09-16T07:47:16.018804+0000","last_fullsized":"2024-09-16T07:47:16.018804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'929","reported_seq":991,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.992871+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:47:15.992871+0000","last_peered":"2024-09-16T07:47:15.992871+0000","last_clean":"2024-09-16T07:47:15.992871+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:47:15.992871+0000","last_undegraded":"2024-09-16T07:47:15.992871+0000","last_fullsized":"2024-09-16T07:47:15.992871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":929,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:47:35.372255+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'918","reported_seq":963,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.819593+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:47:15.819593+0000","last_peered":"2024-09-16T07:47:15.819593+0000","last_clean":"2024-09-16T07:47:15.819593+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:47:15.819593+0000","last_undegraded":"2024-09-16T07:47:15.819593+0000","last_fullsized":"2024-09-16T07:47:15.819593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'1037","reported_seq":1092,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.955552+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:47:15.955552+0000","last_peered":"2024-09-16T07:47:15.955552+0000","last_clean":"2024-09-16T07:47:15.955552+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:47:15.955552+0000","last_undegraded":"2024-09-16T07:47:15.955552+0000","last_fullsized":"2024-09-16T07:47:15.955552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'983","reported_seq":1041,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.999510+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:47:15.999510+0000","last_peered":"2024-09-16T07:47:15.999510+0000","last_clean":"2024-09-16T07:47:15.999510+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:47:15.999510+0000","last_undegraded":"2024-09-16T07:47:15.999510+0000","last_fullsized":"2024-09-16T07:47:15.999510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21889024,"num_objects":334,"num_object_clones":0,"num_object_copies":1002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":42112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'1013","reported_seq":1069,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.900378+0000","last_change":"2024-09-16T07:46:35.714657+0000","last_active":"2024-09-16T07:47:15.900378+0000","last_peered":"2024-09-16T07:47:15.900378+0000","last_clean":"2024-09-16T07:47:15.900378+0000","last_became_active":"2024-09-16T07:46:35.703204+0000","last_became_peered":"2024-09-16T07:46:35.703204+0000","last_unstale":"2024-09-16T07:47:15.900378+0000","last_undegraded":"2024-09-16T07:47:15.900378+0000","last_fullsized":"2024-09-16T07:47:15.900378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'953","reported_seq":997,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.020244+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:47:16.020244+0000","last_peered":"2024-09-16T07:47:16.020244+0000","last_clean":"2024-09-16T07:47:16.020244+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:47:16.020244+0000","last_undegraded":"2024-09-16T07:47:16.020244+0000","last_fullsized":"2024-09-16T07:47:16.020244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":953,"log_dups_size":0,"ondisk_log_size":953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":952,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":360185880,"num_objects":5497,"num_object_clones":0,"num_object_copies":16491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14511,"num_write_kb":640193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":67346432,"data_stored":1077346376,"data_compressed":51158168,"data_compressed_allocated":67334144,"data_compressed_original":1077346304,"omap_allocated":0,"internal_metadata":0},"log_size":14523,"ondisk_log_size":14523,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48544,"kb_used_data":17552,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94323296,"statfs":{"total":96636764160,"available":96587055104,"internally_reserved":0,"allocated":17973248,"data_stored":282947643,"data_compressed":13433425,"data_compressed_allocated":17682432,"data_compressed_original":282836992,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49208,"kb_used_data":13800,"kb_used_omap":0,"kb_used_meta":35392,"kb_avail":94322632,"statfs":{"total":96636764160,"available":96586375168,"internally_reserved":0,"allocated":14131200,"data_stored":221474870,"data_compressed":10514369,"data_compressed_allocated":13840384,"data_compressed_original":221364224,"omap_allocated":0,"internal_metadata":36241408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54272,"kb_used_data":14960,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":15319040,"data_stored":240807470,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":240713752,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13799424,"data_stored":220790784,"data_compressed":10484328,"data_compressed_allocated":13799424,"data_compressed_original":220790784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17645568,"data_stored":282263576,"data_compressed":13403384,"data_compressed_allocated":17641472,"data_compressed_original":282263552,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:41.913 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:42.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:42.075+0000 7f894f551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:42.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:42.086+0000 7f894f551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:42.375 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:42.375 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:42.393 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-16T07:47:42.320202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":360776256,"num_objects":5501,"num_object_clones":0,"num_object_copies":16503,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":14591,"num_write_kb":641300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14578,"ondisk_log_size":14578,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":201132,"kb_used_data":67564,"kb_used_omap":0,"kb_used_meta":133504,"kb_avail":377286228,"statfs":{"total":386547056640,"available":386341097472,"internally_reserved":0,"allocated":69185536,"data_stored":1088732909,"data_compressed":51687083,"data_compressed_allocated":68034560,"data_compressed_original":1088307200,"omap_allocated":0,"internal_metadata":136708096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000773"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:35.372240+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'927","reported_seq":971,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.795547+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:47:15.795547+0000","last_peered":"2024-09-16T07:47:15.795547+0000","last_clean":"2024-09-16T07:47:15.795547+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:47:15.795547+0000","last_undegraded":"2024-09-16T07:47:15.795547+0000","last_fullsized":"2024-09-16T07:47:15.795547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":926,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'908","reported_seq":970,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.758342+0000","last_change":"2024-09-16T07:46:35.964084+0000","last_active":"2024-09-16T07:47:15.758342+0000","last_peered":"2024-09-16T07:47:15.758342+0000","last_clean":"2024-09-16T07:47:15.758342+0000","last_became_active":"2024-09-16T07:46:35.741381+0000","last_became_peered":"2024-09-16T07:46:35.741381+0000","last_unstale":"2024-09-16T07:47:15.758342+0000","last_undegraded":"2024-09-16T07:47:15.758342+0000","last_fullsized":"2024-09-16T07:47:15.758342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333144,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":908,"num_write_kb":38465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:35.372244+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'945","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.914484+0000","last_change":"2024-09-16T07:46:35.708878+0000","last_active":"2024-09-16T07:47:15.914484+0000","last_peered":"2024-09-16T07:47:15.914484+0000","last_clean":"2024-09-16T07:47:15.914484+0000","last_became_active":"2024-09-16T07:46:35.703030+0000","last_became_peered":"2024-09-16T07:46:35.703030+0000","last_unstale":"2024-09-16T07:47:15.914484+0000","last_undegraded":"2024-09-16T07:47:15.914484+0000","last_fullsized":"2024-09-16T07:47:15.914484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:35.372246+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:35.372249+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'917","reported_seq":977,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.964561+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:47:15.964561+0000","last_peered":"2024-09-16T07:47:15.964561+0000","last_clean":"2024-09-16T07:47:15.964561+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:47:15.964561+0000","last_undegraded":"2024-09-16T07:47:15.964561+0000","last_fullsized":"2024-09-16T07:47:15.964561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"32'962","reported_seq":1023,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.571034+0000","last_change":"2024-09-16T07:46:35.923460+0000","last_active":"2024-09-16T07:47:15.571034+0000","last_peered":"2024-09-16T07:47:15.571034+0000","last_clean":"2024-09-16T07:47:15.571034+0000","last_became_active":"2024-09-16T07:46:35.730207+0000","last_became_peered":"2024-09-16T07:46:35.730207+0000","last_unstale":"2024-09-16T07:47:15.571034+0000","last_undegraded":"2024-09-16T07:47:15.571034+0000","last_fullsized":"2024-09-16T07:47:15.571034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":962,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:47:35.372252+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'941","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.018804+0000","last_change":"2024-09-16T07:46:35.882240+0000","last_active":"2024-09-16T07:47:16.018804+0000","last_peered":"2024-09-16T07:47:16.018804+0000","last_clean":"2024-09-16T07:47:16.018804+0000","last_became_active":"2024-09-16T07:46:35.673492+0000","last_became_peered":"2024-09-16T07:46:35.673492+0000","last_unstale":"2024-09-16T07:47:16.018804+0000","last_undegraded":"2024-09-16T07:47:16.018804+0000","last_fullsized":"2024-09-16T07:47:16.018804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'929","reported_seq":991,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.992871+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:47:15.992871+0000","last_peered":"2024-09-16T07:47:15.992871+0000","last_clean":"2024-09-16T07:47:15.992871+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:47:15.992871+0000","last_undegraded":"2024-09-16T07:47:15.992871+0000","last_fullsized":"2024-09-16T07:47:15.992871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":929,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:47:35.372255+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'918","reported_seq":963,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.819593+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:47:15.819593+0000","last_peered":"2024-09-16T07:47:15.819593+0000","last_clean":"2024-09-16T07:47:15.819593+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:47:15.819593+0000","last_undegraded":"2024-09-16T07:47:15.819593+0000","last_fullsized":"2024-09-16T07:47:15.819593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'1037","reported_seq":1092,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.955552+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:47:15.955552+0000","last_peered":"2024-09-16T07:47:15.955552+0000","last_clean":"2024-09-16T07:47:15.955552+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:47:15.955552+0000","last_undegraded":"2024-09-16T07:47:15.955552+0000","last_fullsized":"2024-09-16T07:47:15.955552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'983","reported_seq":1041,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.999510+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:47:15.999510+0000","last_peered":"2024-09-16T07:47:15.999510+0000","last_clean":"2024-09-16T07:47:15.999510+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:47:15.999510+0000","last_undegraded":"2024-09-16T07:47:15.999510+0000","last_fullsized":"2024-09-16T07:47:15.999510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21889024,"num_objects":334,"num_object_clones":0,"num_object_copies":1002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":42112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'1013","reported_seq":1069,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.900378+0000","last_change":"2024-09-16T07:46:35.714657+0000","last_active":"2024-09-16T07:47:15.900378+0000","last_peered":"2024-09-16T07:47:15.900378+0000","last_clean":"2024-09-16T07:47:15.900378+0000","last_became_active":"2024-09-16T07:46:35.703204+0000","last_became_peered":"2024-09-16T07:46:35.703204+0000","last_unstale":"2024-09-16T07:47:15.900378+0000","last_undegraded":"2024-09-16T07:47:15.900378+0000","last_fullsized":"2024-09-16T07:47:15.900378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'953","reported_seq":997,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.020244+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:47:16.020244+0000","last_peered":"2024-09-16T07:47:16.020244+0000","last_clean":"2024-09-16T07:47:16.020244+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:47:16.020244+0000","last_undegraded":"2024-09-16T07:47:16.020244+0000","last_fullsized":"2024-09-16T07:47:16.020244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":953,"log_dups_size":0,"ondisk_log_size":953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":952,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":360185880,"num_objects":5497,"num_object_clones":0,"num_object_copies":16491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14511,"num_write_kb":640193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":67346432,"data_stored":1077346376,"data_compressed":51158168,"data_compressed_allocated":67334144,"data_compressed_original":1077346304,"omap_allocated":0,"internal_metadata":0},"log_size":14523,"ondisk_log_size":14523,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48544,"kb_used_data":17552,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94323296,"statfs":{"total":96636764160,"available":96587055104,"internally_reserved":0,"allocated":17973248,"data_stored":282947643,"data_compressed":13433425,"data_compressed_allocated":17682432,"data_compressed_original":282836992,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49208,"kb_used_data":13800,"kb_used_omap":0,"kb_used_meta":35392,"kb_avail":94322632,"statfs":{"total":96636764160,"available":96586375168,"internally_reserved":0,"allocated":14131200,"data_stored":221474870,"data_compressed":10514369,"data_compressed_allocated":13840384,"data_compressed_original":221364224,"omap_allocated":0,"internal_metadata":36241408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54272,"kb_used_data":14960,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":15319040,"data_stored":240807470,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":240713752,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13799424,"data_stored":220790784,"data_compressed":10484328,"data_compressed_allocated":13799424,"data_compressed_original":220790784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17645568,"data_stored":282263576,"data_compressed":13403384,"data_compressed_allocated":17641472,"data_compressed_original":282263552,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:42.395 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:47:42.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:42.539+0000 7f5299ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:42.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:42.549+0000 7f5299ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:42.563 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:42.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:42.747+0000 7f58cc688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:42.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:42.761+0000 7f58cc688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:43.037 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":165,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":39,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472856,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":19},{"state_name":"stale+active+clean","count":6}],"num_pgs":25,"num_pools":3,"num_objects":5501,"data_bytes":360776256,"bytes_used":205959168,"bytes_avail":386341097472,"bytes_total":386547056640},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:47:43.061 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:47:43.061 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:43.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:43.221+0000 7ff550e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:43.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:43.234+0000 7ff550e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:43.571 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:43.571 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:43.598 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-16T07:47:42.320202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":360776256,"num_objects":5501,"num_object_clones":0,"num_object_copies":16503,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":14591,"num_write_kb":641300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14578,"ondisk_log_size":14578,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":201132,"kb_used_data":67564,"kb_used_omap":0,"kb_used_meta":133504,"kb_avail":377286228,"statfs":{"total":386547056640,"available":386341097472,"internally_reserved":0,"allocated":69185536,"data_stored":1088732909,"data_compressed":51687083,"data_compressed_allocated":68034560,"data_compressed_original":1088307200,"omap_allocated":0,"internal_metadata":136708096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000773"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:35.372240+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'927","reported_seq":971,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.795547+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:47:15.795547+0000","last_peered":"2024-09-16T07:47:15.795547+0000","last_clean":"2024-09-16T07:47:15.795547+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:47:15.795547+0000","last_undegraded":"2024-09-16T07:47:15.795547+0000","last_fullsized":"2024-09-16T07:47:15.795547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":926,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'908","reported_seq":970,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.758342+0000","last_change":"2024-09-16T07:46:35.964084+0000","last_active":"2024-09-16T07:47:15.758342+0000","last_peered":"2024-09-16T07:47:15.758342+0000","last_clean":"2024-09-16T07:47:15.758342+0000","last_became_active":"2024-09-16T07:46:35.741381+0000","last_became_peered":"2024-09-16T07:46:35.741381+0000","last_unstale":"2024-09-16T07:47:15.758342+0000","last_undegraded":"2024-09-16T07:47:15.758342+0000","last_fullsized":"2024-09-16T07:47:15.758342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333144,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":908,"num_write_kb":38465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:35.372244+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'945","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.914484+0000","last_change":"2024-09-16T07:46:35.708878+0000","last_active":"2024-09-16T07:47:15.914484+0000","last_peered":"2024-09-16T07:47:15.914484+0000","last_clean":"2024-09-16T07:47:15.914484+0000","last_became_active":"2024-09-16T07:46:35.703030+0000","last_became_peered":"2024-09-16T07:46:35.703030+0000","last_unstale":"2024-09-16T07:47:15.914484+0000","last_undegraded":"2024-09-16T07:47:15.914484+0000","last_fullsized":"2024-09-16T07:47:15.914484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:35.372246+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:35.372249+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'917","reported_seq":977,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.964561+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:47:15.964561+0000","last_peered":"2024-09-16T07:47:15.964561+0000","last_clean":"2024-09-16T07:47:15.964561+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:47:15.964561+0000","last_undegraded":"2024-09-16T07:47:15.964561+0000","last_fullsized":"2024-09-16T07:47:15.964561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"32'962","reported_seq":1023,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.571034+0000","last_change":"2024-09-16T07:46:35.923460+0000","last_active":"2024-09-16T07:47:15.571034+0000","last_peered":"2024-09-16T07:47:15.571034+0000","last_clean":"2024-09-16T07:47:15.571034+0000","last_became_active":"2024-09-16T07:46:35.730207+0000","last_became_peered":"2024-09-16T07:46:35.730207+0000","last_unstale":"2024-09-16T07:47:15.571034+0000","last_undegraded":"2024-09-16T07:47:15.571034+0000","last_fullsized":"2024-09-16T07:47:15.571034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":962,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:47:35.372252+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'941","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.018804+0000","last_change":"2024-09-16T07:46:35.882240+0000","last_active":"2024-09-16T07:47:16.018804+0000","last_peered":"2024-09-16T07:47:16.018804+0000","last_clean":"2024-09-16T07:47:16.018804+0000","last_became_active":"2024-09-16T07:46:35.673492+0000","last_became_peered":"2024-09-16T07:46:35.673492+0000","last_unstale":"2024-09-16T07:47:16.018804+0000","last_undegraded":"2024-09-16T07:47:16.018804+0000","last_fullsized":"2024-09-16T07:47:16.018804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'929","reported_seq":991,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.992871+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:47:15.992871+0000","last_peered":"2024-09-16T07:47:15.992871+0000","last_clean":"2024-09-16T07:47:15.992871+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:47:15.992871+0000","last_undegraded":"2024-09-16T07:47:15.992871+0000","last_fullsized":"2024-09-16T07:47:15.992871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":929,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:47:35.372255+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'918","reported_seq":963,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.819593+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:47:15.819593+0000","last_peered":"2024-09-16T07:47:15.819593+0000","last_clean":"2024-09-16T07:47:15.819593+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:47:15.819593+0000","last_undegraded":"2024-09-16T07:47:15.819593+0000","last_fullsized":"2024-09-16T07:47:15.819593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'1037","reported_seq":1092,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.955552+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:47:15.955552+0000","last_peered":"2024-09-16T07:47:15.955552+0000","last_clean":"2024-09-16T07:47:15.955552+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:47:15.955552+0000","last_undegraded":"2024-09-16T07:47:15.955552+0000","last_fullsized":"2024-09-16T07:47:15.955552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'983","reported_seq":1041,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.999510+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:47:15.999510+0000","last_peered":"2024-09-16T07:47:15.999510+0000","last_clean":"2024-09-16T07:47:15.999510+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:47:15.999510+0000","last_undegraded":"2024-09-16T07:47:15.999510+0000","last_fullsized":"2024-09-16T07:47:15.999510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21889024,"num_objects":334,"num_object_clones":0,"num_object_copies":1002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":42112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'1013","reported_seq":1069,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.900378+0000","last_change":"2024-09-16T07:46:35.714657+0000","last_active":"2024-09-16T07:47:15.900378+0000","last_peered":"2024-09-16T07:47:15.900378+0000","last_clean":"2024-09-16T07:47:15.900378+0000","last_became_active":"2024-09-16T07:46:35.703204+0000","last_became_peered":"2024-09-16T07:46:35.703204+0000","last_unstale":"2024-09-16T07:47:15.900378+0000","last_undegraded":"2024-09-16T07:47:15.900378+0000","last_fullsized":"2024-09-16T07:47:15.900378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'953","reported_seq":997,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.020244+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:47:16.020244+0000","last_peered":"2024-09-16T07:47:16.020244+0000","last_clean":"2024-09-16T07:47:16.020244+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:47:16.020244+0000","last_undegraded":"2024-09-16T07:47:16.020244+0000","last_fullsized":"2024-09-16T07:47:16.020244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":953,"log_dups_size":0,"ondisk_log_size":953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":952,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":360185880,"num_objects":5497,"num_object_clones":0,"num_object_copies":16491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14511,"num_write_kb":640193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":67346432,"data_stored":1077346376,"data_compressed":51158168,"data_compressed_allocated":67334144,"data_compressed_original":1077346304,"omap_allocated":0,"internal_metadata":0},"log_size":14523,"ondisk_log_size":14523,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48544,"kb_used_data":17552,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94323296,"statfs":{"total":96636764160,"available":96587055104,"internally_reserved":0,"allocated":17973248,"data_stored":282947643,"data_compressed":13433425,"data_compressed_allocated":17682432,"data_compressed_original":282836992,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49208,"kb_used_data":13800,"kb_used_omap":0,"kb_used_meta":35392,"kb_avail":94322632,"statfs":{"total":96636764160,"available":96586375168,"internally_reserved":0,"allocated":14131200,"data_stored":221474870,"data_compressed":10514369,"data_compressed_allocated":13840384,"data_compressed_original":221364224,"omap_allocated":0,"internal_metadata":36241408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54272,"kb_used_data":14960,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":15319040,"data_stored":240807470,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":240713752,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13799424,"data_stored":220790784,"data_compressed":10484328,"data_compressed_allocated":13799424,"data_compressed_original":220790784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17645568,"data_stored":282263576,"data_compressed":13403384,"data_compressed_allocated":17641472,"data_compressed_original":282263552,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:45.135 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:45.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:45.281+0000 7fdd4af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:45.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:45.290+0000 7fdd4af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:46.602 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:46.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:46.756+0000 7f049247d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:46.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:46.770+0000 7f049247d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:47.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:47.129 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:47.147 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-09-16T07:47:46.320886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":360776256,"num_objects":5501,"num_object_clones":0,"num_object_copies":16503,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":14591,"num_write_kb":641300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14578,"ondisk_log_size":14578,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":201132,"kb_used_data":67564,"kb_used_omap":0,"kb_used_meta":133504,"kb_avail":377286228,"statfs":{"total":386547056640,"available":386341097472,"internally_reserved":0,"allocated":69185536,"data_stored":1088732909,"data_compressed":51687083,"data_compressed_allocated":68034560,"data_compressed_original":1088307200,"omap_allocated":0,"internal_metadata":136708096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.922812"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:35.372240+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'927","reported_seq":971,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.795547+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:47:15.795547+0000","last_peered":"2024-09-16T07:47:15.795547+0000","last_clean":"2024-09-16T07:47:15.795547+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:47:15.795547+0000","last_undegraded":"2024-09-16T07:47:15.795547+0000","last_fullsized":"2024-09-16T07:47:15.795547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":926,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'908","reported_seq":970,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.758342+0000","last_change":"2024-09-16T07:46:35.964084+0000","last_active":"2024-09-16T07:47:15.758342+0000","last_peered":"2024-09-16T07:47:15.758342+0000","last_clean":"2024-09-16T07:47:15.758342+0000","last_became_active":"2024-09-16T07:46:35.741381+0000","last_became_peered":"2024-09-16T07:46:35.741381+0000","last_unstale":"2024-09-16T07:47:15.758342+0000","last_undegraded":"2024-09-16T07:47:15.758342+0000","last_fullsized":"2024-09-16T07:47:15.758342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333144,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":908,"num_write_kb":38465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:35.372244+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'945","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.914484+0000","last_change":"2024-09-16T07:46:35.708878+0000","last_active":"2024-09-16T07:47:15.914484+0000","last_peered":"2024-09-16T07:47:15.914484+0000","last_clean":"2024-09-16T07:47:15.914484+0000","last_became_active":"2024-09-16T07:46:35.703030+0000","last_became_peered":"2024-09-16T07:46:35.703030+0000","last_unstale":"2024-09-16T07:47:15.914484+0000","last_undegraded":"2024-09-16T07:47:15.914484+0000","last_fullsized":"2024-09-16T07:47:15.914484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:35.372246+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:35.372249+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'917","reported_seq":977,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.964561+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:47:15.964561+0000","last_peered":"2024-09-16T07:47:15.964561+0000","last_clean":"2024-09-16T07:47:15.964561+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:47:15.964561+0000","last_undegraded":"2024-09-16T07:47:15.964561+0000","last_fullsized":"2024-09-16T07:47:15.964561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"32'962","reported_seq":1023,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.571034+0000","last_change":"2024-09-16T07:46:35.923460+0000","last_active":"2024-09-16T07:47:15.571034+0000","last_peered":"2024-09-16T07:47:15.571034+0000","last_clean":"2024-09-16T07:47:15.571034+0000","last_became_active":"2024-09-16T07:46:35.730207+0000","last_became_peered":"2024-09-16T07:46:35.730207+0000","last_unstale":"2024-09-16T07:47:15.571034+0000","last_undegraded":"2024-09-16T07:47:15.571034+0000","last_fullsized":"2024-09-16T07:47:15.571034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":962,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:47:35.372252+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'941","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.018804+0000","last_change":"2024-09-16T07:46:35.882240+0000","last_active":"2024-09-16T07:47:16.018804+0000","last_peered":"2024-09-16T07:47:16.018804+0000","last_clean":"2024-09-16T07:47:16.018804+0000","last_became_active":"2024-09-16T07:46:35.673492+0000","last_became_peered":"2024-09-16T07:46:35.673492+0000","last_unstale":"2024-09-16T07:47:16.018804+0000","last_undegraded":"2024-09-16T07:47:16.018804+0000","last_fullsized":"2024-09-16T07:47:16.018804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'929","reported_seq":991,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.992871+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:47:15.992871+0000","last_peered":"2024-09-16T07:47:15.992871+0000","last_clean":"2024-09-16T07:47:15.992871+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:47:15.992871+0000","last_undegraded":"2024-09-16T07:47:15.992871+0000","last_fullsized":"2024-09-16T07:47:15.992871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":929,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:47:35.372255+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'918","reported_seq":963,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.819593+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:47:15.819593+0000","last_peered":"2024-09-16T07:47:15.819593+0000","last_clean":"2024-09-16T07:47:15.819593+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:47:15.819593+0000","last_undegraded":"2024-09-16T07:47:15.819593+0000","last_fullsized":"2024-09-16T07:47:15.819593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'1037","reported_seq":1092,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.955552+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:47:15.955552+0000","last_peered":"2024-09-16T07:47:15.955552+0000","last_clean":"2024-09-16T07:47:15.955552+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:47:15.955552+0000","last_undegraded":"2024-09-16T07:47:15.955552+0000","last_fullsized":"2024-09-16T07:47:15.955552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'983","reported_seq":1041,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.999510+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:47:15.999510+0000","last_peered":"2024-09-16T07:47:15.999510+0000","last_clean":"2024-09-16T07:47:15.999510+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:47:15.999510+0000","last_undegraded":"2024-09-16T07:47:15.999510+0000","last_fullsized":"2024-09-16T07:47:15.999510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21889024,"num_objects":334,"num_object_clones":0,"num_object_copies":1002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":42112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'1013","reported_seq":1069,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.900378+0000","last_change":"2024-09-16T07:46:35.714657+0000","last_active":"2024-09-16T07:47:15.900378+0000","last_peered":"2024-09-16T07:47:15.900378+0000","last_clean":"2024-09-16T07:47:15.900378+0000","last_became_active":"2024-09-16T07:46:35.703204+0000","last_became_peered":"2024-09-16T07:46:35.703204+0000","last_unstale":"2024-09-16T07:47:15.900378+0000","last_undegraded":"2024-09-16T07:47:15.900378+0000","last_fullsized":"2024-09-16T07:47:15.900378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'953","reported_seq":997,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.020244+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:47:16.020244+0000","last_peered":"2024-09-16T07:47:16.020244+0000","last_clean":"2024-09-16T07:47:16.020244+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:47:16.020244+0000","last_undegraded":"2024-09-16T07:47:16.020244+0000","last_fullsized":"2024-09-16T07:47:16.020244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":953,"log_dups_size":0,"ondisk_log_size":953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":952,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":360185880,"num_objects":5497,"num_object_clones":0,"num_object_copies":16491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14511,"num_write_kb":640193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":67346432,"data_stored":1077346376,"data_compressed":51158168,"data_compressed_allocated":67334144,"data_compressed_original":1077346304,"omap_allocated":0,"internal_metadata":0},"log_size":14523,"ondisk_log_size":14523,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48544,"kb_used_data":17552,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94323296,"statfs":{"total":96636764160,"available":96587055104,"internally_reserved":0,"allocated":17973248,"data_stored":282947643,"data_compressed":13433425,"data_compressed_allocated":17682432,"data_compressed_original":282836992,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49208,"kb_used_data":13800,"kb_used_omap":0,"kb_used_meta":35392,"kb_avail":94322632,"statfs":{"total":96636764160,"available":96586375168,"internally_reserved":0,"allocated":14131200,"data_stored":221474870,"data_compressed":10514369,"data_compressed_allocated":13840384,"data_compressed_original":221364224,"omap_allocated":0,"internal_metadata":36241408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54272,"kb_used_data":14960,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":15319040,"data_stored":240807470,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":240713752,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13799424,"data_stored":220790784,"data_compressed":10484328,"data_compressed_allocated":13799424,"data_compressed_original":220790784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17645568,"data_stored":282263576,"data_compressed":13403384,"data_compressed_allocated":17641472,"data_compressed_original":282263552,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:47.148 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:47:47.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:47.282+0000 7fc0932bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:47.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:47.291+0000 7fc0932bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:47.702 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:47.743 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:47.744 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":169,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":39,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472856,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":19},{"state_name":"stale+active+clean","count":6}],"num_pgs":25,"num_pools":3,"num_objects":5501,"data_bytes":360776256,"bytes_used":205959168,"bytes_avail":386341097472,"bytes_total":386547056640},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:47:47.763 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:47:47.763 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:47.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:47.865+0000 7f6736a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:47.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:47.882+0000 7f6736a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:47.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:47.984+0000 7f24b3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:47.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:47.998+0000 7f24b3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:48.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:48.353 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:48.370 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-09-16T07:47:48.321217+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":360776256,"num_objects":5501,"num_object_clones":0,"num_object_copies":16503,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":14591,"num_write_kb":641300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14578,"ondisk_log_size":14578,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":201132,"kb_used_data":67564,"kb_used_omap":0,"kb_used_meta":133504,"kb_avail":377286228,"statfs":{"total":386547056640,"available":386341097472,"internally_reserved":0,"allocated":69185536,"data_stored":1088732909,"data_compressed":51687083,"data_compressed_allocated":68034560,"data_compressed_original":1088307200,"omap_allocated":0,"internal_metadata":136708096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001438"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:35.372240+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"32'927","reported_seq":971,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.795547+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:47:15.795547+0000","last_peered":"2024-09-16T07:47:15.795547+0000","last_clean":"2024-09-16T07:47:15.795547+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:47:15.795547+0000","last_undegraded":"2024-09-16T07:47:15.795547+0000","last_fullsized":"2024-09-16T07:47:15.795547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":926,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'908","reported_seq":970,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.758342+0000","last_change":"2024-09-16T07:46:35.964084+0000","last_active":"2024-09-16T07:47:15.758342+0000","last_peered":"2024-09-16T07:47:15.758342+0000","last_clean":"2024-09-16T07:47:15.758342+0000","last_became_active":"2024-09-16T07:46:35.741381+0000","last_became_peered":"2024-09-16T07:46:35.741381+0000","last_unstale":"2024-09-16T07:47:15.758342+0000","last_undegraded":"2024-09-16T07:47:15.758342+0000","last_fullsized":"2024-09-16T07:47:15.758342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333144,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":908,"num_write_kb":38465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:35.372244+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'945","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.914484+0000","last_change":"2024-09-16T07:46:35.708878+0000","last_active":"2024-09-16T07:47:15.914484+0000","last_peered":"2024-09-16T07:47:15.914484+0000","last_clean":"2024-09-16T07:47:15.914484+0000","last_became_active":"2024-09-16T07:46:35.703030+0000","last_became_peered":"2024-09-16T07:46:35.703030+0000","last_unstale":"2024-09-16T07:47:15.914484+0000","last_undegraded":"2024-09-16T07:47:15.914484+0000","last_fullsized":"2024-09-16T07:47:15.914484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:35.372246+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:35.372249+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'917","reported_seq":977,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.964561+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:47:15.964561+0000","last_peered":"2024-09-16T07:47:15.964561+0000","last_clean":"2024-09-16T07:47:15.964561+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:47:15.964561+0000","last_undegraded":"2024-09-16T07:47:15.964561+0000","last_fullsized":"2024-09-16T07:47:15.964561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"32'962","reported_seq":1023,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.571034+0000","last_change":"2024-09-16T07:46:35.923460+0000","last_active":"2024-09-16T07:47:15.571034+0000","last_peered":"2024-09-16T07:47:15.571034+0000","last_clean":"2024-09-16T07:47:15.571034+0000","last_became_active":"2024-09-16T07:46:35.730207+0000","last_became_peered":"2024-09-16T07:46:35.730207+0000","last_unstale":"2024-09-16T07:47:15.571034+0000","last_undegraded":"2024-09-16T07:47:15.571034+0000","last_fullsized":"2024-09-16T07:47:15.571034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":962,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:47:35.372252+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'941","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.018804+0000","last_change":"2024-09-16T07:46:35.882240+0000","last_active":"2024-09-16T07:47:16.018804+0000","last_peered":"2024-09-16T07:47:16.018804+0000","last_clean":"2024-09-16T07:47:16.018804+0000","last_became_active":"2024-09-16T07:46:35.673492+0000","last_became_peered":"2024-09-16T07:46:35.673492+0000","last_unstale":"2024-09-16T07:47:16.018804+0000","last_undegraded":"2024-09-16T07:47:16.018804+0000","last_fullsized":"2024-09-16T07:47:16.018804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'929","reported_seq":991,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.992871+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:47:15.992871+0000","last_peered":"2024-09-16T07:47:15.992871+0000","last_clean":"2024-09-16T07:47:15.992871+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:47:15.992871+0000","last_undegraded":"2024-09-16T07:47:15.992871+0000","last_fullsized":"2024-09-16T07:47:15.992871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":929,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:47:35.372255+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"32'918","reported_seq":963,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.819593+0000","last_change":"2024-09-16T07:46:35.712284+0000","last_active":"2024-09-16T07:47:15.819593+0000","last_peered":"2024-09-16T07:47:15.819593+0000","last_clean":"2024-09-16T07:47:15.819593+0000","last_became_active":"2024-09-16T07:46:35.702887+0000","last_became_peered":"2024-09-16T07:46:35.702887+0000","last_unstale":"2024-09-16T07:47:15.819593+0000","last_undegraded":"2024-09-16T07:47:15.819593+0000","last_fullsized":"2024-09-16T07:47:15.819593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'1037","reported_seq":1092,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.955552+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:47:15.955552+0000","last_peered":"2024-09-16T07:47:15.955552+0000","last_clean":"2024-09-16T07:47:15.955552+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:47:15.955552+0000","last_undegraded":"2024-09-16T07:47:15.955552+0000","last_fullsized":"2024-09-16T07:47:15.955552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.026631+0000","last_change":"2024-09-16T07:46:42.608402+0000","last_active":"2024-09-16T07:46:46.026631+0000","last_peered":"2024-09-16T07:46:46.026631+0000","last_clean":"2024-09-16T07:46:46.026631+0000","last_became_active":"2024-09-16T07:46:35.690802+0000","last_became_peered":"2024-09-16T07:46:35.690802+0000","last_unstale":"2024-09-16T07:46:46.026631+0000","last_undegraded":"2024-09-16T07:46:46.026631+0000","last_fullsized":"2024-09-16T07:46:46.026631+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"32'983","reported_seq":1041,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.999510+0000","last_change":"2024-09-16T07:46:36.007194+0000","last_active":"2024-09-16T07:47:15.999510+0000","last_peered":"2024-09-16T07:47:15.999510+0000","last_clean":"2024-09-16T07:47:15.999510+0000","last_became_active":"2024-09-16T07:46:35.749189+0000","last_became_peered":"2024-09-16T07:46:35.749189+0000","last_unstale":"2024-09-16T07:47:15.999510+0000","last_undegraded":"2024-09-16T07:47:15.999510+0000","last_fullsized":"2024-09-16T07:47:15.999510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":983,"log_dups_size":0,"ondisk_log_size":983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21889024,"num_objects":334,"num_object_clones":0,"num_object_copies":1002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":42112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'1013","reported_seq":1069,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.900378+0000","last_change":"2024-09-16T07:46:35.714657+0000","last_active":"2024-09-16T07:47:15.900378+0000","last_peered":"2024-09-16T07:47:15.900378+0000","last_clean":"2024-09-16T07:47:15.900378+0000","last_became_active":"2024-09-16T07:46:35.703204+0000","last_became_peered":"2024-09-16T07:46:35.703204+0000","last_unstale":"2024-09-16T07:47:15.900378+0000","last_undegraded":"2024-09-16T07:47:15.900378+0000","last_fullsized":"2024-09-16T07:47:15.900378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.020838+0000","last_change":"2024-09-16T07:46:42.607497+0000","last_active":"2024-09-16T07:46:46.020838+0000","last_peered":"2024-09-16T07:46:46.020838+0000","last_clean":"2024-09-16T07:46:46.020838+0000","last_became_active":"2024-09-16T07:46:35.726290+0000","last_became_peered":"2024-09-16T07:46:35.726290+0000","last_unstale":"2024-09-16T07:46:46.020838+0000","last_undegraded":"2024-09-16T07:46:46.020838+0000","last_fullsized":"2024-09-16T07:46:46.020838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"32'953","reported_seq":997,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.020244+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:47:16.020244+0000","last_peered":"2024-09-16T07:47:16.020244+0000","last_clean":"2024-09-16T07:47:16.020244+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:47:16.020244+0000","last_undegraded":"2024-09-16T07:47:16.020244+0000","last_fullsized":"2024-09-16T07:47:16.020244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":953,"log_dups_size":0,"ondisk_log_size":953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":320,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":952,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":360185880,"num_objects":5497,"num_object_clones":0,"num_object_copies":16491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14511,"num_write_kb":640193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":67346432,"data_stored":1077346376,"data_compressed":51158168,"data_compressed_allocated":67334144,"data_compressed_original":1077346304,"omap_allocated":0,"internal_metadata":0},"log_size":14523,"ondisk_log_size":14523,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48544,"kb_used_data":17552,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94323296,"statfs":{"total":96636764160,"available":96587055104,"internally_reserved":0,"allocated":17973248,"data_stored":282947643,"data_compressed":13433425,"data_compressed_allocated":17682432,"data_compressed_original":282836992,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49208,"kb_used_data":13800,"kb_used_omap":0,"kb_used_meta":35392,"kb_avail":94322632,"statfs":{"total":96636764160,"available":96586375168,"internally_reserved":0,"allocated":14131200,"data_stored":221474870,"data_compressed":10514369,"data_compressed_allocated":13840384,"data_compressed_original":221364224,"omap_allocated":0,"internal_metadata":36241408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54272,"kb_used_data":14960,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":15319040,"data_stored":240807470,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":240713752,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13799424,"data_stored":220790784,"data_compressed":10484328,"data_compressed_allocated":13799424,"data_compressed_original":220790784,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17645568,"data_stored":282263576,"data_compressed":13403384,"data_compressed_allocated":17641472,"data_compressed_original":282263552,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:50.438 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:50.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:50.585+0000 7fa9c1a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:50.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:50.597+0000 7fa9c1a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:51.373 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:51.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:51.572+0000 7f1e2e0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:51.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:51.586+0000 7f1e2e0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:51.940 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:51.960 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-16T07:47:50.321569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":327287360,"num_objects":4990,"num_object_clones":0,"num_object_copies":14970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15102,"num_write_kb":641300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15089,"ondisk_log_size":15089,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":199808,"kb_used_data":62080,"kb_used_omap":0,"kb_used_meta":137664,"kb_avail":377287552,"statfs":{"total":386547056640,"available":386342453248,"internally_reserved":0,"allocated":63569920,"data_stored":997989536,"data_compressed":47376963,"data_compressed_allocated":62361600,"data_compressed_original":997539840,"omap_allocated":0,"internal_metadata":140967936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-33488896,"num_objects":-511,"num_object_clones":0,"num_object_copies":-1533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.915988"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:35.372240+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"39'1048","reported_seq":1113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.755029+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:47:48.755029+0000","last_peered":"2024-09-16T07:47:48.755029+0000","last_clean":"2024-09-16T07:47:48.755029+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:47:48.755029+0000","last_undegraded":"2024-09-16T07:47:48.755029+0000","last_fullsized":"2024-09-16T07:47:48.755029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'908","reported_seq":970,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.758342+0000","last_change":"2024-09-16T07:46:35.964084+0000","last_active":"2024-09-16T07:47:15.758342+0000","last_peered":"2024-09-16T07:47:15.758342+0000","last_clean":"2024-09-16T07:47:15.758342+0000","last_became_active":"2024-09-16T07:46:35.741381+0000","last_became_peered":"2024-09-16T07:46:35.741381+0000","last_unstale":"2024-09-16T07:47:15.758342+0000","last_undegraded":"2024-09-16T07:47:15.758342+0000","last_fullsized":"2024-09-16T07:47:15.758342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333144,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":908,"num_write_kb":38465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:35.372244+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'945","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.914484+0000","last_change":"2024-09-16T07:46:35.708878+0000","last_active":"2024-09-16T07:47:15.914484+0000","last_peered":"2024-09-16T07:47:15.914484+0000","last_clean":"2024-09-16T07:47:15.914484+0000","last_became_active":"2024-09-16T07:46:35.703030+0000","last_became_peered":"2024-09-16T07:46:35.703030+0000","last_unstale":"2024-09-16T07:47:15.914484+0000","last_undegraded":"2024-09-16T07:47:15.914484+0000","last_fullsized":"2024-09-16T07:47:15.914484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:35.372246+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:35.372249+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'917","reported_seq":977,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.964561+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:47:15.964561+0000","last_peered":"2024-09-16T07:47:15.964561+0000","last_clean":"2024-09-16T07:47:15.964561+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:47:15.964561+0000","last_undegraded":"2024-09-16T07:47:15.964561+0000","last_fullsized":"2024-09-16T07:47:15.964561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"32'962","reported_seq":1023,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.571034+0000","last_change":"2024-09-16T07:46:35.923460+0000","last_active":"2024-09-16T07:47:15.571034+0000","last_peered":"2024-09-16T07:47:15.571034+0000","last_clean":"2024-09-16T07:47:15.571034+0000","last_became_active":"2024-09-16T07:46:35.730207+0000","last_became_peered":"2024-09-16T07:46:35.730207+0000","last_unstale":"2024-09-16T07:47:15.571034+0000","last_undegraded":"2024-09-16T07:47:15.571034+0000","last_fullsized":"2024-09-16T07:47:15.571034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":962,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:47:35.372252+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'941","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.018804+0000","last_change":"2024-09-16T07:46:35.882240+0000","last_active":"2024-09-16T07:47:16.018804+0000","last_peered":"2024-09-16T07:47:16.018804+0000","last_clean":"2024-09-16T07:47:16.018804+0000","last_became_active":"2024-09-16T07:46:35.673492+0000","last_became_peered":"2024-09-16T07:46:35.673492+0000","last_unstale":"2024-09-16T07:47:16.018804+0000","last_undegraded":"2024-09-16T07:47:16.018804+0000","last_fullsized":"2024-09-16T07:47:16.018804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'929","reported_seq":991,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.992871+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:47:15.992871+0000","last_peered":"2024-09-16T07:47:15.992871+0000","last_clean":"2024-09-16T07:47:15.992871+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:47:15.992871+0000","last_undegraded":"2024-09-16T07:47:15.992871+0000","last_fullsized":"2024-09-16T07:47:15.992871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":929,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:47:35.372255+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"39'1052","reported_seq":1125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.652208+0000","last_change":"2024-09-16T07:47:37.714523+0000","last_active":"2024-09-16T07:47:48.652208+0000","last_peered":"2024-09-16T07:47:48.652208+0000","last_clean":"2024-09-16T07:47:48.652208+0000","last_became_active":"2024-09-16T07:47:37.562789+0000","last_became_peered":"2024-09-16T07:47:37.562789+0000","last_unstale":"2024-09-16T07:47:48.652208+0000","last_undegraded":"2024-09-16T07:47:48.652208+0000","last_fullsized":"2024-09-16T07:47:48.652208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1051,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'1037","reported_seq":1092,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.955552+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:47:15.955552+0000","last_peered":"2024-09-16T07:47:15.955552+0000","last_clean":"2024-09-16T07:47:15.955552+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:47:15.955552+0000","last_undegraded":"2024-09-16T07:47:15.955552+0000","last_fullsized":"2024-09-16T07:47:15.955552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.422563+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:47:41.422563+0000","last_peered":"2024-09-16T07:47:41.422563+0000","last_clean":"2024-09-16T07:47:41.422563+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:47:41.422563+0000","last_undegraded":"2024-09-16T07:47:41.422563+0000","last_fullsized":"2024-09-16T07:47:41.422563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"39'1113","reported_seq":1205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.738616+0000","last_change":"2024-09-16T07:47:37.914474+0000","last_active":"2024-09-16T07:47:48.738616+0000","last_peered":"2024-09-16T07:47:48.738616+0000","last_clean":"2024-09-16T07:47:48.738616+0000","last_became_active":"2024-09-16T07:47:37.611961+0000","last_became_peered":"2024-09-16T07:47:37.611961+0000","last_unstale":"2024-09-16T07:47:48.738616+0000","last_undegraded":"2024-09-16T07:47:48.738616+0000","last_fullsized":"2024-09-16T07:47:48.738616+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":42112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'1013","reported_seq":1069,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.900378+0000","last_change":"2024-09-16T07:46:35.714657+0000","last_active":"2024-09-16T07:47:15.900378+0000","last_peered":"2024-09-16T07:47:15.900378+0000","last_clean":"2024-09-16T07:47:15.900378+0000","last_became_active":"2024-09-16T07:46:35.703204+0000","last_became_peered":"2024-09-16T07:46:35.703204+0000","last_unstale":"2024-09-16T07:47:15.900378+0000","last_undegraded":"2024-09-16T07:47:15.900378+0000","last_fullsized":"2024-09-16T07:47:15.900378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.430508+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:47:41.430508+0000","last_peered":"2024-09-16T07:47:41.430508+0000","last_clean":"2024-09-16T07:47:41.430508+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:47:41.430508+0000","last_undegraded":"2024-09-16T07:47:41.430508+0000","last_fullsized":"2024-09-16T07:47:41.430508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"39'1079","reported_seq":1144,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.685513+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:47:48.685513+0000","last_peered":"2024-09-16T07:47:48.685513+0000","last_clean":"2024-09-16T07:47:48.685513+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:47:48.685513+0000","last_undegraded":"2024-09-16T07:47:48.685513+0000","last_fullsized":"2024-09-16T07:47:48.685513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1079,"log_dups_size":0,"ondisk_log_size":1079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713984,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1078,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":326696984,"num_objects":4986,"num_object_clones":0,"num_object_copies":14958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15022,"num_write_kb":640193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61591552,"data_stored":985268296,"data_compressed":46785808,"data_compressed_allocated":61579264,"data_compressed_original":985268224,"omap_allocated":0,"internal_metadata":0},"log_size":15034,"ondisk_log_size":15034,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48544,"kb_used_data":17552,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94323296,"statfs":{"total":96636764160,"available":96587055104,"internally_reserved":0,"allocated":17973248,"data_stored":282947643,"data_compressed":13433425,"data_compressed_allocated":17682432,"data_compressed_original":282836992,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47884,"kb_used_data":8316,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94323956,"statfs":{"total":96636764160,"available":96587730944,"internally_reserved":0,"allocated":8515584,"data_stored":130731497,"data_compressed":6204249,"data_compressed_allocated":8167424,"data_compressed_original":130596864,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54272,"kb_used_data":14960,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":15319040,"data_stored":240807470,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":240713752,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8044544,"data_stored":128712704,"data_compressed":6111968,"data_compressed_allocated":8044544,"data_compressed_original":128712704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17645568,"data_stored":282263576,"data_compressed":13403384,"data_compressed_allocated":17641472,"data_compressed_original":282263552,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:51.961 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:47:52.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:52.134+0000 7fe565511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:52.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:52.148+0000 7fe565511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:52.606 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:52.607 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":174,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":39,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472856,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":19},{"state_name":"stale+active+clean","count":6}],"num_pgs":25,"num_pools":3,"num_objects":4990,"data_bytes":327287360,"bytes_used":204603392,"bytes_avail":386342453248,"bytes_total":386547056640,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":51},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:47:52.628 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:47:52.628 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:52.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:52.781+0000 7f7299cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:52.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:52.792+0000 7f7299cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:52.992 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:53.067 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:53.067 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:53.092 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-16T07:47:52.321986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":327287360,"num_objects":4990,"num_object_clones":0,"num_object_copies":14970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15102,"num_write_kb":641300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15089,"ondisk_log_size":15089,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":199808,"kb_used_data":62080,"kb_used_omap":0,"kb_used_meta":137664,"kb_avail":377287552,"statfs":{"total":386547056640,"available":386342453248,"internally_reserved":0,"allocated":63569920,"data_stored":997989536,"data_compressed":47376963,"data_compressed_allocated":62361600,"data_compressed_original":997539840,"omap_allocated":0,"internal_metadata":140967936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-33488896,"num_objects":-511,"num_object_clones":0,"num_object_copies":-1533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.909384"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:35.372240+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"39'1048","reported_seq":1113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.755029+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:47:48.755029+0000","last_peered":"2024-09-16T07:47:48.755029+0000","last_clean":"2024-09-16T07:47:48.755029+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:47:48.755029+0000","last_undegraded":"2024-09-16T07:47:48.755029+0000","last_fullsized":"2024-09-16T07:47:48.755029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'908","reported_seq":970,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.758342+0000","last_change":"2024-09-16T07:46:35.964084+0000","last_active":"2024-09-16T07:47:15.758342+0000","last_peered":"2024-09-16T07:47:15.758342+0000","last_clean":"2024-09-16T07:47:15.758342+0000","last_became_active":"2024-09-16T07:46:35.741381+0000","last_became_peered":"2024-09-16T07:46:35.741381+0000","last_unstale":"2024-09-16T07:47:15.758342+0000","last_undegraded":"2024-09-16T07:47:15.758342+0000","last_fullsized":"2024-09-16T07:47:15.758342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333144,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":908,"num_write_kb":38465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:35.372244+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'945","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.914484+0000","last_change":"2024-09-16T07:46:35.708878+0000","last_active":"2024-09-16T07:47:15.914484+0000","last_peered":"2024-09-16T07:47:15.914484+0000","last_clean":"2024-09-16T07:47:15.914484+0000","last_became_active":"2024-09-16T07:46:35.703030+0000","last_became_peered":"2024-09-16T07:46:35.703030+0000","last_unstale":"2024-09-16T07:47:15.914484+0000","last_undegraded":"2024-09-16T07:47:15.914484+0000","last_fullsized":"2024-09-16T07:47:15.914484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:35.372246+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:35.372249+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'917","reported_seq":977,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.964561+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:47:15.964561+0000","last_peered":"2024-09-16T07:47:15.964561+0000","last_clean":"2024-09-16T07:47:15.964561+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:47:15.964561+0000","last_undegraded":"2024-09-16T07:47:15.964561+0000","last_fullsized":"2024-09-16T07:47:15.964561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"32'962","reported_seq":1023,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.571034+0000","last_change":"2024-09-16T07:46:35.923460+0000","last_active":"2024-09-16T07:47:15.571034+0000","last_peered":"2024-09-16T07:47:15.571034+0000","last_clean":"2024-09-16T07:47:15.571034+0000","last_became_active":"2024-09-16T07:46:35.730207+0000","last_became_peered":"2024-09-16T07:46:35.730207+0000","last_unstale":"2024-09-16T07:47:15.571034+0000","last_undegraded":"2024-09-16T07:47:15.571034+0000","last_fullsized":"2024-09-16T07:47:15.571034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":962,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:47:35.372252+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'941","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.018804+0000","last_change":"2024-09-16T07:46:35.882240+0000","last_active":"2024-09-16T07:47:16.018804+0000","last_peered":"2024-09-16T07:47:16.018804+0000","last_clean":"2024-09-16T07:47:16.018804+0000","last_became_active":"2024-09-16T07:46:35.673492+0000","last_became_peered":"2024-09-16T07:46:35.673492+0000","last_unstale":"2024-09-16T07:47:16.018804+0000","last_undegraded":"2024-09-16T07:47:16.018804+0000","last_fullsized":"2024-09-16T07:47:16.018804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'929","reported_seq":991,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.992871+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:47:15.992871+0000","last_peered":"2024-09-16T07:47:15.992871+0000","last_clean":"2024-09-16T07:47:15.992871+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:47:15.992871+0000","last_undegraded":"2024-09-16T07:47:15.992871+0000","last_fullsized":"2024-09-16T07:47:15.992871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":929,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:47:35.372255+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"39'1052","reported_seq":1125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.652208+0000","last_change":"2024-09-16T07:47:37.714523+0000","last_active":"2024-09-16T07:47:48.652208+0000","last_peered":"2024-09-16T07:47:48.652208+0000","last_clean":"2024-09-16T07:47:48.652208+0000","last_became_active":"2024-09-16T07:47:37.562789+0000","last_became_peered":"2024-09-16T07:47:37.562789+0000","last_unstale":"2024-09-16T07:47:48.652208+0000","last_undegraded":"2024-09-16T07:47:48.652208+0000","last_fullsized":"2024-09-16T07:47:48.652208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1051,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'1037","reported_seq":1092,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.955552+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:47:15.955552+0000","last_peered":"2024-09-16T07:47:15.955552+0000","last_clean":"2024-09-16T07:47:15.955552+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:47:15.955552+0000","last_undegraded":"2024-09-16T07:47:15.955552+0000","last_fullsized":"2024-09-16T07:47:15.955552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.422563+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:47:41.422563+0000","last_peered":"2024-09-16T07:47:41.422563+0000","last_clean":"2024-09-16T07:47:41.422563+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:47:41.422563+0000","last_undegraded":"2024-09-16T07:47:41.422563+0000","last_fullsized":"2024-09-16T07:47:41.422563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"39'1113","reported_seq":1205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.738616+0000","last_change":"2024-09-16T07:47:37.914474+0000","last_active":"2024-09-16T07:47:48.738616+0000","last_peered":"2024-09-16T07:47:48.738616+0000","last_clean":"2024-09-16T07:47:48.738616+0000","last_became_active":"2024-09-16T07:47:37.611961+0000","last_became_peered":"2024-09-16T07:47:37.611961+0000","last_unstale":"2024-09-16T07:47:48.738616+0000","last_undegraded":"2024-09-16T07:47:48.738616+0000","last_fullsized":"2024-09-16T07:47:48.738616+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":42112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'1013","reported_seq":1069,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.900378+0000","last_change":"2024-09-16T07:46:35.714657+0000","last_active":"2024-09-16T07:47:15.900378+0000","last_peered":"2024-09-16T07:47:15.900378+0000","last_clean":"2024-09-16T07:47:15.900378+0000","last_became_active":"2024-09-16T07:46:35.703204+0000","last_became_peered":"2024-09-16T07:46:35.703204+0000","last_unstale":"2024-09-16T07:47:15.900378+0000","last_undegraded":"2024-09-16T07:47:15.900378+0000","last_fullsized":"2024-09-16T07:47:15.900378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.430508+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:47:41.430508+0000","last_peered":"2024-09-16T07:47:41.430508+0000","last_clean":"2024-09-16T07:47:41.430508+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:47:41.430508+0000","last_undegraded":"2024-09-16T07:47:41.430508+0000","last_fullsized":"2024-09-16T07:47:41.430508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"39'1079","reported_seq":1144,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.685513+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:47:48.685513+0000","last_peered":"2024-09-16T07:47:48.685513+0000","last_clean":"2024-09-16T07:47:48.685513+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:47:48.685513+0000","last_undegraded":"2024-09-16T07:47:48.685513+0000","last_fullsized":"2024-09-16T07:47:48.685513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1079,"log_dups_size":0,"ondisk_log_size":1079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713984,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1078,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":326696984,"num_objects":4986,"num_object_clones":0,"num_object_copies":14958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15022,"num_write_kb":640193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61591552,"data_stored":985268296,"data_compressed":46785808,"data_compressed_allocated":61579264,"data_compressed_original":985268224,"omap_allocated":0,"internal_metadata":0},"log_size":15034,"ondisk_log_size":15034,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48544,"kb_used_data":17552,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94323296,"statfs":{"total":96636764160,"available":96587055104,"internally_reserved":0,"allocated":17973248,"data_stored":282947643,"data_compressed":13433425,"data_compressed_allocated":17682432,"data_compressed_original":282836992,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47884,"kb_used_data":8316,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94323956,"statfs":{"total":96636764160,"available":96587730944,"internally_reserved":0,"allocated":8515584,"data_stored":130731497,"data_compressed":6204249,"data_compressed_allocated":8167424,"data_compressed_original":130596864,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54272,"kb_used_data":14960,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":15319040,"data_stored":240807470,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":240713752,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8044544,"data_stored":128712704,"data_compressed":6111968,"data_compressed_allocated":8044544,"data_compressed_original":128712704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17645568,"data_stored":282263576,"data_compressed":13403384,"data_compressed_allocated":17641472,"data_compressed_original":282263552,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:53.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:53.167+0000 7f748cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:53.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:53.175+0000 7f748cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:55.648 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:55.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:55.787+0000 7ff881f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:55.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:55.800+0000 7ff881f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:56.095 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:56.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:56.233+0000 7f24a8b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:56.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:56.245+0000 7f24a8b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:56.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:56.615 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:56.632 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2024-09-16T07:47:56.322813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":327287360,"num_objects":4990,"num_object_clones":0,"num_object_copies":14970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15102,"num_write_kb":641300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15089,"ondisk_log_size":15089,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":199808,"kb_used_data":62080,"kb_used_omap":0,"kb_used_meta":137664,"kb_avail":377287552,"statfs":{"total":386547056640,"available":386342453248,"internally_reserved":0,"allocated":63569920,"data_stored":997989536,"data_compressed":47376963,"data_compressed_allocated":62361600,"data_compressed_original":997539840,"omap_allocated":0,"internal_metadata":140967936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-33488896,"num_objects":-511,"num_object_clones":0,"num_object_copies":-1533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002261"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:35.372240+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"39'1048","reported_seq":1113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.755029+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:47:48.755029+0000","last_peered":"2024-09-16T07:47:48.755029+0000","last_clean":"2024-09-16T07:47:48.755029+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:47:48.755029+0000","last_undegraded":"2024-09-16T07:47:48.755029+0000","last_fullsized":"2024-09-16T07:47:48.755029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'908","reported_seq":970,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.758342+0000","last_change":"2024-09-16T07:46:35.964084+0000","last_active":"2024-09-16T07:47:15.758342+0000","last_peered":"2024-09-16T07:47:15.758342+0000","last_clean":"2024-09-16T07:47:15.758342+0000","last_became_active":"2024-09-16T07:46:35.741381+0000","last_became_peered":"2024-09-16T07:46:35.741381+0000","last_unstale":"2024-09-16T07:47:15.758342+0000","last_undegraded":"2024-09-16T07:47:15.758342+0000","last_fullsized":"2024-09-16T07:47:15.758342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333144,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":908,"num_write_kb":38465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:35.372244+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'945","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.914484+0000","last_change":"2024-09-16T07:46:35.708878+0000","last_active":"2024-09-16T07:47:15.914484+0000","last_peered":"2024-09-16T07:47:15.914484+0000","last_clean":"2024-09-16T07:47:15.914484+0000","last_became_active":"2024-09-16T07:46:35.703030+0000","last_became_peered":"2024-09-16T07:46:35.703030+0000","last_unstale":"2024-09-16T07:47:15.914484+0000","last_undegraded":"2024-09-16T07:47:15.914484+0000","last_fullsized":"2024-09-16T07:47:15.914484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:35.372246+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:35.372249+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'917","reported_seq":977,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.964561+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:47:15.964561+0000","last_peered":"2024-09-16T07:47:15.964561+0000","last_clean":"2024-09-16T07:47:15.964561+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:47:15.964561+0000","last_undegraded":"2024-09-16T07:47:15.964561+0000","last_fullsized":"2024-09-16T07:47:15.964561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"32'962","reported_seq":1023,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.571034+0000","last_change":"2024-09-16T07:46:35.923460+0000","last_active":"2024-09-16T07:47:15.571034+0000","last_peered":"2024-09-16T07:47:15.571034+0000","last_clean":"2024-09-16T07:47:15.571034+0000","last_became_active":"2024-09-16T07:46:35.730207+0000","last_became_peered":"2024-09-16T07:46:35.730207+0000","last_unstale":"2024-09-16T07:47:15.571034+0000","last_undegraded":"2024-09-16T07:47:15.571034+0000","last_fullsized":"2024-09-16T07:47:15.571034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":962,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:47:35.372252+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'941","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.018804+0000","last_change":"2024-09-16T07:46:35.882240+0000","last_active":"2024-09-16T07:47:16.018804+0000","last_peered":"2024-09-16T07:47:16.018804+0000","last_clean":"2024-09-16T07:47:16.018804+0000","last_became_active":"2024-09-16T07:46:35.673492+0000","last_became_peered":"2024-09-16T07:46:35.673492+0000","last_unstale":"2024-09-16T07:47:16.018804+0000","last_undegraded":"2024-09-16T07:47:16.018804+0000","last_fullsized":"2024-09-16T07:47:16.018804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'929","reported_seq":991,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.992871+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:47:15.992871+0000","last_peered":"2024-09-16T07:47:15.992871+0000","last_clean":"2024-09-16T07:47:15.992871+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:47:15.992871+0000","last_undegraded":"2024-09-16T07:47:15.992871+0000","last_fullsized":"2024-09-16T07:47:15.992871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":929,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:47:35.372255+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"39'1052","reported_seq":1125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.652208+0000","last_change":"2024-09-16T07:47:37.714523+0000","last_active":"2024-09-16T07:47:48.652208+0000","last_peered":"2024-09-16T07:47:48.652208+0000","last_clean":"2024-09-16T07:47:48.652208+0000","last_became_active":"2024-09-16T07:47:37.562789+0000","last_became_peered":"2024-09-16T07:47:37.562789+0000","last_unstale":"2024-09-16T07:47:48.652208+0000","last_undegraded":"2024-09-16T07:47:48.652208+0000","last_fullsized":"2024-09-16T07:47:48.652208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1051,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'1037","reported_seq":1092,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.955552+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:47:15.955552+0000","last_peered":"2024-09-16T07:47:15.955552+0000","last_clean":"2024-09-16T07:47:15.955552+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:47:15.955552+0000","last_undegraded":"2024-09-16T07:47:15.955552+0000","last_fullsized":"2024-09-16T07:47:15.955552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.422563+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:47:41.422563+0000","last_peered":"2024-09-16T07:47:41.422563+0000","last_clean":"2024-09-16T07:47:41.422563+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:47:41.422563+0000","last_undegraded":"2024-09-16T07:47:41.422563+0000","last_fullsized":"2024-09-16T07:47:41.422563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"39'1113","reported_seq":1205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.738616+0000","last_change":"2024-09-16T07:47:37.914474+0000","last_active":"2024-09-16T07:47:48.738616+0000","last_peered":"2024-09-16T07:47:48.738616+0000","last_clean":"2024-09-16T07:47:48.738616+0000","last_became_active":"2024-09-16T07:47:37.611961+0000","last_became_peered":"2024-09-16T07:47:37.611961+0000","last_unstale":"2024-09-16T07:47:48.738616+0000","last_undegraded":"2024-09-16T07:47:48.738616+0000","last_fullsized":"2024-09-16T07:47:48.738616+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":42112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'1013","reported_seq":1069,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.900378+0000","last_change":"2024-09-16T07:46:35.714657+0000","last_active":"2024-09-16T07:47:15.900378+0000","last_peered":"2024-09-16T07:47:15.900378+0000","last_clean":"2024-09-16T07:47:15.900378+0000","last_became_active":"2024-09-16T07:46:35.703204+0000","last_became_peered":"2024-09-16T07:46:35.703204+0000","last_unstale":"2024-09-16T07:47:15.900378+0000","last_undegraded":"2024-09-16T07:47:15.900378+0000","last_fullsized":"2024-09-16T07:47:15.900378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.430508+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:47:41.430508+0000","last_peered":"2024-09-16T07:47:41.430508+0000","last_clean":"2024-09-16T07:47:41.430508+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:47:41.430508+0000","last_undegraded":"2024-09-16T07:47:41.430508+0000","last_fullsized":"2024-09-16T07:47:41.430508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"39'1079","reported_seq":1144,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.685513+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:47:48.685513+0000","last_peered":"2024-09-16T07:47:48.685513+0000","last_clean":"2024-09-16T07:47:48.685513+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:47:48.685513+0000","last_undegraded":"2024-09-16T07:47:48.685513+0000","last_fullsized":"2024-09-16T07:47:48.685513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1079,"log_dups_size":0,"ondisk_log_size":1079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713984,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1078,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":326696984,"num_objects":4986,"num_object_clones":0,"num_object_copies":14958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15022,"num_write_kb":640193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61591552,"data_stored":985268296,"data_compressed":46785808,"data_compressed_allocated":61579264,"data_compressed_original":985268224,"omap_allocated":0,"internal_metadata":0},"log_size":15034,"ondisk_log_size":15034,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48544,"kb_used_data":17552,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94323296,"statfs":{"total":96636764160,"available":96587055104,"internally_reserved":0,"allocated":17973248,"data_stored":282947643,"data_compressed":13433425,"data_compressed_allocated":17682432,"data_compressed_original":282836992,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47884,"kb_used_data":8316,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94323956,"statfs":{"total":96636764160,"available":96587730944,"internally_reserved":0,"allocated":8515584,"data_stored":130731497,"data_compressed":6204249,"data_compressed_allocated":8167424,"data_compressed_original":130596864,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54272,"kb_used_data":14960,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":15319040,"data_stored":240807470,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":240713752,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8044544,"data_stored":128712704,"data_compressed":6111968,"data_compressed_allocated":8044544,"data_compressed_original":128712704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17645568,"data_stored":282263576,"data_compressed":13403384,"data_compressed_allocated":17641472,"data_compressed_original":282263552,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:56.634 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:47:56.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:56.791+0000 7efc5246c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:56.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:56.804+0000 7efc5246c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:57.191 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:57.191 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":179,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":39,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472856,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":19},{"state_name":"stale+active+clean","count":6}],"num_pgs":25,"num_pools":3,"num_objects":4990,"data_bytes":327287360,"bytes_used":204603392,"bytes_avail":386342453248,"bytes_total":386547056640,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":42},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:47:57.211 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:47:57.212 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:57.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:57.353+0000 7f82e8151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:57.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:57.366+0000 7f82e8151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:57.680 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:47:57.680 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:47:57.696 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2024-09-16T07:47:56.322813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":327287360,"num_objects":4990,"num_object_clones":0,"num_object_copies":14970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15102,"num_write_kb":641300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15089,"ondisk_log_size":15089,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":199808,"kb_used_data":62080,"kb_used_omap":0,"kb_used_meta":137664,"kb_avail":377287552,"statfs":{"total":386547056640,"available":386342453248,"internally_reserved":0,"allocated":63569920,"data_stored":997989536,"data_compressed":47376963,"data_compressed_allocated":62361600,"data_compressed_original":997539840,"omap_allocated":0,"internal_metadata":140967936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-33488896,"num_objects":-511,"num_object_clones":0,"num_object_copies":-1533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002261"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:35.372240+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"39'1048","reported_seq":1113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.755029+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:47:48.755029+0000","last_peered":"2024-09-16T07:47:48.755029+0000","last_clean":"2024-09-16T07:47:48.755029+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:47:48.755029+0000","last_undegraded":"2024-09-16T07:47:48.755029+0000","last_fullsized":"2024-09-16T07:47:48.755029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'908","reported_seq":970,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.758342+0000","last_change":"2024-09-16T07:46:35.964084+0000","last_active":"2024-09-16T07:47:15.758342+0000","last_peered":"2024-09-16T07:47:15.758342+0000","last_clean":"2024-09-16T07:47:15.758342+0000","last_became_active":"2024-09-16T07:46:35.741381+0000","last_became_peered":"2024-09-16T07:46:35.741381+0000","last_unstale":"2024-09-16T07:47:15.758342+0000","last_undegraded":"2024-09-16T07:47:15.758342+0000","last_fullsized":"2024-09-16T07:47:15.758342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333144,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":908,"num_write_kb":38465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:35.372244+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'945","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.914484+0000","last_change":"2024-09-16T07:46:35.708878+0000","last_active":"2024-09-16T07:47:15.914484+0000","last_peered":"2024-09-16T07:47:15.914484+0000","last_clean":"2024-09-16T07:47:15.914484+0000","last_became_active":"2024-09-16T07:46:35.703030+0000","last_became_peered":"2024-09-16T07:46:35.703030+0000","last_unstale":"2024-09-16T07:47:15.914484+0000","last_undegraded":"2024-09-16T07:47:15.914484+0000","last_fullsized":"2024-09-16T07:47:15.914484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:35.372246+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:35.372249+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'917","reported_seq":977,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.964561+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:47:15.964561+0000","last_peered":"2024-09-16T07:47:15.964561+0000","last_clean":"2024-09-16T07:47:15.964561+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:47:15.964561+0000","last_undegraded":"2024-09-16T07:47:15.964561+0000","last_fullsized":"2024-09-16T07:47:15.964561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"32'962","reported_seq":1023,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.571034+0000","last_change":"2024-09-16T07:46:35.923460+0000","last_active":"2024-09-16T07:47:15.571034+0000","last_peered":"2024-09-16T07:47:15.571034+0000","last_clean":"2024-09-16T07:47:15.571034+0000","last_became_active":"2024-09-16T07:46:35.730207+0000","last_became_peered":"2024-09-16T07:46:35.730207+0000","last_unstale":"2024-09-16T07:47:15.571034+0000","last_undegraded":"2024-09-16T07:47:15.571034+0000","last_fullsized":"2024-09-16T07:47:15.571034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":962,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:47:35.372252+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'941","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.018804+0000","last_change":"2024-09-16T07:46:35.882240+0000","last_active":"2024-09-16T07:47:16.018804+0000","last_peered":"2024-09-16T07:47:16.018804+0000","last_clean":"2024-09-16T07:47:16.018804+0000","last_became_active":"2024-09-16T07:46:35.673492+0000","last_became_peered":"2024-09-16T07:46:35.673492+0000","last_unstale":"2024-09-16T07:47:16.018804+0000","last_undegraded":"2024-09-16T07:47:16.018804+0000","last_fullsized":"2024-09-16T07:47:16.018804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'929","reported_seq":991,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.992871+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:47:15.992871+0000","last_peered":"2024-09-16T07:47:15.992871+0000","last_clean":"2024-09-16T07:47:15.992871+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:47:15.992871+0000","last_undegraded":"2024-09-16T07:47:15.992871+0000","last_fullsized":"2024-09-16T07:47:15.992871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":929,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:47:35.372255+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"39'1052","reported_seq":1125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.652208+0000","last_change":"2024-09-16T07:47:37.714523+0000","last_active":"2024-09-16T07:47:48.652208+0000","last_peered":"2024-09-16T07:47:48.652208+0000","last_clean":"2024-09-16T07:47:48.652208+0000","last_became_active":"2024-09-16T07:47:37.562789+0000","last_became_peered":"2024-09-16T07:47:37.562789+0000","last_unstale":"2024-09-16T07:47:48.652208+0000","last_undegraded":"2024-09-16T07:47:48.652208+0000","last_fullsized":"2024-09-16T07:47:48.652208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1051,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'1037","reported_seq":1092,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.955552+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:47:15.955552+0000","last_peered":"2024-09-16T07:47:15.955552+0000","last_clean":"2024-09-16T07:47:15.955552+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:47:15.955552+0000","last_undegraded":"2024-09-16T07:47:15.955552+0000","last_fullsized":"2024-09-16T07:47:15.955552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.422563+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:47:41.422563+0000","last_peered":"2024-09-16T07:47:41.422563+0000","last_clean":"2024-09-16T07:47:41.422563+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:47:41.422563+0000","last_undegraded":"2024-09-16T07:47:41.422563+0000","last_fullsized":"2024-09-16T07:47:41.422563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"39'1113","reported_seq":1205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.738616+0000","last_change":"2024-09-16T07:47:37.914474+0000","last_active":"2024-09-16T07:47:48.738616+0000","last_peered":"2024-09-16T07:47:48.738616+0000","last_clean":"2024-09-16T07:47:48.738616+0000","last_became_active":"2024-09-16T07:47:37.611961+0000","last_became_peered":"2024-09-16T07:47:37.611961+0000","last_unstale":"2024-09-16T07:47:48.738616+0000","last_undegraded":"2024-09-16T07:47:48.738616+0000","last_fullsized":"2024-09-16T07:47:48.738616+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":42112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'1013","reported_seq":1069,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.900378+0000","last_change":"2024-09-16T07:46:35.714657+0000","last_active":"2024-09-16T07:47:15.900378+0000","last_peered":"2024-09-16T07:47:15.900378+0000","last_clean":"2024-09-16T07:47:15.900378+0000","last_became_active":"2024-09-16T07:46:35.703204+0000","last_became_peered":"2024-09-16T07:46:35.703204+0000","last_unstale":"2024-09-16T07:47:15.900378+0000","last_undegraded":"2024-09-16T07:47:15.900378+0000","last_fullsized":"2024-09-16T07:47:15.900378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.430508+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:47:41.430508+0000","last_peered":"2024-09-16T07:47:41.430508+0000","last_clean":"2024-09-16T07:47:41.430508+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:47:41.430508+0000","last_undegraded":"2024-09-16T07:47:41.430508+0000","last_fullsized":"2024-09-16T07:47:41.430508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"39'1079","reported_seq":1144,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.685513+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:47:48.685513+0000","last_peered":"2024-09-16T07:47:48.685513+0000","last_clean":"2024-09-16T07:47:48.685513+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:47:48.685513+0000","last_undegraded":"2024-09-16T07:47:48.685513+0000","last_fullsized":"2024-09-16T07:47:48.685513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1079,"log_dups_size":0,"ondisk_log_size":1079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713984,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1078,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":326696984,"num_objects":4986,"num_object_clones":0,"num_object_copies":14958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15022,"num_write_kb":640193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61591552,"data_stored":985268296,"data_compressed":46785808,"data_compressed_allocated":61579264,"data_compressed_original":985268224,"omap_allocated":0,"internal_metadata":0},"log_size":15034,"ondisk_log_size":15034,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48544,"kb_used_data":17552,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94323296,"statfs":{"total":96636764160,"available":96587055104,"internally_reserved":0,"allocated":17973248,"data_stored":282947643,"data_compressed":13433425,"data_compressed_allocated":17682432,"data_compressed_original":282836992,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47884,"kb_used_data":8316,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94323956,"statfs":{"total":96636764160,"available":96587730944,"internally_reserved":0,"allocated":8515584,"data_stored":130731497,"data_compressed":6204249,"data_compressed_allocated":8167424,"data_compressed_original":130596864,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54272,"kb_used_data":14960,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":15319040,"data_stored":240807470,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":240713752,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8044544,"data_stored":128712704,"data_compressed":6111968,"data_compressed_allocated":8044544,"data_compressed_original":128712704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17645568,"data_stored":282263576,"data_compressed":13403384,"data_compressed_allocated":17641472,"data_compressed_original":282263552,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:58.059 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:58.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:58.231+0000 7f6649511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:58.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:47:58.240+0000 7f6649511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:00.698 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:00.751 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:00.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:00.853+0000 7fd97eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:00.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:00.866+0000 7fd97eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:00.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:00.930+0000 7f0520191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:00.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:00.941+0000 7f0520191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:01.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:01.154 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:01.172 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2024-09-16T07:48:00.323485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":327287360,"num_objects":4990,"num_object_clones":0,"num_object_copies":14970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15102,"num_write_kb":641300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15089,"ondisk_log_size":15089,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":199808,"kb_used_data":62080,"kb_used_omap":0,"kb_used_meta":137664,"kb_avail":377287552,"statfs":{"total":386547056640,"available":386342453248,"internally_reserved":0,"allocated":63569920,"data_stored":997989536,"data_compressed":47376963,"data_compressed_allocated":62361600,"data_compressed_original":997539840,"omap_allocated":0,"internal_metadata":140967936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-33488896,"num_objects":-511,"num_object_clones":0,"num_object_copies":-1533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002268"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:35.372240+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"39'1048","reported_seq":1113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.755029+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:47:48.755029+0000","last_peered":"2024-09-16T07:47:48.755029+0000","last_clean":"2024-09-16T07:47:48.755029+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:47:48.755029+0000","last_undegraded":"2024-09-16T07:47:48.755029+0000","last_fullsized":"2024-09-16T07:47:48.755029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'908","reported_seq":970,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.758342+0000","last_change":"2024-09-16T07:46:35.964084+0000","last_active":"2024-09-16T07:47:15.758342+0000","last_peered":"2024-09-16T07:47:15.758342+0000","last_clean":"2024-09-16T07:47:15.758342+0000","last_became_active":"2024-09-16T07:46:35.741381+0000","last_became_peered":"2024-09-16T07:46:35.741381+0000","last_unstale":"2024-09-16T07:47:15.758342+0000","last_undegraded":"2024-09-16T07:47:15.758342+0000","last_fullsized":"2024-09-16T07:47:15.758342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333144,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":908,"num_write_kb":38465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:35.372244+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'945","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.914484+0000","last_change":"2024-09-16T07:46:35.708878+0000","last_active":"2024-09-16T07:47:15.914484+0000","last_peered":"2024-09-16T07:47:15.914484+0000","last_clean":"2024-09-16T07:47:15.914484+0000","last_became_active":"2024-09-16T07:46:35.703030+0000","last_became_peered":"2024-09-16T07:46:35.703030+0000","last_unstale":"2024-09-16T07:47:15.914484+0000","last_undegraded":"2024-09-16T07:47:15.914484+0000","last_fullsized":"2024-09-16T07:47:15.914484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:35.372246+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:35.372249+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'917","reported_seq":977,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.964561+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:47:15.964561+0000","last_peered":"2024-09-16T07:47:15.964561+0000","last_clean":"2024-09-16T07:47:15.964561+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:47:15.964561+0000","last_undegraded":"2024-09-16T07:47:15.964561+0000","last_fullsized":"2024-09-16T07:47:15.964561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"32'962","reported_seq":1023,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.571034+0000","last_change":"2024-09-16T07:46:35.923460+0000","last_active":"2024-09-16T07:47:15.571034+0000","last_peered":"2024-09-16T07:47:15.571034+0000","last_clean":"2024-09-16T07:47:15.571034+0000","last_became_active":"2024-09-16T07:46:35.730207+0000","last_became_peered":"2024-09-16T07:46:35.730207+0000","last_unstale":"2024-09-16T07:47:15.571034+0000","last_undegraded":"2024-09-16T07:47:15.571034+0000","last_fullsized":"2024-09-16T07:47:15.571034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":962,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:47:35.372252+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'941","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.018804+0000","last_change":"2024-09-16T07:46:35.882240+0000","last_active":"2024-09-16T07:47:16.018804+0000","last_peered":"2024-09-16T07:47:16.018804+0000","last_clean":"2024-09-16T07:47:16.018804+0000","last_became_active":"2024-09-16T07:46:35.673492+0000","last_became_peered":"2024-09-16T07:46:35.673492+0000","last_unstale":"2024-09-16T07:47:16.018804+0000","last_undegraded":"2024-09-16T07:47:16.018804+0000","last_fullsized":"2024-09-16T07:47:16.018804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'929","reported_seq":991,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.992871+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:47:15.992871+0000","last_peered":"2024-09-16T07:47:15.992871+0000","last_clean":"2024-09-16T07:47:15.992871+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:47:15.992871+0000","last_undegraded":"2024-09-16T07:47:15.992871+0000","last_fullsized":"2024-09-16T07:47:15.992871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":929,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:47:35.372255+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"39'1052","reported_seq":1125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.652208+0000","last_change":"2024-09-16T07:47:37.714523+0000","last_active":"2024-09-16T07:47:48.652208+0000","last_peered":"2024-09-16T07:47:48.652208+0000","last_clean":"2024-09-16T07:47:48.652208+0000","last_became_active":"2024-09-16T07:47:37.562789+0000","last_became_peered":"2024-09-16T07:47:37.562789+0000","last_unstale":"2024-09-16T07:47:48.652208+0000","last_undegraded":"2024-09-16T07:47:48.652208+0000","last_fullsized":"2024-09-16T07:47:48.652208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1051,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'1037","reported_seq":1092,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.955552+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:47:15.955552+0000","last_peered":"2024-09-16T07:47:15.955552+0000","last_clean":"2024-09-16T07:47:15.955552+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:47:15.955552+0000","last_undegraded":"2024-09-16T07:47:15.955552+0000","last_fullsized":"2024-09-16T07:47:15.955552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.422563+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:47:41.422563+0000","last_peered":"2024-09-16T07:47:41.422563+0000","last_clean":"2024-09-16T07:47:41.422563+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:47:41.422563+0000","last_undegraded":"2024-09-16T07:47:41.422563+0000","last_fullsized":"2024-09-16T07:47:41.422563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"39'1113","reported_seq":1205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.738616+0000","last_change":"2024-09-16T07:47:37.914474+0000","last_active":"2024-09-16T07:47:48.738616+0000","last_peered":"2024-09-16T07:47:48.738616+0000","last_clean":"2024-09-16T07:47:48.738616+0000","last_became_active":"2024-09-16T07:47:37.611961+0000","last_became_peered":"2024-09-16T07:47:37.611961+0000","last_unstale":"2024-09-16T07:47:48.738616+0000","last_undegraded":"2024-09-16T07:47:48.738616+0000","last_fullsized":"2024-09-16T07:47:48.738616+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":42112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'1013","reported_seq":1069,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.900378+0000","last_change":"2024-09-16T07:46:35.714657+0000","last_active":"2024-09-16T07:47:15.900378+0000","last_peered":"2024-09-16T07:47:15.900378+0000","last_clean":"2024-09-16T07:47:15.900378+0000","last_became_active":"2024-09-16T07:46:35.703204+0000","last_became_peered":"2024-09-16T07:46:35.703204+0000","last_unstale":"2024-09-16T07:47:15.900378+0000","last_undegraded":"2024-09-16T07:47:15.900378+0000","last_fullsized":"2024-09-16T07:47:15.900378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.430508+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:47:41.430508+0000","last_peered":"2024-09-16T07:47:41.430508+0000","last_clean":"2024-09-16T07:47:41.430508+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:47:41.430508+0000","last_undegraded":"2024-09-16T07:47:41.430508+0000","last_fullsized":"2024-09-16T07:47:41.430508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"39'1079","reported_seq":1144,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.685513+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:47:48.685513+0000","last_peered":"2024-09-16T07:47:48.685513+0000","last_clean":"2024-09-16T07:47:48.685513+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:47:48.685513+0000","last_undegraded":"2024-09-16T07:47:48.685513+0000","last_fullsized":"2024-09-16T07:47:48.685513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1079,"log_dups_size":0,"ondisk_log_size":1079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713984,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1078,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":326696984,"num_objects":4986,"num_object_clones":0,"num_object_copies":14958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15022,"num_write_kb":640193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61591552,"data_stored":985268296,"data_compressed":46785808,"data_compressed_allocated":61579264,"data_compressed_original":985268224,"omap_allocated":0,"internal_metadata":0},"log_size":15034,"ondisk_log_size":15034,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48544,"kb_used_data":17552,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94323296,"statfs":{"total":96636764160,"available":96587055104,"internally_reserved":0,"allocated":17973248,"data_stored":282947643,"data_compressed":13433425,"data_compressed_allocated":17682432,"data_compressed_original":282836992,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47884,"kb_used_data":8316,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94323956,"statfs":{"total":96636764160,"available":96587730944,"internally_reserved":0,"allocated":8515584,"data_stored":130731497,"data_compressed":6204249,"data_compressed_allocated":8167424,"data_compressed_original":130596864,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54272,"kb_used_data":14960,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":15319040,"data_stored":240807470,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":240713752,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8044544,"data_stored":128712704,"data_compressed":6111968,"data_compressed_allocated":8044544,"data_compressed_original":128712704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17645568,"data_stored":282263576,"data_compressed":13403384,"data_compressed_allocated":17641472,"data_compressed_original":282263552,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:01.173 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:48:01.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:01.342+0000 7f649389c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:01.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:01.355+0000 7f649389c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:01.857 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:01.858 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":183,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":39,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472856,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":19},{"state_name":"stale+active+clean","count":6}],"num_pgs":25,"num_pools":3,"num_objects":4990,"data_bytes":327287360,"bytes_used":204603392,"bytes_avail":386342453248,"bytes_total":386547056640,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":42},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:48:01.876 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:48:01.876 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:02.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:02.029+0000 7ff2f0ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:02.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:02.046+0000 7ff2f0ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:02.321 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:02.321 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:02.343 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2024-09-16T07:48:00.323485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":327287360,"num_objects":4990,"num_object_clones":0,"num_object_copies":14970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15102,"num_write_kb":641300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15089,"ondisk_log_size":15089,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":199808,"kb_used_data":62080,"kb_used_omap":0,"kb_used_meta":137664,"kb_avail":377287552,"statfs":{"total":386547056640,"available":386342453248,"internally_reserved":0,"allocated":63569920,"data_stored":997989536,"data_compressed":47376963,"data_compressed_allocated":62361600,"data_compressed_original":997539840,"omap_allocated":0,"internal_metadata":140967936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-33488896,"num_objects":-511,"num_object_clones":0,"num_object_copies":-1533,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002268"},"pg_stats":[{"pgid":"3.f","version":"32'815","reported_seq":867,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.272851+0000","last_change":"2024-09-16T07:46:35.772746+0000","last_active":"2024-09-16T07:47:03.272851+0000","last_peered":"2024-09-16T07:47:03.272851+0000","last_clean":"2024-09-16T07:47:03.272851+0000","last_became_active":"2024-09-16T07:46:35.749492+0000","last_became_peered":"2024-09-16T07:46:35.749492+0000","last_unstale":"2024-09-16T07:47:35.372240+0000","last_undegraded":"2024-09-16T07:47:03.272851+0000","last_fullsized":"2024-09-16T07:47:03.272851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":813,"num_write_kb":40256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"39'1048","reported_seq":1113,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.755029+0000","last_change":"2024-09-16T07:45:50.628940+0000","last_active":"2024-09-16T07:47:48.755029+0000","last_peered":"2024-09-16T07:47:48.755029+0000","last_clean":"2024-09-16T07:47:48.755029+0000","last_became_active":"2024-09-16T07:45:50.620035+0000","last_became_peered":"2024-09-16T07:45:50.620035+0000","last_unstale":"2024-09-16T07:47:48.755029+0000","last_undegraded":"2024-09-16T07:47:48.755029+0000","last_fullsized":"2024-09-16T07:47:48.755029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11206656,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1047,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'908","reported_seq":970,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.758342+0000","last_change":"2024-09-16T07:46:35.964084+0000","last_active":"2024-09-16T07:47:15.758342+0000","last_peered":"2024-09-16T07:47:15.758342+0000","last_clean":"2024-09-16T07:47:15.758342+0000","last_became_active":"2024-09-16T07:46:35.741381+0000","last_became_peered":"2024-09-16T07:46:35.741381+0000","last_unstale":"2024-09-16T07:47:15.758342+0000","last_undegraded":"2024-09-16T07:47:15.758342+0000","last_fullsized":"2024-09-16T07:47:15.758342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333144,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":908,"num_write_kb":38465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'728","reported_seq":781,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.505123+0000","last_change":"2024-09-16T07:46:35.802648+0000","last_active":"2024-09-16T07:47:03.505123+0000","last_peered":"2024-09-16T07:47:03.505123+0000","last_clean":"2024-09-16T07:47:03.505123+0000","last_became_active":"2024-09-16T07:46:35.791285+0000","last_became_peered":"2024-09-16T07:46:35.791285+0000","last_unstale":"2024-09-16T07:47:35.372244+0000","last_undegraded":"2024-09-16T07:47:03.505123+0000","last_fullsized":"2024-09-16T07:47:03.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":37056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"32'945","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.914484+0000","last_change":"2024-09-16T07:46:35.708878+0000","last_active":"2024-09-16T07:47:15.914484+0000","last_peered":"2024-09-16T07:47:15.914484+0000","last_clean":"2024-09-16T07:47:15.914484+0000","last_became_active":"2024-09-16T07:46:35.703030+0000","last_became_peered":"2024-09-16T07:46:35.703030+0000","last_unstale":"2024-09-16T07:47:15.914484+0000","last_undegraded":"2024-09-16T07:47:15.914484+0000","last_fullsized":"2024-09-16T07:47:15.914484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21299200,"num_objects":325,"num_object_clones":0,"num_object_copies":975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'758","reported_seq":804,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.561096+0000","last_change":"2024-09-16T07:46:35.811410+0000","last_active":"2024-09-16T07:47:03.561096+0000","last_peered":"2024-09-16T07:47:03.561096+0000","last_clean":"2024-09-16T07:47:03.561096+0000","last_became_active":"2024-09-16T07:46:35.802487+0000","last_became_peered":"2024-09-16T07:46:35.802487+0000","last_unstale":"2024-09-16T07:47:35.372246+0000","last_undegraded":"2024-09-16T07:47:03.561096+0000","last_fullsized":"2024-09-16T07:47:03.561096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":38976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"32'789","reported_seq":835,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:47:03.624369+0000","last_change":"2024-09-16T07:46:35.782492+0000","last_active":"2024-09-16T07:47:03.624369+0000","last_peered":"2024-09-16T07:47:03.624369+0000","last_clean":"2024-09-16T07:47:03.624369+0000","last_became_active":"2024-09-16T07:46:35.764632+0000","last_became_peered":"2024-09-16T07:46:35.764632+0000","last_unstale":"2024-09-16T07:47:35.372249+0000","last_undegraded":"2024-09-16T07:47:03.624369+0000","last_fullsized":"2024-09-16T07:47:03.624369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"32'917","reported_seq":977,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.964561+0000","last_change":"2024-09-16T07:45:50.786271+0000","last_active":"2024-09-16T07:47:15.964561+0000","last_peered":"2024-09-16T07:47:15.964561+0000","last_clean":"2024-09-16T07:47:15.964561+0000","last_became_active":"2024-09-16T07:45:50.588643+0000","last_became_peered":"2024-09-16T07:45:50.588643+0000","last_unstale":"2024-09-16T07:47:15.964561+0000","last_undegraded":"2024-09-16T07:47:15.964561+0000","last_fullsized":"2024-09-16T07:47:15.964561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19595264,"num_objects":299,"num_object_clones":0,"num_object_copies":897,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"32'962","reported_seq":1023,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.571034+0000","last_change":"2024-09-16T07:46:35.923460+0000","last_active":"2024-09-16T07:47:15.571034+0000","last_peered":"2024-09-16T07:47:15.571034+0000","last_clean":"2024-09-16T07:47:15.571034+0000","last_became_active":"2024-09-16T07:46:35.730207+0000","last_became_peered":"2024-09-16T07:46:35.730207+0000","last_unstale":"2024-09-16T07:47:15.571034+0000","last_undegraded":"2024-09-16T07:47:15.571034+0000","last_fullsized":"2024-09-16T07:47:15.571034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":962,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:47:35.372252+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"32'941","reported_seq":1004,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:16.018804+0000","last_change":"2024-09-16T07:46:35.882240+0000","last_active":"2024-09-16T07:47:16.018804+0000","last_peered":"2024-09-16T07:47:16.018804+0000","last_clean":"2024-09-16T07:47:16.018804+0000","last_became_active":"2024-09-16T07:46:35.673492+0000","last_became_peered":"2024-09-16T07:46:35.673492+0000","last_unstale":"2024-09-16T07:47:16.018804+0000","last_undegraded":"2024-09-16T07:47:16.018804+0000","last_fullsized":"2024-09-16T07:47:16.018804+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20250624,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":40000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'929","reported_seq":991,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.992871+0000","last_change":"2024-09-16T07:45:50.890487+0000","last_active":"2024-09-16T07:47:15.992871+0000","last_peered":"2024-09-16T07:47:15.992871+0000","last_clean":"2024-09-16T07:47:15.992871+0000","last_became_active":"2024-09-16T07:45:50.627127+0000","last_became_peered":"2024-09-16T07:45:50.627127+0000","last_unstale":"2024-09-16T07:47:15.992871+0000","last_undegraded":"2024-09-16T07:47:15.992871+0000","last_fullsized":"2024-09-16T07:47:15.992871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":929,"log_dups_size":0,"ondisk_log_size":929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19464192,"num_objects":297,"num_object_clones":0,"num_object_copies":891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":929,"num_write_kb":39232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:47:35.372255+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"39'1052","reported_seq":1125,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.652208+0000","last_change":"2024-09-16T07:47:37.714523+0000","last_active":"2024-09-16T07:47:48.652208+0000","last_peered":"2024-09-16T07:47:48.652208+0000","last_clean":"2024-09-16T07:47:48.652208+0000","last_became_active":"2024-09-16T07:47:37.562789+0000","last_became_peered":"2024-09-16T07:47:37.562789+0000","last_unstale":"2024-09-16T07:47:48.652208+0000","last_undegraded":"2024-09-16T07:47:48.652208+0000","last_fullsized":"2024-09-16T07:47:48.652208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1051,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'1037","reported_seq":1092,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.955552+0000","last_change":"2024-09-16T07:45:50.646824+0000","last_active":"2024-09-16T07:47:15.955552+0000","last_peered":"2024-09-16T07:47:15.955552+0000","last_clean":"2024-09-16T07:47:15.955552+0000","last_became_active":"2024-09-16T07:45:50.633657+0000","last_became_peered":"2024-09-16T07:45:50.633657+0000","last_unstale":"2024-09-16T07:47:15.955552+0000","last_undegraded":"2024-09-16T07:47:15.955552+0000","last_fullsized":"2024-09-16T07:47:15.955552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1037,"log_dups_size":0,"ondisk_log_size":1037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1037,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.422563+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:47:41.422563+0000","last_peered":"2024-09-16T07:47:41.422563+0000","last_clean":"2024-09-16T07:47:41.422563+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:47:41.422563+0000","last_undegraded":"2024-09-16T07:47:41.422563+0000","last_fullsized":"2024-09-16T07:47:41.422563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"39'1113","reported_seq":1205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.738616+0000","last_change":"2024-09-16T07:47:37.914474+0000","last_active":"2024-09-16T07:47:48.738616+0000","last_peered":"2024-09-16T07:47:48.738616+0000","last_clean":"2024-09-16T07:47:48.738616+0000","last_became_active":"2024-09-16T07:47:37.611961+0000","last_became_peered":"2024-09-16T07:47:37.611961+0000","last_unstale":"2024-09-16T07:47:48.738616+0000","last_undegraded":"2024-09-16T07:47:48.738616+0000","last_fullsized":"2024-09-16T07:47:48.738616+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1112,"num_write_kb":42112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'1013","reported_seq":1069,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:47:15.900378+0000","last_change":"2024-09-16T07:46:35.714657+0000","last_active":"2024-09-16T07:47:15.900378+0000","last_peered":"2024-09-16T07:47:15.900378+0000","last_clean":"2024-09-16T07:47:15.900378+0000","last_became_active":"2024-09-16T07:46:35.703204+0000","last_became_peered":"2024-09-16T07:46:35.703204+0000","last_unstale":"2024-09-16T07:47:15.900378+0000","last_undegraded":"2024-09-16T07:47:15.900378+0000","last_fullsized":"2024-09-16T07:47:15.900378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":42752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.430508+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:47:41.430508+0000","last_peered":"2024-09-16T07:47:41.430508+0000","last_clean":"2024-09-16T07:47:41.430508+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:47:41.430508+0000","last_undegraded":"2024-09-16T07:47:41.430508+0000","last_fullsized":"2024-09-16T07:47:41.430508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"39'1079","reported_seq":1144,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:48.685513+0000","last_change":"2024-09-16T07:45:50.698697+0000","last_active":"2024-09-16T07:47:48.685513+0000","last_peered":"2024-09-16T07:47:48.685513+0000","last_clean":"2024-09-16T07:47:48.685513+0000","last_became_active":"2024-09-16T07:45:50.681994+0000","last_became_peered":"2024-09-16T07:45:50.681994+0000","last_unstale":"2024-09-16T07:47:48.685513+0000","last_undegraded":"2024-09-16T07:47:48.685513+0000","last_fullsized":"2024-09-16T07:47:48.685513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:17.388638+0000","last_clean_scrub_stamp":"2024-09-16T07:45:17.388638+0000","objects_scrubbed":0,"log_size":1079,"log_dups_size":0,"ondisk_log_size":1079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12713984,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1078,"num_write_kb":40704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":326696984,"num_objects":4986,"num_object_clones":0,"num_object_copies":14958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15022,"num_write_kb":640193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61591552,"data_stored":985268296,"data_compressed":46785808,"data_compressed_allocated":61579264,"data_compressed_original":985268224,"omap_allocated":0,"internal_metadata":0},"log_size":15034,"ondisk_log_size":15034,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48544,"kb_used_data":17552,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94323296,"statfs":{"total":96636764160,"available":96587055104,"internally_reserved":0,"allocated":17973248,"data_stored":282947643,"data_compressed":13433425,"data_compressed_allocated":17682432,"data_compressed_original":282836992,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47884,"kb_used_data":8316,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94323956,"statfs":{"total":96636764160,"available":96587730944,"internally_reserved":0,"allocated":8515584,"data_stored":130731497,"data_compressed":6204249,"data_compressed_allocated":8167424,"data_compressed_original":130596864,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54272,"kb_used_data":14960,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":15319040,"data_stored":240807470,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20852736,"data_stored":333578264,"data_compressed":15840080,"data_compressed_allocated":20848640,"data_compressed_original":333578240,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15048704,"data_stored":240713752,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8044544,"data_stored":128712704,"data_compressed":6111968,"data_compressed_allocated":8044544,"data_compressed_original":128712704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17645568,"data_stored":282263576,"data_compressed":13403384,"data_compressed_allocated":17641472,"data_compressed_original":282263552,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:03.517 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:03.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:03.657+0000 7f16f1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:03.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:03.668+0000 7f16f1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:04.282 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Removed 10015 objects 2024-09-16T07:48:04.282 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Clean up completed and total clean up time :73.7522 2024-09-16T07:48:04.392 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-16T07:48:04.392 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-16T07:48:04.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:04.504+0000 7f26db191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:04.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:04.517+0000 7f26db191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:04.984 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'unique_pool_0' removed 2024-09-16T07:48:05.004 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T07:48:05.005 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T07:48:05.006 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2024-09-16T07:48:05.006 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 16 2024-09-16T07:48:05.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:05.180+0000 7fe872991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:05.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:05.201+0000 7fe872991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:05.346 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:05.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:05.468+0000 7fe001c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:05.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:05.481+0000 7fe001c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:05.683 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:05.683 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:05.695 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-09-16T07:48:04.987271+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":199808,"kb_used_data":62080,"kb_used_omap":0,"kb_used_meta":137664,"kb_avail":377287552,"statfs":{"total":386547056640,"available":386342453248,"internally_reserved":0,"allocated":63569920,"data_stored":997989536,"data_compressed":47376963,"data_compressed_allocated":62361600,"data_compressed_original":997539840,"omap_allocated":0,"internal_metadata":140967936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-326696984,"num_objects":-4986,"num_object_clones":0,"num_object_copies":-14958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-15022,"num_write_kb":-640193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-17,"num_bytes_recovered":-1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.664835"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":135,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.972901+0000","last_change":"2024-09-16T07:46:35.698040+0000","last_active":"2024-09-16T07:46:45.972901+0000","last_peered":"2024-09-16T07:46:45.972901+0000","last_clean":"2024-09-16T07:46:45.972901+0000","last_became_active":"2024-09-16T07:46:35.689209+0000","last_became_peered":"2024-09-16T07:46:35.689209+0000","last_unstale":"2024-09-16T07:46:45.972901+0000","last_undegraded":"2024-09-16T07:46:45.972901+0000","last_fullsized":"2024-09-16T07:46:45.972901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.997567+0000","last_change":"2024-09-16T07:46:42.638063+0000","last_active":"2024-09-16T07:46:45.997567+0000","last_peered":"2024-09-16T07:46:45.997567+0000","last_clean":"2024-09-16T07:46:45.997567+0000","last_became_active":"2024-09-16T07:46:35.726033+0000","last_became_peered":"2024-09-16T07:46:35.726033+0000","last_unstale":"2024-09-16T07:46:45.997567+0000","last_undegraded":"2024-09-16T07:46:45.997567+0000","last_fullsized":"2024-09-16T07:46:45.997567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.024074+0000","last_change":"2024-09-16T07:46:42.629210+0000","last_active":"2024-09-16T07:46:46.024074+0000","last_peered":"2024-09-16T07:46:46.024074+0000","last_clean":"2024-09-16T07:46:46.024074+0000","last_became_active":"2024-09-16T07:46:35.780426+0000","last_became_peered":"2024-09-16T07:46:35.780426+0000","last_unstale":"2024-09-16T07:47:35.372252+0000","last_undegraded":"2024-09-16T07:46:46.024074+0000","last_fullsized":"2024-09-16T07:46:46.024074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.993249+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:46:45.993249+0000","last_peered":"2024-09-16T07:46:45.993249+0000","last_clean":"2024-09-16T07:46:45.993249+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:46:45.993249+0000","last_undegraded":"2024-09-16T07:46:45.993249+0000","last_fullsized":"2024-09-16T07:46:45.993249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":32,"state":"stale+active+clean","last_fresh":"2024-09-16T07:46:46.023044+0000","last_change":"2024-09-16T07:46:42.627933+0000","last_active":"2024-09-16T07:46:46.023044+0000","last_peered":"2024-09-16T07:46:46.023044+0000","last_clean":"2024-09-16T07:46:46.023044+0000","last_became_active":"2024-09-16T07:46:35.808505+0000","last_became_peered":"2024-09-16T07:46:35.808505+0000","last_unstale":"2024-09-16T07:47:35.372255+0000","last_undegraded":"2024-09-16T07:46:46.023044+0000","last_fullsized":"2024-09-16T07:46:46.023044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.422563+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:47:41.422563+0000","last_peered":"2024-09-16T07:47:41.422563+0000","last_clean":"2024-09-16T07:47:41.422563+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:47:41.422563+0000","last_undegraded":"2024-09-16T07:47:41.422563+0000","last_fullsized":"2024-09-16T07:47:41.422563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:45.975235+0000","last_change":"2024-09-16T07:46:42.648417+0000","last_active":"2024-09-16T07:46:45.975235+0000","last_peered":"2024-09-16T07:46:45.975235+0000","last_clean":"2024-09-16T07:46:45.975235+0000","last_became_active":"2024-09-16T07:46:35.738579+0000","last_became_peered":"2024-09-16T07:46:35.738579+0000","last_unstale":"2024-09-16T07:46:45.975235+0000","last_undegraded":"2024-09-16T07:46:45.975235+0000","last_fullsized":"2024-09-16T07:46:45.975235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.430508+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:47:41.430508+0000","last_peered":"2024-09-16T07:47:41.430508+0000","last_clean":"2024-09-16T07:47:41.430508+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:47:41.430508+0000","last_undegraded":"2024-09-16T07:47:41.430508+0000","last_fullsized":"2024-09-16T07:47:41.430508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-16T07:46:46.002968+0000","last_change":"2024-09-16T07:46:42.634142+0000","last_active":"2024-09-16T07:46:46.002968+0000","last_peered":"2024-09-16T07:46:46.002968+0000","last_clean":"2024-09-16T07:46:46.002968+0000","last_became_active":"2024-09-16T07:46:35.703326+0000","last_became_peered":"2024-09-16T07:46:35.703326+0000","last_unstale":"2024-09-16T07:46:46.002968+0000","last_undegraded":"2024-09-16T07:46:46.002968+0000","last_fullsized":"2024-09-16T07:46:46.002968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48544,"kb_used_data":17552,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94323296,"statfs":{"total":96636764160,"available":96587055104,"internally_reserved":0,"allocated":17973248,"data_stored":282947643,"data_compressed":13433425,"data_compressed_allocated":17682432,"data_compressed_original":282836992,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47884,"kb_used_data":8316,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94323956,"statfs":{"total":96636764160,"available":96587730944,"internally_reserved":0,"allocated":8515584,"data_stored":130731497,"data_compressed":6204249,"data_compressed_allocated":8167424,"data_compressed_original":130596864,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54272,"kb_used_data":14960,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":15319040,"data_stored":240807470,"data_compressed":11430376,"data_compressed_allocated":15044608,"data_compressed_original":240713728,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49108,"kb_used_data":21252,"kb_used_omap":0,"kb_used_meta":27840,"kb_avail":94322732,"statfs":{"total":96636764160,"available":96586477568,"internally_reserved":0,"allocated":21762048,"data_stored":343502926,"data_compressed":16308913,"data_compressed_allocated":21467136,"data_compressed_original":343392256,"omap_allocated":0,"internal_metadata":28508160},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:05.696 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:48:05.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:05.805+0000 7f156fed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:05.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:05.813+0000 7f156fed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:05.986 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'unique_pool_1' created 2024-09-16T07:48:06.006 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2024-09-16T07:48:06.056 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:06.124 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:06.125 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":188,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":41,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472856,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":19},{"state_name":"stale+active+clean","count":6}],"num_pgs":25,"num_pools":3,"num_objects":4990,"data_bytes":327287360,"bytes_used":204603392,"bytes_avail":386342453248,"bytes_total":386547056640},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:48:06.139 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:48:06.140 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:06.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:06.167+0000 7f02c5751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:06.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:06.185+0000 7f02c5751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:06.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:06.194+0000 7fdd7e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:06.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:06.202+0000 7fdd7e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:06.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:06.269+0000 7fbabecb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:06.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:06.278+0000 7fbabecb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:06.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:06.495 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:06.508 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-09-16T07:48:06.324783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":39,"acting":39,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":147836,"kb_used_data":9404,"kb_used_omap":0,"kb_used_meta":138368,"kb_avail":377339524,"statfs":{"total":386547056640,"available":386395672576,"internally_reserved":0,"allocated":9629696,"data_stored":132268590,"data_compressed":6264331,"data_compressed_allocated":8249344,"data_compressed_original":131743744,"omap_allocated":0,"internal_metadata":141688832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-326696984,"num_objects":-4986,"num_object_clones":0,"num_object_copies":-14958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-15022,"num_write_kb":-640193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-17,"num_bytes_recovered":-1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001641"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.076292+0000","last_change":"2024-09-16T07:48:06.076292+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.076292+0000","last_undegraded":"2024-09-16T07:48:06.076292+0000","last_fullsized":"2024-09-16T07:48:06.076292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.007831+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:05.007831+0000","last_peered":"2024-09-16T07:48:05.007831+0000","last_clean":"2024-09-16T07:48:05.007831+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:05.007831+0000","last_undegraded":"2024-09-16T07:48:05.007831+0000","last_fullsized":"2024-09-16T07:48:05.007831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":92,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.041128+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:05.041128+0000","last_peered":"2024-09-16T07:48:05.041128+0000","last_clean":"2024-09-16T07:48:05.041128+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:05.041128+0000","last_undegraded":"2024-09-16T07:48:05.041128+0000","last_fullsized":"2024-09-16T07:48:05.041128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.050936+0000","last_change":"2024-09-16T07:48:06.050936+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.050936+0000","last_undegraded":"2024-09-16T07:48:06.050936+0000","last_fullsized":"2024-09-16T07:48:06.050936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.007760+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:06.007760+0000","last_peered":"2024-09-16T07:48:06.007760+0000","last_clean":"2024-09-16T07:48:06.007760+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:06.007760+0000","last_undegraded":"2024-09-16T07:48:06.007760+0000","last_fullsized":"2024-09-16T07:48:06.007760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.002130+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:05.002130+0000","last_peered":"2024-09-16T07:48:05.002130+0000","last_clean":"2024-09-16T07:48:05.002130+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:05.002130+0000","last_undegraded":"2024-09-16T07:48:05.002130+0000","last_fullsized":"2024-09-16T07:48:05.002130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.006869+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:06.006869+0000","last_peered":"2024-09-16T07:48:06.006869+0000","last_clean":"2024-09-16T07:48:06.006869+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:06.006869+0000","last_undegraded":"2024-09-16T07:48:06.006869+0000","last_fullsized":"2024-09-16T07:48:06.006869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.422563+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:47:41.422563+0000","last_peered":"2024-09-16T07:47:41.422563+0000","last_clean":"2024-09-16T07:47:41.422563+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:47:41.422563+0000","last_undegraded":"2024-09-16T07:47:41.422563+0000","last_fullsized":"2024-09-16T07:47:41.422563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.035972+0000","last_change":"2024-09-16T07:48:06.035972+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.035972+0000","last_undegraded":"2024-09-16T07:48:06.035972+0000","last_fullsized":"2024-09-16T07:48:06.035972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.039578+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:05.039578+0000","last_peered":"2024-09-16T07:48:05.039578+0000","last_clean":"2024-09-16T07:48:05.039578+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:05.039578+0000","last_undegraded":"2024-09-16T07:48:05.039578+0000","last_fullsized":"2024-09-16T07:48:05.039578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.024375+0000","last_change":"2024-09-16T07:48:06.024375+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.024375+0000","last_undegraded":"2024-09-16T07:48:06.024375+0000","last_fullsized":"2024-09-16T07:48:06.024375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.430508+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:47:41.430508+0000","last_peered":"2024-09-16T07:47:41.430508+0000","last_clean":"2024-09-16T07:47:41.430508+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:47:41.430508+0000","last_undegraded":"2024-09-16T07:47:41.430508+0000","last_fullsized":"2024-09-16T07:47:41.430508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.028611+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:05.028611+0000","last_peered":"2024-09-16T07:48:05.028611+0000","last_clean":"2024-09-16T07:48:05.028611+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:05.028611+0000","last_undegraded":"2024-09-16T07:48:05.028611+0000","last_fullsized":"2024-09-16T07:48:05.028611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":385024,"data_stored":708054,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47884,"kb_used_data":8316,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94323956,"statfs":{"total":96636764160,"available":96587730944,"internally_reserved":0,"allocated":8515584,"data_stored":130731497,"data_compressed":6204249,"data_compressed_allocated":8167424,"data_compressed_original":130596864,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35472,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94336368,"statfs":{"total":96636764160,"available":96600440832,"internally_reserved":0,"allocated":327680,"data_stored":117705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33112,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":401408,"data_stored":711334,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:06.989 INFO:teuthology.orchestra.run.smithi003.stderr:enabled application 'rados' on pool 'unique_pool_1' 2024-09-16T07:48:08.010 DEBUG:teuthology.orchestra.run.smithi003:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_1 bench 90 write' 2024-09-16T07:48:08.013 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T07:48:08.013 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T07:48:08.087 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:hints = 1 2024-09-16T07:48:08.087 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T07:48:08.087 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Object prefix: benchmark_data_smithi003_36040 2024-09-16T07:48:08.088 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:48:08.088 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 0 0 0 0 0 0 - 0 2024-09-16T07:48:08.319 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:08.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:08.486+0000 7f190ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:08.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:08.496+0000 7f190ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:09.088 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 1 16 202 186 11.6244 11.625 0.106181 0.082213 2024-09-16T07:48:09.510 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:09.683+0000 7f515cc7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:09.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:09.696+0000 7f515cc7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:10.031 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:10.032 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:10.049 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2024-09-16T07:48:08.325173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":39,"acting":39,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":147836,"kb_used_data":9404,"kb_used_omap":0,"kb_used_meta":138368,"kb_avail":377339524,"statfs":{"total":386547056640,"available":386395672576,"internally_reserved":0,"allocated":9629696,"data_stored":132268590,"data_compressed":6264331,"data_compressed_allocated":8249344,"data_compressed_original":131743744,"omap_allocated":0,"internal_metadata":141688832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-326696984,"num_objects":-4986,"num_object_clones":0,"num_object_copies":-14958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-15022,"num_write_kb":-640193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-17,"num_bytes_recovered":-1114112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000777"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.076292+0000","last_change":"2024-09-16T07:48:06.076292+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.076292+0000","last_undegraded":"2024-09-16T07:48:06.076292+0000","last_fullsized":"2024-09-16T07:48:06.076292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.007831+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:05.007831+0000","last_peered":"2024-09-16T07:48:05.007831+0000","last_clean":"2024-09-16T07:48:05.007831+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:05.007831+0000","last_undegraded":"2024-09-16T07:48:05.007831+0000","last_fullsized":"2024-09-16T07:48:05.007831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":92,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.041128+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:05.041128+0000","last_peered":"2024-09-16T07:48:05.041128+0000","last_clean":"2024-09-16T07:48:05.041128+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:05.041128+0000","last_undegraded":"2024-09-16T07:48:05.041128+0000","last_fullsized":"2024-09-16T07:48:05.041128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.050936+0000","last_change":"2024-09-16T07:48:06.050936+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.050936+0000","last_undegraded":"2024-09-16T07:48:06.050936+0000","last_fullsized":"2024-09-16T07:48:06.050936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.007760+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:06.007760+0000","last_peered":"2024-09-16T07:48:06.007760+0000","last_clean":"2024-09-16T07:48:06.007760+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:06.007760+0000","last_undegraded":"2024-09-16T07:48:06.007760+0000","last_fullsized":"2024-09-16T07:48:06.007760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.002130+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:05.002130+0000","last_peered":"2024-09-16T07:48:05.002130+0000","last_clean":"2024-09-16T07:48:05.002130+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:05.002130+0000","last_undegraded":"2024-09-16T07:48:05.002130+0000","last_fullsized":"2024-09-16T07:48:05.002130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.006869+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:06.006869+0000","last_peered":"2024-09-16T07:48:06.006869+0000","last_clean":"2024-09-16T07:48:06.006869+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:06.006869+0000","last_undegraded":"2024-09-16T07:48:06.006869+0000","last_fullsized":"2024-09-16T07:48:06.006869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.422563+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:47:41.422563+0000","last_peered":"2024-09-16T07:47:41.422563+0000","last_clean":"2024-09-16T07:47:41.422563+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:47:41.422563+0000","last_undegraded":"2024-09-16T07:47:41.422563+0000","last_fullsized":"2024-09-16T07:47:41.422563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.035972+0000","last_change":"2024-09-16T07:48:06.035972+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.035972+0000","last_undegraded":"2024-09-16T07:48:06.035972+0000","last_fullsized":"2024-09-16T07:48:06.035972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.039578+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:05.039578+0000","last_peered":"2024-09-16T07:48:05.039578+0000","last_clean":"2024-09-16T07:48:05.039578+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:05.039578+0000","last_undegraded":"2024-09-16T07:48:05.039578+0000","last_fullsized":"2024-09-16T07:48:05.039578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.024375+0000","last_change":"2024-09-16T07:48:06.024375+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.024375+0000","last_undegraded":"2024-09-16T07:48:06.024375+0000","last_fullsized":"2024-09-16T07:48:06.024375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.430508+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:47:41.430508+0000","last_peered":"2024-09-16T07:47:41.430508+0000","last_clean":"2024-09-16T07:47:41.430508+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:47:41.430508+0000","last_undegraded":"2024-09-16T07:47:41.430508+0000","last_fullsized":"2024-09-16T07:47:41.430508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.028611+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:05.028611+0000","last_peered":"2024-09-16T07:48:05.028611+0000","last_clean":"2024-09-16T07:48:05.028611+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:05.028611+0000","last_undegraded":"2024-09-16T07:48:05.028611+0000","last_fullsized":"2024-09-16T07:48:05.028611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":385024,"data_stored":708054,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47884,"kb_used_data":8316,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94323956,"statfs":{"total":96636764160,"available":96587730944,"internally_reserved":0,"allocated":8515584,"data_stored":130731497,"data_compressed":6204249,"data_compressed_allocated":8167424,"data_compressed_original":130596864,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35472,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94336368,"statfs":{"total":96636764160,"available":96600440832,"internally_reserved":0,"allocated":327680,"data_stored":117705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33112,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":401408,"data_stored":711334,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:10.052 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:48:10.088 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 2 16 404 388 12.1241 12.625 0.0623514 0.080372 2024-09-16T07:48:10.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:10.210+0000 7f4e256d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:10.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:10.226+0000 7f4e256d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:10.692 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:10.692 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":192,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":43,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472856,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":12},{"state_name":"active+clean","count":9},{"state_name":"creating+peering","count":4}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590376,"bytes_used":151384064,"bytes_avail":386395672576,"bytes_total":386547056640,"unknown_pgs_ratio":0.47999998927116394,"inactive_pgs_ratio":0.15999999642372131},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:48:10.714 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:48:10.714 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:10.834 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:10.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:10.907+0000 7f3f85d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:10.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:10.930+0000 7f3f85d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:11.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:11.018+0000 7f9522efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:11.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:11.034+0000 7f9522efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:11.088 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 3 16 591 575 11.9781 11.6875 0.114253 0.0816583 2024-09-16T07:48:11.261 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:11.261 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:11.284 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-09-16T07:48:10.325671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":39,"acting":39,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":147836,"kb_used_data":9404,"kb_used_omap":0,"kb_used_meta":138368,"kb_avail":377339524,"statfs":{"total":386547056640,"available":386395672576,"internally_reserved":0,"allocated":9629696,"data_stored":132268590,"data_compressed":6264331,"data_compressed_allocated":8249344,"data_compressed_original":131743744,"omap_allocated":0,"internal_metadata":141688832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.338400"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.076292+0000","last_change":"2024-09-16T07:48:06.076292+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.076292+0000","last_undegraded":"2024-09-16T07:48:06.076292+0000","last_fullsized":"2024-09-16T07:48:06.076292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.007831+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:05.007831+0000","last_peered":"2024-09-16T07:48:05.007831+0000","last_clean":"2024-09-16T07:48:05.007831+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:05.007831+0000","last_undegraded":"2024-09-16T07:48:05.007831+0000","last_fullsized":"2024-09-16T07:48:05.007831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":92,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.041128+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:05.041128+0000","last_peered":"2024-09-16T07:48:05.041128+0000","last_clean":"2024-09-16T07:48:05.041128+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:05.041128+0000","last_undegraded":"2024-09-16T07:48:05.041128+0000","last_fullsized":"2024-09-16T07:48:05.041128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.050936+0000","last_change":"2024-09-16T07:48:06.050936+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.050936+0000","last_undegraded":"2024-09-16T07:48:06.050936+0000","last_fullsized":"2024-09-16T07:48:06.050936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.007760+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:06.007760+0000","last_peered":"2024-09-16T07:48:06.007760+0000","last_clean":"2024-09-16T07:48:06.007760+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:06.007760+0000","last_undegraded":"2024-09-16T07:48:06.007760+0000","last_fullsized":"2024-09-16T07:48:06.007760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.002130+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:05.002130+0000","last_peered":"2024-09-16T07:48:05.002130+0000","last_clean":"2024-09-16T07:48:05.002130+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:05.002130+0000","last_undegraded":"2024-09-16T07:48:05.002130+0000","last_fullsized":"2024-09-16T07:48:05.002130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.006869+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:06.006869+0000","last_peered":"2024-09-16T07:48:06.006869+0000","last_clean":"2024-09-16T07:48:06.006869+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:06.006869+0000","last_undegraded":"2024-09-16T07:48:06.006869+0000","last_fullsized":"2024-09-16T07:48:06.006869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.422563+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:47:41.422563+0000","last_peered":"2024-09-16T07:47:41.422563+0000","last_clean":"2024-09-16T07:47:41.422563+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:47:41.422563+0000","last_undegraded":"2024-09-16T07:47:41.422563+0000","last_fullsized":"2024-09-16T07:47:41.422563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.035972+0000","last_change":"2024-09-16T07:48:06.035972+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.035972+0000","last_undegraded":"2024-09-16T07:48:06.035972+0000","last_fullsized":"2024-09-16T07:48:06.035972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.039578+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:05.039578+0000","last_peered":"2024-09-16T07:48:05.039578+0000","last_clean":"2024-09-16T07:48:05.039578+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:05.039578+0000","last_undegraded":"2024-09-16T07:48:05.039578+0000","last_fullsized":"2024-09-16T07:48:05.039578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.024375+0000","last_change":"2024-09-16T07:48:06.024375+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.024375+0000","last_undegraded":"2024-09-16T07:48:06.024375+0000","last_fullsized":"2024-09-16T07:48:06.024375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.430508+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:47:41.430508+0000","last_peered":"2024-09-16T07:47:41.430508+0000","last_clean":"2024-09-16T07:47:41.430508+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:47:41.430508+0000","last_undegraded":"2024-09-16T07:47:41.430508+0000","last_fullsized":"2024-09-16T07:47:41.430508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.028611+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:05.028611+0000","last_peered":"2024-09-16T07:48:05.028611+0000","last_clean":"2024-09-16T07:48:05.028611+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:05.028611+0000","last_undegraded":"2024-09-16T07:48:05.028611+0000","last_fullsized":"2024-09-16T07:48:05.028611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":385024,"data_stored":708054,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47884,"kb_used_data":8316,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94323956,"statfs":{"total":96636764160,"available":96587730944,"internally_reserved":0,"allocated":8515584,"data_stored":130731497,"data_compressed":6204249,"data_compressed_allocated":8167424,"data_compressed_original":130596864,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35472,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94336368,"statfs":{"total":96636764160,"available":96600440832,"internally_reserved":0,"allocated":327680,"data_stored":117705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33112,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":401408,"data_stored":711334,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:12.088 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 4 16 794 778 12.1552 12.6875 0.0792671 0.08112 2024-09-16T07:48:13.088 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 5 16 1001 985 12.3114 12.9375 0.133092 0.0800182 2024-09-16T07:48:13.468 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:13.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:13.639+0000 7fa8164c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:13.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:13.647+0000 7fa8164c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:14.088 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 6 16 1171 1155 12.0302 10.625 0.0795731 0.0824983 2024-09-16T07:48:14.286 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:14.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:14.444+0000 7fadc7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:14.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:14.461+0000 7fadc7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:14.845 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:14.845 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:14.864 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-16T07:48:14.326499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":39,"acting":39,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":147836,"kb_used_data":9404,"kb_used_omap":0,"kb_used_meta":138368,"kb_avail":377339524,"statfs":{"total":386547056640,"available":386395672576,"internally_reserved":0,"allocated":9629696,"data_stored":132268590,"data_compressed":6264331,"data_compressed_allocated":8249344,"data_compressed_original":131743744,"omap_allocated":0,"internal_metadata":141688832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001716"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.076292+0000","last_change":"2024-09-16T07:48:06.076292+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.076292+0000","last_undegraded":"2024-09-16T07:48:06.076292+0000","last_fullsized":"2024-09-16T07:48:06.076292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.007831+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:05.007831+0000","last_peered":"2024-09-16T07:48:05.007831+0000","last_clean":"2024-09-16T07:48:05.007831+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:05.007831+0000","last_undegraded":"2024-09-16T07:48:05.007831+0000","last_fullsized":"2024-09-16T07:48:05.007831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":92,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.041128+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:05.041128+0000","last_peered":"2024-09-16T07:48:05.041128+0000","last_clean":"2024-09-16T07:48:05.041128+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:05.041128+0000","last_undegraded":"2024-09-16T07:48:05.041128+0000","last_fullsized":"2024-09-16T07:48:05.041128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.050936+0000","last_change":"2024-09-16T07:48:06.050936+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.050936+0000","last_undegraded":"2024-09-16T07:48:06.050936+0000","last_fullsized":"2024-09-16T07:48:06.050936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.007760+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:06.007760+0000","last_peered":"2024-09-16T07:48:06.007760+0000","last_clean":"2024-09-16T07:48:06.007760+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:06.007760+0000","last_undegraded":"2024-09-16T07:48:06.007760+0000","last_fullsized":"2024-09-16T07:48:06.007760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.002130+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:05.002130+0000","last_peered":"2024-09-16T07:48:05.002130+0000","last_clean":"2024-09-16T07:48:05.002130+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:05.002130+0000","last_undegraded":"2024-09-16T07:48:05.002130+0000","last_fullsized":"2024-09-16T07:48:05.002130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.006869+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:06.006869+0000","last_peered":"2024-09-16T07:48:06.006869+0000","last_clean":"2024-09-16T07:48:06.006869+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:06.006869+0000","last_undegraded":"2024-09-16T07:48:06.006869+0000","last_fullsized":"2024-09-16T07:48:06.006869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.422563+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:47:41.422563+0000","last_peered":"2024-09-16T07:47:41.422563+0000","last_clean":"2024-09-16T07:47:41.422563+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:47:41.422563+0000","last_undegraded":"2024-09-16T07:47:41.422563+0000","last_fullsized":"2024-09-16T07:47:41.422563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.035972+0000","last_change":"2024-09-16T07:48:06.035972+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.035972+0000","last_undegraded":"2024-09-16T07:48:06.035972+0000","last_fullsized":"2024-09-16T07:48:06.035972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.039578+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:05.039578+0000","last_peered":"2024-09-16T07:48:05.039578+0000","last_clean":"2024-09-16T07:48:05.039578+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:05.039578+0000","last_undegraded":"2024-09-16T07:48:05.039578+0000","last_fullsized":"2024-09-16T07:48:05.039578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.024375+0000","last_change":"2024-09-16T07:48:06.024375+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.024375+0000","last_undegraded":"2024-09-16T07:48:06.024375+0000","last_fullsized":"2024-09-16T07:48:06.024375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.430508+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:47:41.430508+0000","last_peered":"2024-09-16T07:47:41.430508+0000","last_clean":"2024-09-16T07:47:41.430508+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:47:41.430508+0000","last_undegraded":"2024-09-16T07:47:41.430508+0000","last_fullsized":"2024-09-16T07:47:41.430508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.028611+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:05.028611+0000","last_peered":"2024-09-16T07:48:05.028611+0000","last_clean":"2024-09-16T07:48:05.028611+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:05.028611+0000","last_undegraded":"2024-09-16T07:48:05.028611+0000","last_fullsized":"2024-09-16T07:48:05.028611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":385024,"data_stored":708054,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47884,"kb_used_data":8316,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94323956,"statfs":{"total":96636764160,"available":96587730944,"internally_reserved":0,"allocated":8515584,"data_stored":130731497,"data_compressed":6204249,"data_compressed_allocated":8167424,"data_compressed_original":130596864,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35472,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94336368,"statfs":{"total":96636764160,"available":96600440832,"internally_reserved":0,"allocated":327680,"data_stored":117705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33112,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":401408,"data_stored":711334,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:14.866 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:48:15.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:15.035+0000 7f859f551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:15.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:15.048+0000 7f859f551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:15.088 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 7 16 1355 1339 11.9543 11.5 0.0546467 0.0831992 2024-09-16T07:48:15.478 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:15.479 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":197,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":43,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472856,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":12},{"state_name":"active+clean","count":9},{"state_name":"creating+peering","count":4}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590376,"bytes_used":151384064,"bytes_avail":386395672576,"bytes_total":386547056640,"unknown_pgs_ratio":0.47999998927116394,"inactive_pgs_ratio":0.15999999642372131},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:48:15.499 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:48:15.500 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:15.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:15.657+0000 7f2a4e45c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:15.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:15.670+0000 7f2a4e45c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:15.989 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:16.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:16.031 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:16.051 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-16T07:48:14.326499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":39,"acting":39,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":147836,"kb_used_data":9404,"kb_used_omap":0,"kb_used_meta":138368,"kb_avail":377339524,"statfs":{"total":386547056640,"available":386395672576,"internally_reserved":0,"allocated":9629696,"data_stored":132268590,"data_compressed":6264331,"data_compressed_allocated":8249344,"data_compressed_original":131743744,"omap_allocated":0,"internal_metadata":141688832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001716"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.076292+0000","last_change":"2024-09-16T07:48:06.076292+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.076292+0000","last_undegraded":"2024-09-16T07:48:06.076292+0000","last_fullsized":"2024-09-16T07:48:06.076292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.007831+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:05.007831+0000","last_peered":"2024-09-16T07:48:05.007831+0000","last_clean":"2024-09-16T07:48:05.007831+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:05.007831+0000","last_undegraded":"2024-09-16T07:48:05.007831+0000","last_fullsized":"2024-09-16T07:48:05.007831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":92,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.041128+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:05.041128+0000","last_peered":"2024-09-16T07:48:05.041128+0000","last_clean":"2024-09-16T07:48:05.041128+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:05.041128+0000","last_undegraded":"2024-09-16T07:48:05.041128+0000","last_fullsized":"2024-09-16T07:48:05.041128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.050936+0000","last_change":"2024-09-16T07:48:06.050936+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.050936+0000","last_undegraded":"2024-09-16T07:48:06.050936+0000","last_fullsized":"2024-09-16T07:48:06.050936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.007760+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:06.007760+0000","last_peered":"2024-09-16T07:48:06.007760+0000","last_clean":"2024-09-16T07:48:06.007760+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:06.007760+0000","last_undegraded":"2024-09-16T07:48:06.007760+0000","last_fullsized":"2024-09-16T07:48:06.007760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.002130+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:05.002130+0000","last_peered":"2024-09-16T07:48:05.002130+0000","last_clean":"2024-09-16T07:48:05.002130+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:05.002130+0000","last_undegraded":"2024-09-16T07:48:05.002130+0000","last_fullsized":"2024-09-16T07:48:05.002130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.006869+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:06.006869+0000","last_peered":"2024-09-16T07:48:06.006869+0000","last_clean":"2024-09-16T07:48:06.006869+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:06.006869+0000","last_undegraded":"2024-09-16T07:48:06.006869+0000","last_fullsized":"2024-09-16T07:48:06.006869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.422563+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:47:41.422563+0000","last_peered":"2024-09-16T07:47:41.422563+0000","last_clean":"2024-09-16T07:47:41.422563+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:47:41.422563+0000","last_undegraded":"2024-09-16T07:47:41.422563+0000","last_fullsized":"2024-09-16T07:47:41.422563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.035972+0000","last_change":"2024-09-16T07:48:06.035972+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.035972+0000","last_undegraded":"2024-09-16T07:48:06.035972+0000","last_fullsized":"2024-09-16T07:48:06.035972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.039578+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:05.039578+0000","last_peered":"2024-09-16T07:48:05.039578+0000","last_clean":"2024-09-16T07:48:05.039578+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:05.039578+0000","last_undegraded":"2024-09-16T07:48:05.039578+0000","last_fullsized":"2024-09-16T07:48:05.039578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.024375+0000","last_change":"2024-09-16T07:48:06.024375+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.024375+0000","last_undegraded":"2024-09-16T07:48:06.024375+0000","last_fullsized":"2024-09-16T07:48:06.024375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.430508+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:47:41.430508+0000","last_peered":"2024-09-16T07:47:41.430508+0000","last_clean":"2024-09-16T07:47:41.430508+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:47:41.430508+0000","last_undegraded":"2024-09-16T07:47:41.430508+0000","last_fullsized":"2024-09-16T07:47:41.430508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.028611+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:05.028611+0000","last_peered":"2024-09-16T07:48:05.028611+0000","last_clean":"2024-09-16T07:48:05.028611+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:05.028611+0000","last_undegraded":"2024-09-16T07:48:05.028611+0000","last_fullsized":"2024-09-16T07:48:05.028611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":385024,"data_stored":708054,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47884,"kb_used_data":8316,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94323956,"statfs":{"total":96636764160,"available":96587730944,"internally_reserved":0,"allocated":8515584,"data_stored":130731497,"data_compressed":6204249,"data_compressed_allocated":8167424,"data_compressed_original":130596864,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35472,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94336368,"statfs":{"total":96636764160,"available":96600440832,"internally_reserved":0,"allocated":327680,"data_stored":117705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33112,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":401408,"data_stored":711334,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:16.088 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 8 16 1542 1526 11.9208 11.6875 0.0967379 0.083459 2024-09-16T07:48:16.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:16.143+0000 7f488fd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:16.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:16.154+0000 7f488fd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:17.088 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 9 16 1740 1724 11.9712 12.375 0.0500725 0.0831606 2024-09-16T07:48:18.088 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 10 16 1935 1919 11.9927 12.1875 0.097068 0.0829683 2024-09-16T07:48:18.585 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:18.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:18.740+0000 7fb4e42d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:18.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:18.750+0000 7fb4e42d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:19.053 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:19.088 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 11 16 2121 2105 11.9592 11.625 0.13753 0.0830056 2024-09-16T07:48:19.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:19.231+0000 7f226ec88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:19.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:19.244+0000 7f226ec88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:19.616 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:19.617 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:19.638 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-09-16T07:48:18.327279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":39,"acting":39,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":147836,"kb_used_data":9404,"kb_used_omap":0,"kb_used_meta":138368,"kb_avail":377339524,"statfs":{"total":386547056640,"available":386395672576,"internally_reserved":0,"allocated":9629696,"data_stored":132268590,"data_compressed":6264331,"data_compressed_allocated":8249344,"data_compressed_original":131743744,"omap_allocated":0,"internal_metadata":141688832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.329725"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.076292+0000","last_change":"2024-09-16T07:48:06.076292+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.076292+0000","last_undegraded":"2024-09-16T07:48:06.076292+0000","last_fullsized":"2024-09-16T07:48:06.076292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.007831+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:05.007831+0000","last_peered":"2024-09-16T07:48:05.007831+0000","last_clean":"2024-09-16T07:48:05.007831+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:05.007831+0000","last_undegraded":"2024-09-16T07:48:05.007831+0000","last_fullsized":"2024-09-16T07:48:05.007831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":92,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.041128+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:05.041128+0000","last_peered":"2024-09-16T07:48:05.041128+0000","last_clean":"2024-09-16T07:48:05.041128+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:05.041128+0000","last_undegraded":"2024-09-16T07:48:05.041128+0000","last_fullsized":"2024-09-16T07:48:05.041128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.050936+0000","last_change":"2024-09-16T07:48:06.050936+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.050936+0000","last_undegraded":"2024-09-16T07:48:06.050936+0000","last_fullsized":"2024-09-16T07:48:06.050936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.007760+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:06.007760+0000","last_peered":"2024-09-16T07:48:06.007760+0000","last_clean":"2024-09-16T07:48:06.007760+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:06.007760+0000","last_undegraded":"2024-09-16T07:48:06.007760+0000","last_fullsized":"2024-09-16T07:48:06.007760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.002130+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:05.002130+0000","last_peered":"2024-09-16T07:48:05.002130+0000","last_clean":"2024-09-16T07:48:05.002130+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:05.002130+0000","last_undegraded":"2024-09-16T07:48:05.002130+0000","last_fullsized":"2024-09-16T07:48:05.002130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.006869+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:06.006869+0000","last_peered":"2024-09-16T07:48:06.006869+0000","last_clean":"2024-09-16T07:48:06.006869+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:06.006869+0000","last_undegraded":"2024-09-16T07:48:06.006869+0000","last_fullsized":"2024-09-16T07:48:06.006869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.422563+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:47:41.422563+0000","last_peered":"2024-09-16T07:47:41.422563+0000","last_clean":"2024-09-16T07:47:41.422563+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:47:41.422563+0000","last_undegraded":"2024-09-16T07:47:41.422563+0000","last_fullsized":"2024-09-16T07:47:41.422563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.035972+0000","last_change":"2024-09-16T07:48:06.035972+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.035972+0000","last_undegraded":"2024-09-16T07:48:06.035972+0000","last_fullsized":"2024-09-16T07:48:06.035972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.039578+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:05.039578+0000","last_peered":"2024-09-16T07:48:05.039578+0000","last_clean":"2024-09-16T07:48:05.039578+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:05.039578+0000","last_undegraded":"2024-09-16T07:48:05.039578+0000","last_fullsized":"2024-09-16T07:48:05.039578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.024375+0000","last_change":"2024-09-16T07:48:06.024375+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.024375+0000","last_undegraded":"2024-09-16T07:48:06.024375+0000","last_fullsized":"2024-09-16T07:48:06.024375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-16T07:47:41.430508+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:47:41.430508+0000","last_peered":"2024-09-16T07:47:41.430508+0000","last_clean":"2024-09-16T07:47:41.430508+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:47:41.430508+0000","last_undegraded":"2024-09-16T07:47:41.430508+0000","last_fullsized":"2024-09-16T07:47:41.430508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.028611+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:05.028611+0000","last_peered":"2024-09-16T07:48:05.028611+0000","last_clean":"2024-09-16T07:48:05.028611+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:05.028611+0000","last_undegraded":"2024-09-16T07:48:05.028611+0000","last_fullsized":"2024-09-16T07:48:05.028611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":385024,"data_stored":708054,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47884,"kb_used_data":8316,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94323956,"statfs":{"total":96636764160,"available":96587730944,"internally_reserved":0,"allocated":8515584,"data_stored":130731497,"data_compressed":6204249,"data_compressed_allocated":8167424,"data_compressed_original":130596864,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35472,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94336368,"statfs":{"total":96636764160,"available":96600440832,"internally_reserved":0,"allocated":327680,"data_stored":117705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33112,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":401408,"data_stored":711334,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:19.640 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:48:19.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:19.797+0000 7fd9a6151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:19.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:19.809+0000 7fd9a6151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:20.089 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 12 16 2297 2281 11.8792 11 0.100965 0.0838433 2024-09-16T07:48:20.190 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:20.191 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":202,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":43,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472856,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":12},{"state_name":"active+clean","count":9},{"state_name":"creating+peering","count":4}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590376,"bytes_used":151384064,"bytes_avail":386395672576,"bytes_total":386547056640,"unknown_pgs_ratio":0.47999998927116394,"inactive_pgs_ratio":0.15999999642372131},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:48:20.213 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:48:20.213 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:20.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:20.391+0000 7f0e30391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:20.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:20.406+0000 7f0e30391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:20.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:20.762 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:20.778 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-16T07:48:20.327601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36569640,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":629,"num_write_kb":36243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":604,"ondisk_log_size":604,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":145084,"kb_used_data":6652,"kb_used_omap":0,"kb_used_meta":138368,"kb_avail":377342276,"statfs":{"total":386547056640,"available":386398490624,"internally_reserved":0,"allocated":6811648,"data_stored":86604105,"data_compressed":4094550,"data_compressed_allocated":5394432,"data_compressed_original":86065152,"omap_allocated":0,"internal_metadata":141688832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002428"},"pg_stats":[{"pgid":"4.f","version":"43'133","reported_seq":145,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.697957+0000","last_change":"2024-09-16T07:48:07.143237+0000","last_active":"2024-09-16T07:48:18.697957+0000","last_peered":"2024-09-16T07:48:18.697957+0000","last_clean":"2024-09-16T07:48:18.697957+0000","last_became_active":"2024-09-16T07:48:07.134157+0000","last_became_peered":"2024-09-16T07:48:07.134157+0000","last_unstale":"2024-09-16T07:48:18.697957+0000","last_undegraded":"2024-09-16T07:48:18.697957+0000","last_fullsized":"2024-09-16T07:48:18.697957+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"43'138","reported_seq":150,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.638770+0000","last_change":"2024-09-16T07:48:07.121004+0000","last_active":"2024-09-16T07:48:18.638770+0000","last_peered":"2024-09-16T07:48:18.638770+0000","last_clean":"2024-09-16T07:48:18.638770+0000","last_became_active":"2024-09-16T07:48:07.113500+0000","last_became_peered":"2024-09-16T07:48:07.113500+0000","last_unstale":"2024-09-16T07:48:18.638770+0000","last_undegraded":"2024-09-16T07:48:18.638770+0000","last_fullsized":"2024-09-16T07:48:18.638770+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.076292+0000","last_change":"2024-09-16T07:48:06.076292+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.076292+0000","last_undegraded":"2024-09-16T07:48:06.076292+0000","last_fullsized":"2024-09-16T07:48:06.076292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.007831+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:05.007831+0000","last_peered":"2024-09-16T07:48:05.007831+0000","last_clean":"2024-09-16T07:48:05.007831+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:05.007831+0000","last_undegraded":"2024-09-16T07:48:05.007831+0000","last_fullsized":"2024-09-16T07:48:05.007831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":92,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.041128+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:05.041128+0000","last_peered":"2024-09-16T07:48:05.041128+0000","last_clean":"2024-09-16T07:48:05.041128+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:05.041128+0000","last_undegraded":"2024-09-16T07:48:05.041128+0000","last_fullsized":"2024-09-16T07:48:05.041128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.050936+0000","last_change":"2024-09-16T07:48:06.050936+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.050936+0000","last_undegraded":"2024-09-16T07:48:06.050936+0000","last_fullsized":"2024-09-16T07:48:06.050936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.007760+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:06.007760+0000","last_peered":"2024-09-16T07:48:06.007760+0000","last_clean":"2024-09-16T07:48:06.007760+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:06.007760+0000","last_undegraded":"2024-09-16T07:48:06.007760+0000","last_fullsized":"2024-09-16T07:48:06.007760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"43'146","reported_seq":158,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.685399+0000","last_change":"2024-09-16T07:48:07.167154+0000","last_active":"2024-09-16T07:48:18.685399+0000","last_peered":"2024-09-16T07:48:18.685399+0000","last_clean":"2024-09-16T07:48:18.685399+0000","last_became_active":"2024-09-16T07:48:07.158060+0000","last_became_peered":"2024-09-16T07:48:07.158060+0000","last_unstale":"2024-09-16T07:48:18.685399+0000","last_undegraded":"2024-09-16T07:48:18.685399+0000","last_fullsized":"2024-09-16T07:48:18.685399+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.002130+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:05.002130+0000","last_peered":"2024-09-16T07:48:05.002130+0000","last_clean":"2024-09-16T07:48:05.002130+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:05.002130+0000","last_undegraded":"2024-09-16T07:48:05.002130+0000","last_fullsized":"2024-09-16T07:48:05.002130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"43'132","reported_seq":144,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.723482+0000","last_change":"2024-09-16T07:48:07.107086+0000","last_active":"2024-09-16T07:48:18.723482+0000","last_peered":"2024-09-16T07:48:18.723482+0000","last_clean":"2024-09-16T07:48:18.723482+0000","last_became_active":"2024-09-16T07:48:07.099520+0000","last_became_peered":"2024-09-16T07:48:07.099520+0000","last_unstale":"2024-09-16T07:48:18.723482+0000","last_undegraded":"2024-09-16T07:48:18.723482+0000","last_fullsized":"2024-09-16T07:48:18.723482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.006869+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:06.006869+0000","last_peered":"2024-09-16T07:48:06.006869+0000","last_clean":"2024-09-16T07:48:06.006869+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:06.006869+0000","last_undegraded":"2024-09-16T07:48:06.006869+0000","last_fullsized":"2024-09-16T07:48:06.006869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.008538+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:48:08.008538+0000","last_peered":"2024-09-16T07:48:08.008538+0000","last_clean":"2024-09-16T07:48:08.008538+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:48:08.008538+0000","last_undegraded":"2024-09-16T07:48:08.008538+0000","last_fullsized":"2024-09-16T07:48:08.008538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.035972+0000","last_change":"2024-09-16T07:48:06.035972+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.035972+0000","last_undegraded":"2024-09-16T07:48:06.035972+0000","last_fullsized":"2024-09-16T07:48:06.035972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.039578+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:05.039578+0000","last_peered":"2024-09-16T07:48:05.039578+0000","last_clean":"2024-09-16T07:48:05.039578+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:05.039578+0000","last_undegraded":"2024-09-16T07:48:05.039578+0000","last_fullsized":"2024-09-16T07:48:05.039578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.024375+0000","last_change":"2024-09-16T07:48:06.024375+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.024375+0000","last_undegraded":"2024-09-16T07:48:06.024375+0000","last_fullsized":"2024-09-16T07:48:06.024375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.018574+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:48:08.018574+0000","last_peered":"2024-09-16T07:48:08.018574+0000","last_clean":"2024-09-16T07:48:08.018574+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:48:08.018574+0000","last_undegraded":"2024-09-16T07:48:08.018574+0000","last_fullsized":"2024-09-16T07:48:08.018574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.028611+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:05.028611+0000","last_peered":"2024-09-16T07:48:05.028611+0000","last_clean":"2024-09-16T07:48:05.028611+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:05.028611+0000","last_undegraded":"2024-09-16T07:48:05.028611+0000","last_fullsized":"2024-09-16T07:48:05.028611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":385024,"data_stored":708054,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45132,"kb_used_data":5564,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94326708,"statfs":{"total":96636764160,"available":96590548992,"internally_reserved":0,"allocated":5697536,"data_stored":85067012,"data_compressed":4034468,"data_compressed_allocated":5312512,"data_compressed_original":84918272,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35472,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94336368,"statfs":{"total":96636764160,"available":96600440832,"internally_reserved":0,"allocated":327680,"data_stored":117705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33112,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":401408,"data_stored":711334,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:21.089 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 13 16 2484 2468 11.8643 11.6875 0.125206 0.0840512 2024-09-16T07:48:21.105 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:21.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:21.269+0000 7f69e9f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:21.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:21.279+0000 7f69e9f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:22.089 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 14 16 2682 2666 11.9007 12.375 0.0888025 0.0838017 2024-09-16T07:48:23.089 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 15 16 2874 2858 11.9073 12 0.0340568 0.0837031 2024-09-16T07:48:23.675 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:23.780 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:23.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:23.830+0000 7f6b136d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:23.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:23.843+0000 7f6b136d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:23.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:23.961+0000 7fd07e708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:23.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:23.977+0000 7fd07e708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:24.089 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 16 16 3060 3044 11.8896 11.625 0.0621237 0.0838493 2024-09-16T07:48:24.293 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:24.293 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:24.311 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-09-16T07:48:22.327991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36569640,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":629,"num_write_kb":36243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":604,"ondisk_log_size":604,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":145084,"kb_used_data":6652,"kb_used_omap":0,"kb_used_meta":138368,"kb_avail":377342276,"statfs":{"total":386547056640,"available":386398490624,"internally_reserved":0,"allocated":6811648,"data_stored":86604105,"data_compressed":4094550,"data_compressed_allocated":5394432,"data_compressed_original":86065152,"omap_allocated":0,"internal_metadata":141688832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002319"},"pg_stats":[{"pgid":"4.f","version":"43'133","reported_seq":145,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.697957+0000","last_change":"2024-09-16T07:48:07.143237+0000","last_active":"2024-09-16T07:48:18.697957+0000","last_peered":"2024-09-16T07:48:18.697957+0000","last_clean":"2024-09-16T07:48:18.697957+0000","last_became_active":"2024-09-16T07:48:07.134157+0000","last_became_peered":"2024-09-16T07:48:07.134157+0000","last_unstale":"2024-09-16T07:48:18.697957+0000","last_undegraded":"2024-09-16T07:48:18.697957+0000","last_fullsized":"2024-09-16T07:48:18.697957+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"43'138","reported_seq":150,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.638770+0000","last_change":"2024-09-16T07:48:07.121004+0000","last_active":"2024-09-16T07:48:18.638770+0000","last_peered":"2024-09-16T07:48:18.638770+0000","last_clean":"2024-09-16T07:48:18.638770+0000","last_became_active":"2024-09-16T07:48:07.113500+0000","last_became_peered":"2024-09-16T07:48:07.113500+0000","last_unstale":"2024-09-16T07:48:18.638770+0000","last_undegraded":"2024-09-16T07:48:18.638770+0000","last_fullsized":"2024-09-16T07:48:18.638770+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.076292+0000","last_change":"2024-09-16T07:48:06.076292+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.076292+0000","last_undegraded":"2024-09-16T07:48:06.076292+0000","last_fullsized":"2024-09-16T07:48:06.076292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.007831+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:05.007831+0000","last_peered":"2024-09-16T07:48:05.007831+0000","last_clean":"2024-09-16T07:48:05.007831+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:05.007831+0000","last_undegraded":"2024-09-16T07:48:05.007831+0000","last_fullsized":"2024-09-16T07:48:05.007831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":92,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.041128+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:05.041128+0000","last_peered":"2024-09-16T07:48:05.041128+0000","last_clean":"2024-09-16T07:48:05.041128+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:05.041128+0000","last_undegraded":"2024-09-16T07:48:05.041128+0000","last_fullsized":"2024-09-16T07:48:05.041128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.050936+0000","last_change":"2024-09-16T07:48:06.050936+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.050936+0000","last_undegraded":"2024-09-16T07:48:06.050936+0000","last_fullsized":"2024-09-16T07:48:06.050936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.007760+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:06.007760+0000","last_peered":"2024-09-16T07:48:06.007760+0000","last_clean":"2024-09-16T07:48:06.007760+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:06.007760+0000","last_undegraded":"2024-09-16T07:48:06.007760+0000","last_fullsized":"2024-09-16T07:48:06.007760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"43'146","reported_seq":158,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.685399+0000","last_change":"2024-09-16T07:48:07.167154+0000","last_active":"2024-09-16T07:48:18.685399+0000","last_peered":"2024-09-16T07:48:18.685399+0000","last_clean":"2024-09-16T07:48:18.685399+0000","last_became_active":"2024-09-16T07:48:07.158060+0000","last_became_peered":"2024-09-16T07:48:07.158060+0000","last_unstale":"2024-09-16T07:48:18.685399+0000","last_undegraded":"2024-09-16T07:48:18.685399+0000","last_fullsized":"2024-09-16T07:48:18.685399+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.002130+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:05.002130+0000","last_peered":"2024-09-16T07:48:05.002130+0000","last_clean":"2024-09-16T07:48:05.002130+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:05.002130+0000","last_undegraded":"2024-09-16T07:48:05.002130+0000","last_fullsized":"2024-09-16T07:48:05.002130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"43'132","reported_seq":144,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.723482+0000","last_change":"2024-09-16T07:48:07.107086+0000","last_active":"2024-09-16T07:48:18.723482+0000","last_peered":"2024-09-16T07:48:18.723482+0000","last_clean":"2024-09-16T07:48:18.723482+0000","last_became_active":"2024-09-16T07:48:07.099520+0000","last_became_peered":"2024-09-16T07:48:07.099520+0000","last_unstale":"2024-09-16T07:48:18.723482+0000","last_undegraded":"2024-09-16T07:48:18.723482+0000","last_fullsized":"2024-09-16T07:48:18.723482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.006869+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:06.006869+0000","last_peered":"2024-09-16T07:48:06.006869+0000","last_clean":"2024-09-16T07:48:06.006869+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:06.006869+0000","last_undegraded":"2024-09-16T07:48:06.006869+0000","last_fullsized":"2024-09-16T07:48:06.006869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.008538+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:48:08.008538+0000","last_peered":"2024-09-16T07:48:08.008538+0000","last_clean":"2024-09-16T07:48:08.008538+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:48:08.008538+0000","last_undegraded":"2024-09-16T07:48:08.008538+0000","last_fullsized":"2024-09-16T07:48:08.008538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.035972+0000","last_change":"2024-09-16T07:48:06.035972+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.035972+0000","last_undegraded":"2024-09-16T07:48:06.035972+0000","last_fullsized":"2024-09-16T07:48:06.035972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.039578+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:05.039578+0000","last_peered":"2024-09-16T07:48:05.039578+0000","last_clean":"2024-09-16T07:48:05.039578+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:05.039578+0000","last_undegraded":"2024-09-16T07:48:05.039578+0000","last_fullsized":"2024-09-16T07:48:05.039578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.024375+0000","last_change":"2024-09-16T07:48:06.024375+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.024375+0000","last_undegraded":"2024-09-16T07:48:06.024375+0000","last_fullsized":"2024-09-16T07:48:06.024375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.018574+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:48:08.018574+0000","last_peered":"2024-09-16T07:48:08.018574+0000","last_clean":"2024-09-16T07:48:08.018574+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:48:08.018574+0000","last_undegraded":"2024-09-16T07:48:08.018574+0000","last_fullsized":"2024-09-16T07:48:08.018574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.028611+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:05.028611+0000","last_peered":"2024-09-16T07:48:05.028611+0000","last_clean":"2024-09-16T07:48:05.028611+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:05.028611+0000","last_undegraded":"2024-09-16T07:48:05.028611+0000","last_fullsized":"2024-09-16T07:48:05.028611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":385024,"data_stored":708054,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45132,"kb_used_data":5564,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94326708,"statfs":{"total":96636764160,"available":96590548992,"internally_reserved":0,"allocated":5697536,"data_stored":85067012,"data_compressed":4034468,"data_compressed_allocated":5312512,"data_compressed_original":84918272,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35472,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94336368,"statfs":{"total":96636764160,"available":96600440832,"internally_reserved":0,"allocated":327680,"data_stored":117705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33112,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":401408,"data_stored":711334,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:24.313 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:48:24.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:24.506+0000 7fa0ed391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:24.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:24.521+0000 7fa0ed391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:25.030 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:25.031 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":207,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":43,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472856,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":13},{"state_name":"unknown","count":8},{"state_name":"creating+peering","count":4}],"num_pgs":25,"num_pools":3,"num_objects":553,"data_bytes":36569640,"bytes_used":148566016,"bytes_avail":386398490624,"bytes_total":386547056640,"unknown_pgs_ratio":0.31999999284744263,"inactive_pgs_ratio":0.15999999642372131,"write_bytes_sec":2997693,"read_op_per_sec":0,"write_op_per_sec":45},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:48:25.056 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:48:25.056 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:25.089 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 17 16 3244 3228 11.8666 11.5 0.105007 0.084059 2024-09-16T07:48:25.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:25.215+0000 7f3a49751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:25.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:25.229+0000 7f3a49751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:25.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:25.604 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:25.621 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-16T07:48:24.328431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36569640,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":629,"num_write_kb":36243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":604,"ondisk_log_size":604,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":145084,"kb_used_data":6652,"kb_used_omap":0,"kb_used_meta":138368,"kb_avail":377342276,"statfs":{"total":386547056640,"available":386398490624,"internally_reserved":0,"allocated":6811648,"data_stored":86604105,"data_compressed":4094550,"data_compressed_allocated":5394432,"data_compressed_original":86065152,"omap_allocated":0,"internal_metadata":141688832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002314"},"pg_stats":[{"pgid":"4.f","version":"43'133","reported_seq":145,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.697957+0000","last_change":"2024-09-16T07:48:07.143237+0000","last_active":"2024-09-16T07:48:18.697957+0000","last_peered":"2024-09-16T07:48:18.697957+0000","last_clean":"2024-09-16T07:48:18.697957+0000","last_became_active":"2024-09-16T07:48:07.134157+0000","last_became_peered":"2024-09-16T07:48:07.134157+0000","last_unstale":"2024-09-16T07:48:18.697957+0000","last_undegraded":"2024-09-16T07:48:18.697957+0000","last_fullsized":"2024-09-16T07:48:18.697957+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"43'138","reported_seq":150,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.638770+0000","last_change":"2024-09-16T07:48:07.121004+0000","last_active":"2024-09-16T07:48:18.638770+0000","last_peered":"2024-09-16T07:48:18.638770+0000","last_clean":"2024-09-16T07:48:18.638770+0000","last_became_active":"2024-09-16T07:48:07.113500+0000","last_became_peered":"2024-09-16T07:48:07.113500+0000","last_unstale":"2024-09-16T07:48:18.638770+0000","last_undegraded":"2024-09-16T07:48:18.638770+0000","last_fullsized":"2024-09-16T07:48:18.638770+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.076292+0000","last_change":"2024-09-16T07:48:06.076292+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.076292+0000","last_undegraded":"2024-09-16T07:48:06.076292+0000","last_fullsized":"2024-09-16T07:48:06.076292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.007831+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:05.007831+0000","last_peered":"2024-09-16T07:48:05.007831+0000","last_clean":"2024-09-16T07:48:05.007831+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:05.007831+0000","last_undegraded":"2024-09-16T07:48:05.007831+0000","last_fullsized":"2024-09-16T07:48:05.007831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":92,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.041128+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:05.041128+0000","last_peered":"2024-09-16T07:48:05.041128+0000","last_clean":"2024-09-16T07:48:05.041128+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:05.041128+0000","last_undegraded":"2024-09-16T07:48:05.041128+0000","last_fullsized":"2024-09-16T07:48:05.041128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.050936+0000","last_change":"2024-09-16T07:48:06.050936+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.050936+0000","last_undegraded":"2024-09-16T07:48:06.050936+0000","last_fullsized":"2024-09-16T07:48:06.050936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.007760+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:06.007760+0000","last_peered":"2024-09-16T07:48:06.007760+0000","last_clean":"2024-09-16T07:48:06.007760+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:06.007760+0000","last_undegraded":"2024-09-16T07:48:06.007760+0000","last_fullsized":"2024-09-16T07:48:06.007760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"43'146","reported_seq":158,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.685399+0000","last_change":"2024-09-16T07:48:07.167154+0000","last_active":"2024-09-16T07:48:18.685399+0000","last_peered":"2024-09-16T07:48:18.685399+0000","last_clean":"2024-09-16T07:48:18.685399+0000","last_became_active":"2024-09-16T07:48:07.158060+0000","last_became_peered":"2024-09-16T07:48:07.158060+0000","last_unstale":"2024-09-16T07:48:18.685399+0000","last_undegraded":"2024-09-16T07:48:18.685399+0000","last_fullsized":"2024-09-16T07:48:18.685399+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.002130+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:05.002130+0000","last_peered":"2024-09-16T07:48:05.002130+0000","last_clean":"2024-09-16T07:48:05.002130+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:05.002130+0000","last_undegraded":"2024-09-16T07:48:05.002130+0000","last_fullsized":"2024-09-16T07:48:05.002130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"43'132","reported_seq":144,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.723482+0000","last_change":"2024-09-16T07:48:07.107086+0000","last_active":"2024-09-16T07:48:18.723482+0000","last_peered":"2024-09-16T07:48:18.723482+0000","last_clean":"2024-09-16T07:48:18.723482+0000","last_became_active":"2024-09-16T07:48:07.099520+0000","last_became_peered":"2024-09-16T07:48:07.099520+0000","last_unstale":"2024-09-16T07:48:18.723482+0000","last_undegraded":"2024-09-16T07:48:18.723482+0000","last_fullsized":"2024-09-16T07:48:18.723482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.006869+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:06.006869+0000","last_peered":"2024-09-16T07:48:06.006869+0000","last_clean":"2024-09-16T07:48:06.006869+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:06.006869+0000","last_undegraded":"2024-09-16T07:48:06.006869+0000","last_fullsized":"2024-09-16T07:48:06.006869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.008538+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:48:08.008538+0000","last_peered":"2024-09-16T07:48:08.008538+0000","last_clean":"2024-09-16T07:48:08.008538+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:48:08.008538+0000","last_undegraded":"2024-09-16T07:48:08.008538+0000","last_fullsized":"2024-09-16T07:48:08.008538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.035972+0000","last_change":"2024-09-16T07:48:06.035972+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.035972+0000","last_undegraded":"2024-09-16T07:48:06.035972+0000","last_fullsized":"2024-09-16T07:48:06.035972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.039578+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:05.039578+0000","last_peered":"2024-09-16T07:48:05.039578+0000","last_clean":"2024-09-16T07:48:05.039578+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:05.039578+0000","last_undegraded":"2024-09-16T07:48:05.039578+0000","last_fullsized":"2024-09-16T07:48:05.039578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.024375+0000","last_change":"2024-09-16T07:48:06.024375+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.024375+0000","last_undegraded":"2024-09-16T07:48:06.024375+0000","last_fullsized":"2024-09-16T07:48:06.024375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.018574+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:48:08.018574+0000","last_peered":"2024-09-16T07:48:08.018574+0000","last_clean":"2024-09-16T07:48:08.018574+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:48:08.018574+0000","last_undegraded":"2024-09-16T07:48:08.018574+0000","last_fullsized":"2024-09-16T07:48:08.018574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.028611+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:05.028611+0000","last_peered":"2024-09-16T07:48:05.028611+0000","last_clean":"2024-09-16T07:48:05.028611+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:05.028611+0000","last_undegraded":"2024-09-16T07:48:05.028611+0000","last_fullsized":"2024-09-16T07:48:05.028611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":385024,"data_stored":708054,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45132,"kb_used_data":5564,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94326708,"statfs":{"total":96636764160,"available":96590548992,"internally_reserved":0,"allocated":5697536,"data_stored":85067012,"data_compressed":4034468,"data_compressed_allocated":5312512,"data_compressed_original":84918272,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35472,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94336368,"statfs":{"total":96636764160,"available":96600440832,"internally_reserved":0,"allocated":327680,"data_stored":117705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33112,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":401408,"data_stored":711334,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:26.090 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 18 16 3435 3419 11.8705 11.9375 0.0711781 0.0839902 2024-09-16T07:48:26.264 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:26.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:26.419+0000 7f5080f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:26.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:26.428+0000 7f5080f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:27.089 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 19 16 3630 3614 11.8871 12.1875 0.0639796 0.0839799 2024-09-16T07:48:28.089 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:48:28.091392+0000 min lat: 0.0188198 max lat: 0.211809 avg lat: 0.0839601 2024-09-16T07:48:28.090 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:48:28.090 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 20 16 3820 3804 11.8864 11.875 0.0781822 0.0839601 2024-09-16T07:48:28.624 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:28.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:28.788+0000 7f3444684640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:28.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:28.801+0000 7f3444684640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:28.827 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:29.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:29.011+0000 7f3d4ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:29.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:29.021+0000 7f3d4ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:29.090 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 21 16 3992 3976 11.8323 10.75 0.0358046 0.0841719 2024-09-16T07:48:29.123 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:29.124 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:29.145 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-16T07:48:28.329201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36569640,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":629,"num_write_kb":36243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":604,"ondisk_log_size":604,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":145084,"kb_used_data":6652,"kb_used_omap":0,"kb_used_meta":138368,"kb_avail":377342276,"statfs":{"total":386547056640,"available":386398490624,"internally_reserved":0,"allocated":6811648,"data_stored":86604105,"data_compressed":4094550,"data_compressed_allocated":5394432,"data_compressed_original":86065152,"omap_allocated":0,"internal_metadata":141688832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002253"},"pg_stats":[{"pgid":"4.f","version":"43'133","reported_seq":145,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.697957+0000","last_change":"2024-09-16T07:48:07.143237+0000","last_active":"2024-09-16T07:48:18.697957+0000","last_peered":"2024-09-16T07:48:18.697957+0000","last_clean":"2024-09-16T07:48:18.697957+0000","last_became_active":"2024-09-16T07:48:07.134157+0000","last_became_peered":"2024-09-16T07:48:07.134157+0000","last_unstale":"2024-09-16T07:48:18.697957+0000","last_undegraded":"2024-09-16T07:48:18.697957+0000","last_fullsized":"2024-09-16T07:48:18.697957+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"43'138","reported_seq":150,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.638770+0000","last_change":"2024-09-16T07:48:07.121004+0000","last_active":"2024-09-16T07:48:18.638770+0000","last_peered":"2024-09-16T07:48:18.638770+0000","last_clean":"2024-09-16T07:48:18.638770+0000","last_became_active":"2024-09-16T07:48:07.113500+0000","last_became_peered":"2024-09-16T07:48:07.113500+0000","last_unstale":"2024-09-16T07:48:18.638770+0000","last_undegraded":"2024-09-16T07:48:18.638770+0000","last_fullsized":"2024-09-16T07:48:18.638770+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.076292+0000","last_change":"2024-09-16T07:48:06.076292+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.076292+0000","last_undegraded":"2024-09-16T07:48:06.076292+0000","last_fullsized":"2024-09-16T07:48:06.076292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.007831+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:05.007831+0000","last_peered":"2024-09-16T07:48:05.007831+0000","last_clean":"2024-09-16T07:48:05.007831+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:05.007831+0000","last_undegraded":"2024-09-16T07:48:05.007831+0000","last_fullsized":"2024-09-16T07:48:05.007831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":92,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.041128+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:05.041128+0000","last_peered":"2024-09-16T07:48:05.041128+0000","last_clean":"2024-09-16T07:48:05.041128+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:05.041128+0000","last_undegraded":"2024-09-16T07:48:05.041128+0000","last_fullsized":"2024-09-16T07:48:05.041128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.050936+0000","last_change":"2024-09-16T07:48:06.050936+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.050936+0000","last_undegraded":"2024-09-16T07:48:06.050936+0000","last_fullsized":"2024-09-16T07:48:06.050936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.007760+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:06.007760+0000","last_peered":"2024-09-16T07:48:06.007760+0000","last_clean":"2024-09-16T07:48:06.007760+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:06.007760+0000","last_undegraded":"2024-09-16T07:48:06.007760+0000","last_fullsized":"2024-09-16T07:48:06.007760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"43'146","reported_seq":158,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.685399+0000","last_change":"2024-09-16T07:48:07.167154+0000","last_active":"2024-09-16T07:48:18.685399+0000","last_peered":"2024-09-16T07:48:18.685399+0000","last_clean":"2024-09-16T07:48:18.685399+0000","last_became_active":"2024-09-16T07:48:07.158060+0000","last_became_peered":"2024-09-16T07:48:07.158060+0000","last_unstale":"2024-09-16T07:48:18.685399+0000","last_undegraded":"2024-09-16T07:48:18.685399+0000","last_fullsized":"2024-09-16T07:48:18.685399+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.002130+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:05.002130+0000","last_peered":"2024-09-16T07:48:05.002130+0000","last_clean":"2024-09-16T07:48:05.002130+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:05.002130+0000","last_undegraded":"2024-09-16T07:48:05.002130+0000","last_fullsized":"2024-09-16T07:48:05.002130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"43'132","reported_seq":144,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.723482+0000","last_change":"2024-09-16T07:48:07.107086+0000","last_active":"2024-09-16T07:48:18.723482+0000","last_peered":"2024-09-16T07:48:18.723482+0000","last_clean":"2024-09-16T07:48:18.723482+0000","last_became_active":"2024-09-16T07:48:07.099520+0000","last_became_peered":"2024-09-16T07:48:07.099520+0000","last_unstale":"2024-09-16T07:48:18.723482+0000","last_undegraded":"2024-09-16T07:48:18.723482+0000","last_fullsized":"2024-09-16T07:48:18.723482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.006869+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:06.006869+0000","last_peered":"2024-09-16T07:48:06.006869+0000","last_clean":"2024-09-16T07:48:06.006869+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:06.006869+0000","last_undegraded":"2024-09-16T07:48:06.006869+0000","last_fullsized":"2024-09-16T07:48:06.006869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.008538+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:48:08.008538+0000","last_peered":"2024-09-16T07:48:08.008538+0000","last_clean":"2024-09-16T07:48:08.008538+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:48:08.008538+0000","last_undegraded":"2024-09-16T07:48:08.008538+0000","last_fullsized":"2024-09-16T07:48:08.008538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.035972+0000","last_change":"2024-09-16T07:48:06.035972+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.035972+0000","last_undegraded":"2024-09-16T07:48:06.035972+0000","last_fullsized":"2024-09-16T07:48:06.035972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.039578+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:05.039578+0000","last_peered":"2024-09-16T07:48:05.039578+0000","last_clean":"2024-09-16T07:48:05.039578+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:05.039578+0000","last_undegraded":"2024-09-16T07:48:05.039578+0000","last_fullsized":"2024-09-16T07:48:05.039578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.024375+0000","last_change":"2024-09-16T07:48:06.024375+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.024375+0000","last_undegraded":"2024-09-16T07:48:06.024375+0000","last_fullsized":"2024-09-16T07:48:06.024375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.018574+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:48:08.018574+0000","last_peered":"2024-09-16T07:48:08.018574+0000","last_clean":"2024-09-16T07:48:08.018574+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:48:08.018574+0000","last_undegraded":"2024-09-16T07:48:08.018574+0000","last_fullsized":"2024-09-16T07:48:08.018574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.028611+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:05.028611+0000","last_peered":"2024-09-16T07:48:05.028611+0000","last_clean":"2024-09-16T07:48:05.028611+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:05.028611+0000","last_undegraded":"2024-09-16T07:48:05.028611+0000","last_fullsized":"2024-09-16T07:48:05.028611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":385024,"data_stored":708054,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45132,"kb_used_data":5564,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94326708,"statfs":{"total":96636764160,"available":96590548992,"internally_reserved":0,"allocated":5697536,"data_stored":85067012,"data_compressed":4034468,"data_compressed_allocated":5312512,"data_compressed_original":84918272,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35472,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94336368,"statfs":{"total":96636764160,"available":96600440832,"internally_reserved":0,"allocated":327680,"data_stored":117705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33112,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":401408,"data_stored":711334,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:29.146 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:48:29.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:29.309+0000 7f4cf8351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:29.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:29.321+0000 7f4cf8351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:29.861 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:29.861 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":211,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":43,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472856,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":13},{"state_name":"unknown","count":8},{"state_name":"creating+peering","count":4}],"num_pgs":25,"num_pools":3,"num_objects":553,"data_bytes":36569640,"bytes_used":148566016,"bytes_avail":386398490624,"bytes_total":386547056640,"unknown_pgs_ratio":0.31999999284744263,"inactive_pgs_ratio":0.15999999642372131,"write_bytes_sec":2997709,"read_op_per_sec":0,"write_op_per_sec":45},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:48:29.880 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:48:29.881 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:30.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:30.039+0000 7fbf6b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:30.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:30.052+0000 7fbf6b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:30.089 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 22 16 4160 4144 11.7717 10.5 0.0830366 0.0847662 2024-09-16T07:48:30.382 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:30.382 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:30.399 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-16T07:48:30.329544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36569640,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":629,"num_write_kb":36243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":604,"ondisk_log_size":604,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":145084,"kb_used_data":6652,"kb_used_omap":0,"kb_used_meta":138368,"kb_avail":377342276,"statfs":{"total":386547056640,"available":386398490624,"internally_reserved":0,"allocated":6811648,"data_stored":86604105,"data_compressed":4094550,"data_compressed_allocated":5394432,"data_compressed_original":86065152,"omap_allocated":0,"internal_metadata":141688832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002265"},"pg_stats":[{"pgid":"4.f","version":"43'133","reported_seq":145,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.697957+0000","last_change":"2024-09-16T07:48:07.143237+0000","last_active":"2024-09-16T07:48:18.697957+0000","last_peered":"2024-09-16T07:48:18.697957+0000","last_clean":"2024-09-16T07:48:18.697957+0000","last_became_active":"2024-09-16T07:48:07.134157+0000","last_became_peered":"2024-09-16T07:48:07.134157+0000","last_unstale":"2024-09-16T07:48:18.697957+0000","last_undegraded":"2024-09-16T07:48:18.697957+0000","last_fullsized":"2024-09-16T07:48:18.697957+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"43'138","reported_seq":150,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.638770+0000","last_change":"2024-09-16T07:48:07.121004+0000","last_active":"2024-09-16T07:48:18.638770+0000","last_peered":"2024-09-16T07:48:18.638770+0000","last_clean":"2024-09-16T07:48:18.638770+0000","last_became_active":"2024-09-16T07:48:07.113500+0000","last_became_peered":"2024-09-16T07:48:07.113500+0000","last_unstale":"2024-09-16T07:48:18.638770+0000","last_undegraded":"2024-09-16T07:48:18.638770+0000","last_fullsized":"2024-09-16T07:48:18.638770+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.076292+0000","last_change":"2024-09-16T07:48:06.076292+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.076292+0000","last_undegraded":"2024-09-16T07:48:06.076292+0000","last_fullsized":"2024-09-16T07:48:06.076292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.007831+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:05.007831+0000","last_peered":"2024-09-16T07:48:05.007831+0000","last_clean":"2024-09-16T07:48:05.007831+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:05.007831+0000","last_undegraded":"2024-09-16T07:48:05.007831+0000","last_fullsized":"2024-09-16T07:48:05.007831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":92,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.041128+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:05.041128+0000","last_peered":"2024-09-16T07:48:05.041128+0000","last_clean":"2024-09-16T07:48:05.041128+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:05.041128+0000","last_undegraded":"2024-09-16T07:48:05.041128+0000","last_fullsized":"2024-09-16T07:48:05.041128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.050936+0000","last_change":"2024-09-16T07:48:06.050936+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.050936+0000","last_undegraded":"2024-09-16T07:48:06.050936+0000","last_fullsized":"2024-09-16T07:48:06.050936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.007760+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:06.007760+0000","last_peered":"2024-09-16T07:48:06.007760+0000","last_clean":"2024-09-16T07:48:06.007760+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:06.007760+0000","last_undegraded":"2024-09-16T07:48:06.007760+0000","last_fullsized":"2024-09-16T07:48:06.007760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"43'146","reported_seq":158,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.685399+0000","last_change":"2024-09-16T07:48:07.167154+0000","last_active":"2024-09-16T07:48:18.685399+0000","last_peered":"2024-09-16T07:48:18.685399+0000","last_clean":"2024-09-16T07:48:18.685399+0000","last_became_active":"2024-09-16T07:48:07.158060+0000","last_became_peered":"2024-09-16T07:48:07.158060+0000","last_unstale":"2024-09-16T07:48:18.685399+0000","last_undegraded":"2024-09-16T07:48:18.685399+0000","last_fullsized":"2024-09-16T07:48:18.685399+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.002130+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:05.002130+0000","last_peered":"2024-09-16T07:48:05.002130+0000","last_clean":"2024-09-16T07:48:05.002130+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:05.002130+0000","last_undegraded":"2024-09-16T07:48:05.002130+0000","last_fullsized":"2024-09-16T07:48:05.002130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"43'132","reported_seq":144,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.723482+0000","last_change":"2024-09-16T07:48:07.107086+0000","last_active":"2024-09-16T07:48:18.723482+0000","last_peered":"2024-09-16T07:48:18.723482+0000","last_clean":"2024-09-16T07:48:18.723482+0000","last_became_active":"2024-09-16T07:48:07.099520+0000","last_became_peered":"2024-09-16T07:48:07.099520+0000","last_unstale":"2024-09-16T07:48:18.723482+0000","last_undegraded":"2024-09-16T07:48:18.723482+0000","last_fullsized":"2024-09-16T07:48:18.723482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.006869+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:06.006869+0000","last_peered":"2024-09-16T07:48:06.006869+0000","last_clean":"2024-09-16T07:48:06.006869+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:06.006869+0000","last_undegraded":"2024-09-16T07:48:06.006869+0000","last_fullsized":"2024-09-16T07:48:06.006869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.008538+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:48:08.008538+0000","last_peered":"2024-09-16T07:48:08.008538+0000","last_clean":"2024-09-16T07:48:08.008538+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:48:08.008538+0000","last_undegraded":"2024-09-16T07:48:08.008538+0000","last_fullsized":"2024-09-16T07:48:08.008538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.035972+0000","last_change":"2024-09-16T07:48:06.035972+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.035972+0000","last_undegraded":"2024-09-16T07:48:06.035972+0000","last_fullsized":"2024-09-16T07:48:06.035972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.039578+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:05.039578+0000","last_peered":"2024-09-16T07:48:05.039578+0000","last_clean":"2024-09-16T07:48:05.039578+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:05.039578+0000","last_undegraded":"2024-09-16T07:48:05.039578+0000","last_fullsized":"2024-09-16T07:48:05.039578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.024375+0000","last_change":"2024-09-16T07:48:06.024375+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.024375+0000","last_undegraded":"2024-09-16T07:48:06.024375+0000","last_fullsized":"2024-09-16T07:48:06.024375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.018574+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:48:08.018574+0000","last_peered":"2024-09-16T07:48:08.018574+0000","last_clean":"2024-09-16T07:48:08.018574+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:48:08.018574+0000","last_undegraded":"2024-09-16T07:48:08.018574+0000","last_fullsized":"2024-09-16T07:48:08.018574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.028611+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:05.028611+0000","last_peered":"2024-09-16T07:48:05.028611+0000","last_clean":"2024-09-16T07:48:05.028611+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:05.028611+0000","last_undegraded":"2024-09-16T07:48:05.028611+0000","last_fullsized":"2024-09-16T07:48:05.028611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":385024,"data_stored":708054,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45132,"kb_used_data":5564,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94326708,"statfs":{"total":96636764160,"available":96590548992,"internally_reserved":0,"allocated":5697536,"data_stored":85067012,"data_compressed":4034468,"data_compressed_allocated":5312512,"data_compressed_original":84918272,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35472,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94336368,"statfs":{"total":96636764160,"available":96600440832,"internally_reserved":0,"allocated":327680,"data_stored":117705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33112,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":401408,"data_stored":711334,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:31.090 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 23 16 4357 4341 11.7951 12.3125 0.0770852 0.0846434 2024-09-16T07:48:31.394 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:31.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:31.564+0000 7f7522591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:31.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:31.578+0000 7f7522591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:32.090 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 24 16 4544 4528 11.7906 11.6875 0.0803361 0.0845977 2024-09-16T07:48:33.090 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 25 16 4750 4734 11.8339 12.875 0.054453 0.0843591 2024-09-16T07:48:33.401 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:33.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:33.555+0000 7f03bd351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:33.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:33.566+0000 7f03bd351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:33.953 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:33.953 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:33.975 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-09-16T07:48:32.329893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36569640,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":629,"num_write_kb":36243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":604,"ondisk_log_size":604,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":145084,"kb_used_data":6652,"kb_used_omap":0,"kb_used_meta":138368,"kb_avail":377342276,"statfs":{"total":386547056640,"available":386398490624,"internally_reserved":0,"allocated":6811648,"data_stored":86604105,"data_compressed":4094550,"data_compressed_allocated":5394432,"data_compressed_original":86065152,"omap_allocated":0,"internal_metadata":141688832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002292"},"pg_stats":[{"pgid":"4.f","version":"43'133","reported_seq":145,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.697957+0000","last_change":"2024-09-16T07:48:07.143237+0000","last_active":"2024-09-16T07:48:18.697957+0000","last_peered":"2024-09-16T07:48:18.697957+0000","last_clean":"2024-09-16T07:48:18.697957+0000","last_became_active":"2024-09-16T07:48:07.134157+0000","last_became_peered":"2024-09-16T07:48:07.134157+0000","last_unstale":"2024-09-16T07:48:18.697957+0000","last_undegraded":"2024-09-16T07:48:18.697957+0000","last_fullsized":"2024-09-16T07:48:18.697957+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"43'138","reported_seq":150,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.638770+0000","last_change":"2024-09-16T07:48:07.121004+0000","last_active":"2024-09-16T07:48:18.638770+0000","last_peered":"2024-09-16T07:48:18.638770+0000","last_clean":"2024-09-16T07:48:18.638770+0000","last_became_active":"2024-09-16T07:48:07.113500+0000","last_became_peered":"2024-09-16T07:48:07.113500+0000","last_unstale":"2024-09-16T07:48:18.638770+0000","last_undegraded":"2024-09-16T07:48:18.638770+0000","last_fullsized":"2024-09-16T07:48:18.638770+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.076292+0000","last_change":"2024-09-16T07:48:06.076292+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.076292+0000","last_undegraded":"2024-09-16T07:48:06.076292+0000","last_fullsized":"2024-09-16T07:48:06.076292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.007831+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:05.007831+0000","last_peered":"2024-09-16T07:48:05.007831+0000","last_clean":"2024-09-16T07:48:05.007831+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:05.007831+0000","last_undegraded":"2024-09-16T07:48:05.007831+0000","last_fullsized":"2024-09-16T07:48:05.007831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":92,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.041128+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:05.041128+0000","last_peered":"2024-09-16T07:48:05.041128+0000","last_clean":"2024-09-16T07:48:05.041128+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:05.041128+0000","last_undegraded":"2024-09-16T07:48:05.041128+0000","last_fullsized":"2024-09-16T07:48:05.041128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.050936+0000","last_change":"2024-09-16T07:48:06.050936+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.050936+0000","last_undegraded":"2024-09-16T07:48:06.050936+0000","last_fullsized":"2024-09-16T07:48:06.050936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.007760+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:06.007760+0000","last_peered":"2024-09-16T07:48:06.007760+0000","last_clean":"2024-09-16T07:48:06.007760+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:06.007760+0000","last_undegraded":"2024-09-16T07:48:06.007760+0000","last_fullsized":"2024-09-16T07:48:06.007760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"43'146","reported_seq":158,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.685399+0000","last_change":"2024-09-16T07:48:07.167154+0000","last_active":"2024-09-16T07:48:18.685399+0000","last_peered":"2024-09-16T07:48:18.685399+0000","last_clean":"2024-09-16T07:48:18.685399+0000","last_became_active":"2024-09-16T07:48:07.158060+0000","last_became_peered":"2024-09-16T07:48:07.158060+0000","last_unstale":"2024-09-16T07:48:18.685399+0000","last_undegraded":"2024-09-16T07:48:18.685399+0000","last_fullsized":"2024-09-16T07:48:18.685399+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.002130+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:05.002130+0000","last_peered":"2024-09-16T07:48:05.002130+0000","last_clean":"2024-09-16T07:48:05.002130+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:05.002130+0000","last_undegraded":"2024-09-16T07:48:05.002130+0000","last_fullsized":"2024-09-16T07:48:05.002130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"43'132","reported_seq":144,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.723482+0000","last_change":"2024-09-16T07:48:07.107086+0000","last_active":"2024-09-16T07:48:18.723482+0000","last_peered":"2024-09-16T07:48:18.723482+0000","last_clean":"2024-09-16T07:48:18.723482+0000","last_became_active":"2024-09-16T07:48:07.099520+0000","last_became_peered":"2024-09-16T07:48:07.099520+0000","last_unstale":"2024-09-16T07:48:18.723482+0000","last_undegraded":"2024-09-16T07:48:18.723482+0000","last_fullsized":"2024-09-16T07:48:18.723482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.006869+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:06.006869+0000","last_peered":"2024-09-16T07:48:06.006869+0000","last_clean":"2024-09-16T07:48:06.006869+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:06.006869+0000","last_undegraded":"2024-09-16T07:48:06.006869+0000","last_fullsized":"2024-09-16T07:48:06.006869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.008538+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:48:08.008538+0000","last_peered":"2024-09-16T07:48:08.008538+0000","last_clean":"2024-09-16T07:48:08.008538+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:48:08.008538+0000","last_undegraded":"2024-09-16T07:48:08.008538+0000","last_fullsized":"2024-09-16T07:48:08.008538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.035972+0000","last_change":"2024-09-16T07:48:06.035972+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.035972+0000","last_undegraded":"2024-09-16T07:48:06.035972+0000","last_fullsized":"2024-09-16T07:48:06.035972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.039578+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:05.039578+0000","last_peered":"2024-09-16T07:48:05.039578+0000","last_clean":"2024-09-16T07:48:05.039578+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:05.039578+0000","last_undegraded":"2024-09-16T07:48:05.039578+0000","last_fullsized":"2024-09-16T07:48:05.039578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.024375+0000","last_change":"2024-09-16T07:48:06.024375+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.024375+0000","last_undegraded":"2024-09-16T07:48:06.024375+0000","last_fullsized":"2024-09-16T07:48:06.024375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.018574+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:48:08.018574+0000","last_peered":"2024-09-16T07:48:08.018574+0000","last_clean":"2024-09-16T07:48:08.018574+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:48:08.018574+0000","last_undegraded":"2024-09-16T07:48:08.018574+0000","last_fullsized":"2024-09-16T07:48:08.018574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.028611+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:05.028611+0000","last_peered":"2024-09-16T07:48:05.028611+0000","last_clean":"2024-09-16T07:48:05.028611+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:05.028611+0000","last_undegraded":"2024-09-16T07:48:05.028611+0000","last_fullsized":"2024-09-16T07:48:05.028611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":385024,"data_stored":708054,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45132,"kb_used_data":5564,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94326708,"statfs":{"total":96636764160,"available":96590548992,"internally_reserved":0,"allocated":5697536,"data_stored":85067012,"data_compressed":4034468,"data_compressed_allocated":5312512,"data_compressed_original":84918272,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35472,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94336368,"statfs":{"total":96636764160,"available":96600440832,"internally_reserved":0,"allocated":327680,"data_stored":117705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33112,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":401408,"data_stored":711334,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:33.977 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:48:34.007 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:34.090 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 26 16 4915 4899 11.7754 10.3125 0.203282 0.0846111 2024-09-16T07:48:34.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:34.136+0000 7f7d7e4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:34.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:34.157+0000 7f7d7e4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:34.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:34.189+0000 7f6594693640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:34.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:34.202+0000 7f6594693640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:34.629 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:34.629 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":216,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":43,"num_osds":4,"num_up_osds":4,"osd_up_since":1726472856,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":13},{"state_name":"unknown","count":8},{"state_name":"creating+peering","count":4}],"num_pgs":25,"num_pools":3,"num_objects":553,"data_bytes":36569640,"bytes_used":148566016,"bytes_avail":386398490624,"bytes_total":386547056640,"unknown_pgs_ratio":0.31999999284744263,"inactive_pgs_ratio":0.15999999642372131},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:48:34.657 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:48:34.657 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:34.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:34.868+0000 7fcc76711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:34.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:34.882+0000 7fcc76711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:35.090 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 27 16 5082 5066 11.7258 10.4375 0.0899847 0.0851238 2024-09-16T07:48:35.251 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:35.252 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:35.273 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-16T07:48:34.330318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36569640,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":629,"num_write_kb":36243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":604,"ondisk_log_size":604,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":145084,"kb_used_data":6652,"kb_used_omap":0,"kb_used_meta":138368,"kb_avail":377342276,"statfs":{"total":386547056640,"available":386398490624,"internally_reserved":0,"allocated":6811648,"data_stored":86604105,"data_compressed":4094550,"data_compressed_allocated":5394432,"data_compressed_original":86065152,"omap_allocated":0,"internal_metadata":141688832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002327"},"pg_stats":[{"pgid":"4.f","version":"43'133","reported_seq":145,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.697957+0000","last_change":"2024-09-16T07:48:07.143237+0000","last_active":"2024-09-16T07:48:18.697957+0000","last_peered":"2024-09-16T07:48:18.697957+0000","last_clean":"2024-09-16T07:48:18.697957+0000","last_became_active":"2024-09-16T07:48:07.134157+0000","last_became_peered":"2024-09-16T07:48:07.134157+0000","last_unstale":"2024-09-16T07:48:18.697957+0000","last_undegraded":"2024-09-16T07:48:18.697957+0000","last_fullsized":"2024-09-16T07:48:18.697957+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"43'138","reported_seq":150,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.638770+0000","last_change":"2024-09-16T07:48:07.121004+0000","last_active":"2024-09-16T07:48:18.638770+0000","last_peered":"2024-09-16T07:48:18.638770+0000","last_clean":"2024-09-16T07:48:18.638770+0000","last_became_active":"2024-09-16T07:48:07.113500+0000","last_became_peered":"2024-09-16T07:48:07.113500+0000","last_unstale":"2024-09-16T07:48:18.638770+0000","last_undegraded":"2024-09-16T07:48:18.638770+0000","last_fullsized":"2024-09-16T07:48:18.638770+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.076292+0000","last_change":"2024-09-16T07:48:06.076292+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.076292+0000","last_undegraded":"2024-09-16T07:48:06.076292+0000","last_fullsized":"2024-09-16T07:48:06.076292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.007831+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:05.007831+0000","last_peered":"2024-09-16T07:48:05.007831+0000","last_clean":"2024-09-16T07:48:05.007831+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:05.007831+0000","last_undegraded":"2024-09-16T07:48:05.007831+0000","last_fullsized":"2024-09-16T07:48:05.007831+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":92,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.041128+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:05.041128+0000","last_peered":"2024-09-16T07:48:05.041128+0000","last_clean":"2024-09-16T07:48:05.041128+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:05.041128+0000","last_undegraded":"2024-09-16T07:48:05.041128+0000","last_fullsized":"2024-09-16T07:48:05.041128+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.050936+0000","last_change":"2024-09-16T07:48:06.050936+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.050936+0000","last_undegraded":"2024-09-16T07:48:06.050936+0000","last_fullsized":"2024-09-16T07:48:06.050936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.007760+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:06.007760+0000","last_peered":"2024-09-16T07:48:06.007760+0000","last_clean":"2024-09-16T07:48:06.007760+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:06.007760+0000","last_undegraded":"2024-09-16T07:48:06.007760+0000","last_fullsized":"2024-09-16T07:48:06.007760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"43'146","reported_seq":158,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.685399+0000","last_change":"2024-09-16T07:48:07.167154+0000","last_active":"2024-09-16T07:48:18.685399+0000","last_peered":"2024-09-16T07:48:18.685399+0000","last_clean":"2024-09-16T07:48:18.685399+0000","last_became_active":"2024-09-16T07:48:07.158060+0000","last_became_peered":"2024-09-16T07:48:07.158060+0000","last_unstale":"2024-09-16T07:48:18.685399+0000","last_undegraded":"2024-09-16T07:48:18.685399+0000","last_fullsized":"2024-09-16T07:48:18.685399+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.002130+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:05.002130+0000","last_peered":"2024-09-16T07:48:05.002130+0000","last_clean":"2024-09-16T07:48:05.002130+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:05.002130+0000","last_undegraded":"2024-09-16T07:48:05.002130+0000","last_fullsized":"2024-09-16T07:48:05.002130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"43'132","reported_seq":144,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.723482+0000","last_change":"2024-09-16T07:48:07.107086+0000","last_active":"2024-09-16T07:48:18.723482+0000","last_peered":"2024-09-16T07:48:18.723482+0000","last_clean":"2024-09-16T07:48:18.723482+0000","last_became_active":"2024-09-16T07:48:07.099520+0000","last_became_peered":"2024-09-16T07:48:07.099520+0000","last_unstale":"2024-09-16T07:48:18.723482+0000","last_undegraded":"2024-09-16T07:48:18.723482+0000","last_fullsized":"2024-09-16T07:48:18.723482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":66,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:48:06.006869+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:06.006869+0000","last_peered":"2024-09-16T07:48:06.006869+0000","last_clean":"2024-09-16T07:48:06.006869+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:06.006869+0000","last_undegraded":"2024-09-16T07:48:06.006869+0000","last_fullsized":"2024-09-16T07:48:06.006869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.008538+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:48:08.008538+0000","last_peered":"2024-09-16T07:48:08.008538+0000","last_clean":"2024-09-16T07:48:08.008538+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:48:08.008538+0000","last_undegraded":"2024-09-16T07:48:08.008538+0000","last_fullsized":"2024-09-16T07:48:08.008538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.035972+0000","last_change":"2024-09-16T07:48:06.035972+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.035972+0000","last_undegraded":"2024-09-16T07:48:06.035972+0000","last_fullsized":"2024-09-16T07:48:06.035972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.039578+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:05.039578+0000","last_peered":"2024-09-16T07:48:05.039578+0000","last_clean":"2024-09-16T07:48:05.039578+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:05.039578+0000","last_undegraded":"2024-09-16T07:48:05.039578+0000","last_fullsized":"2024-09-16T07:48:05.039578+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-16T07:48:06.024375+0000","last_change":"2024-09-16T07:48:06.024375+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:06.024375+0000","last_undegraded":"2024-09-16T07:48:06.024375+0000","last_fullsized":"2024-09-16T07:48:06.024375+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.018574+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:48:08.018574+0000","last_peered":"2024-09-16T07:48:08.018574+0000","last_clean":"2024-09-16T07:48:08.018574+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:48:08.018574+0000","last_undegraded":"2024-09-16T07:48:08.018574+0000","last_fullsized":"2024-09-16T07:48:08.018574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:05.986264+0000","last_change":"2024-09-16T07:48:05.986264+0000","last_active":"2024-09-16T07:48:05.986264+0000","last_peered":"2024-09-16T07:48:05.986264+0000","last_clean":"2024-09-16T07:48:05.986264+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:05.986264+0000","last_undegraded":"2024-09-16T07:48:05.986264+0000","last_fullsized":"2024-09-16T07:48:05.986264+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-16T07:48:05.028611+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:05.028611+0000","last_peered":"2024-09-16T07:48:05.028611+0000","last_clean":"2024-09-16T07:48:05.028611+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:05.028611+0000","last_undegraded":"2024-09-16T07:48:05.028611+0000","last_fullsized":"2024-09-16T07:48:05.028611+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31368,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":385024,"data_stored":708054,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45132,"kb_used_data":5564,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94326708,"statfs":{"total":96636764160,"available":96590548992,"internally_reserved":0,"allocated":5697536,"data_stored":85067012,"data_compressed":4034468,"data_compressed_allocated":5312512,"data_compressed_original":84918272,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35472,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94336368,"statfs":{"total":96636764160,"available":96600440832,"internally_reserved":0,"allocated":327680,"data_stored":117705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33112,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":401408,"data_stored":711334,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:36.090 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 28 16 5265 5249 11.7155 11.4375 0.174457 0.0851662 2024-09-16T07:48:36.612 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:36.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:36.775+0000 7f2900591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:36.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:36.789+0000 7f2900591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:37.090 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 29 16 5452 5436 11.7145 11.6875 0.114584 0.0852081 2024-09-16T07:48:38.090 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 30 16 5648 5632 11.7323 12.25 0.097781 0.0850943 2024-09-16T07:48:38.276 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:38.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:38.449+0000 7fee262a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:38.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:38.462+0000 7fee262a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:38.733 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:48:38.734 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:48:38.749 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-16T07:48:38.331288+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":291111464,"num_objects":4437,"num_object_clones":0,"num_object_copies":13311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4513,"num_write_kb":284819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4488,"ondisk_log_size":4488,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":229140,"kb_used_data":54608,"kb_used_omap":0,"kb_used_meta":174464,"kb_avail":377258220,"statfs":{"total":386547056640,"available":386312417280,"internally_reserved":0,"allocated":55918592,"data_stored":870781405,"data_compressed":41327017,"data_compressed_allocated":54403072,"data_compressed_original":870203392,"omap_allocated":0,"internal_metadata":178651136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":254541824,"num_objects":3884,"num_object_clones":0,"num_object_copies":11652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3884,"num_write_kb":248576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002454"},"pg_stats":[{"pgid":"4.f","version":"43'133","reported_seq":145,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.697957+0000","last_change":"2024-09-16T07:48:07.143237+0000","last_active":"2024-09-16T07:48:18.697957+0000","last_peered":"2024-09-16T07:48:18.697957+0000","last_clean":"2024-09-16T07:48:18.697957+0000","last_became_active":"2024-09-16T07:48:07.134157+0000","last_became_peered":"2024-09-16T07:48:07.134157+0000","last_unstale":"2024-09-16T07:48:18.697957+0000","last_undegraded":"2024-09-16T07:48:18.697957+0000","last_fullsized":"2024-09-16T07:48:18.697957+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"43'138","reported_seq":150,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.638770+0000","last_change":"2024-09-16T07:48:07.121004+0000","last_active":"2024-09-16T07:48:18.638770+0000","last_peered":"2024-09-16T07:48:18.638770+0000","last_clean":"2024-09-16T07:48:18.638770+0000","last_became_active":"2024-09-16T07:48:07.113500+0000","last_became_peered":"2024-09-16T07:48:07.113500+0000","last_unstale":"2024-09-16T07:48:18.638770+0000","last_undegraded":"2024-09-16T07:48:18.638770+0000","last_fullsized":"2024-09-16T07:48:18.638770+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"43'336","reported_seq":348,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.171495+0000","last_change":"2024-09-16T07:48:07.207772+0000","last_active":"2024-09-16T07:48:35.171495+0000","last_peered":"2024-09-16T07:48:35.171495+0000","last_clean":"2024-09-16T07:48:35.171495+0000","last_became_active":"2024-09-16T07:48:07.202453+0000","last_became_peered":"2024-09-16T07:48:07.202453+0000","last_unstale":"2024-09-16T07:48:35.171495+0000","last_undegraded":"2024-09-16T07:48:35.171495+0000","last_fullsized":"2024-09-16T07:48:35.171495+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"43'312","reported_seq":324,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.204743+0000","last_change":"2024-09-16T07:48:07.139629+0000","last_active":"2024-09-16T07:48:35.204743+0000","last_peered":"2024-09-16T07:48:35.204743+0000","last_clean":"2024-09-16T07:48:35.204743+0000","last_became_active":"2024-09-16T07:48:07.134408+0000","last_became_peered":"2024-09-16T07:48:07.134408+0000","last_unstale":"2024-09-16T07:48:35.204743+0000","last_undegraded":"2024-09-16T07:48:35.204743+0000","last_fullsized":"2024-09-16T07:48:35.204743+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":19968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"43'336","reported_seq":348,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:36.137489+0000","last_change":"2024-09-16T07:48:07.155059+0000","last_active":"2024-09-16T07:48:36.137489+0000","last_peered":"2024-09-16T07:48:36.137489+0000","last_clean":"2024-09-16T07:48:36.137489+0000","last_became_active":"2024-09-16T07:48:07.136136+0000","last_became_peered":"2024-09-16T07:48:07.136136+0000","last_unstale":"2024-09-16T07:48:36.137489+0000","last_undegraded":"2024-09-16T07:48:36.137489+0000","last_fullsized":"2024-09-16T07:48:36.137489+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"43'323","reported_seq":335,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.148995+0000","last_change":"2024-09-16T07:48:07.157959+0000","last_active":"2024-09-16T07:48:35.148995+0000","last_peered":"2024-09-16T07:48:35.148995+0000","last_clean":"2024-09-16T07:48:35.148995+0000","last_became_active":"2024-09-16T07:48:07.143105+0000","last_became_peered":"2024-09-16T07:48:07.143105+0000","last_unstale":"2024-09-16T07:48:35.148995+0000","last_undegraded":"2024-09-16T07:48:35.148995+0000","last_fullsized":"2024-09-16T07:48:35.148995+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"43'310","reported_seq":322,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.298801+0000","last_change":"2024-09-16T07:48:07.133658+0000","last_active":"2024-09-16T07:48:35.298801+0000","last_peered":"2024-09-16T07:48:35.298801+0000","last_clean":"2024-09-16T07:48:35.298801+0000","last_became_active":"2024-09-16T07:48:07.120658+0000","last_became_peered":"2024-09-16T07:48:07.120658+0000","last_unstale":"2024-09-16T07:48:35.298801+0000","last_undegraded":"2024-09-16T07:48:35.298801+0000","last_fullsized":"2024-09-16T07:48:35.298801+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":19840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"43'329","reported_seq":341,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.060085+0000","last_change":"2024-09-16T07:48:07.196679+0000","last_active":"2024-09-16T07:48:35.060085+0000","last_peered":"2024-09-16T07:48:35.060085+0000","last_clean":"2024-09-16T07:48:35.060085+0000","last_became_active":"2024-09-16T07:48:07.187590+0000","last_became_peered":"2024-09-16T07:48:07.187590+0000","last_unstale":"2024-09-16T07:48:35.060085+0000","last_undegraded":"2024-09-16T07:48:35.060085+0000","last_fullsized":"2024-09-16T07:48:35.060085+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":21056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"43'304","reported_seq":316,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.137745+0000","last_change":"2024-09-16T07:48:07.163297+0000","last_active":"2024-09-16T07:48:35.137745+0000","last_peered":"2024-09-16T07:48:35.137745+0000","last_clean":"2024-09-16T07:48:35.137745+0000","last_became_active":"2024-09-16T07:48:07.149858+0000","last_became_peered":"2024-09-16T07:48:07.149858+0000","last_unstale":"2024-09-16T07:48:35.137745+0000","last_undegraded":"2024-09-16T07:48:35.137745+0000","last_fullsized":"2024-09-16T07:48:35.137745+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":169,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.007311+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:08.007311+0000","last_peered":"2024-09-16T07:48:08.007311+0000","last_clean":"2024-09-16T07:48:08.007311+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:08.007311+0000","last_undegraded":"2024-09-16T07:48:08.007311+0000","last_fullsized":"2024-09-16T07:48:08.007311+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":101,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.024251+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:08.024251+0000","last_peered":"2024-09-16T07:48:08.024251+0000","last_clean":"2024-09-16T07:48:08.024251+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:08.024251+0000","last_undegraded":"2024-09-16T07:48:08.024251+0000","last_fullsized":"2024-09-16T07:48:08.024251+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"43'303","reported_seq":315,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:36.013400+0000","last_change":"2024-09-16T07:48:07.174709+0000","last_active":"2024-09-16T07:48:36.013400+0000","last_peered":"2024-09-16T07:48:36.013400+0000","last_clean":"2024-09-16T07:48:36.013400+0000","last_became_active":"2024-09-16T07:48:07.165407+0000","last_became_peered":"2024-09-16T07:48:07.165407+0000","last_unstale":"2024-09-16T07:48:36.013400+0000","last_undegraded":"2024-09-16T07:48:36.013400+0000","last_fullsized":"2024-09-16T07:48:36.013400+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":19392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.022897+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:08.022897+0000","last_peered":"2024-09-16T07:48:08.022897+0000","last_clean":"2024-09-16T07:48:08.022897+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:08.022897+0000","last_undegraded":"2024-09-16T07:48:08.022897+0000","last_fullsized":"2024-09-16T07:48:08.022897+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"43'146","reported_seq":158,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.685399+0000","last_change":"2024-09-16T07:48:07.167154+0000","last_active":"2024-09-16T07:48:18.685399+0000","last_peered":"2024-09-16T07:48:18.685399+0000","last_clean":"2024-09-16T07:48:18.685399+0000","last_became_active":"2024-09-16T07:48:07.158060+0000","last_became_peered":"2024-09-16T07:48:07.158060+0000","last_unstale":"2024-09-16T07:48:18.685399+0000","last_undegraded":"2024-09-16T07:48:18.685399+0000","last_fullsized":"2024-09-16T07:48:18.685399+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":102,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.013055+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:08.013055+0000","last_peered":"2024-09-16T07:48:08.013055+0000","last_clean":"2024-09-16T07:48:08.013055+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:08.013055+0000","last_undegraded":"2024-09-16T07:48:08.013055+0000","last_fullsized":"2024-09-16T07:48:08.013055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"43'132","reported_seq":144,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:18.723482+0000","last_change":"2024-09-16T07:48:07.107086+0000","last_active":"2024-09-16T07:48:18.723482+0000","last_peered":"2024-09-16T07:48:18.723482+0000","last_clean":"2024-09-16T07:48:18.723482+0000","last_became_active":"2024-09-16T07:48:07.099520+0000","last_became_peered":"2024-09-16T07:48:07.099520+0000","last_unstale":"2024-09-16T07:48:18.723482+0000","last_undegraded":"2024-09-16T07:48:18.723482+0000","last_fullsized":"2024-09-16T07:48:18.723482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":8448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":72,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.022002+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:08.022002+0000","last_peered":"2024-09-16T07:48:08.022002+0000","last_clean":"2024-09-16T07:48:08.022002+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:08.022002+0000","last_undegraded":"2024-09-16T07:48:08.022002+0000","last_fullsized":"2024-09-16T07:48:08.022002+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"43'322","reported_seq":334,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.125287+0000","last_change":"2024-09-16T07:48:07.144760+0000","last_active":"2024-09-16T07:48:35.125287+0000","last_peered":"2024-09-16T07:48:35.125287+0000","last_clean":"2024-09-16T07:48:35.125287+0000","last_became_active":"2024-09-16T07:48:07.138226+0000","last_became_peered":"2024-09-16T07:48:07.138226+0000","last_unstale":"2024-09-16T07:48:35.125287+0000","last_undegraded":"2024-09-16T07:48:35.125287+0000","last_fullsized":"2024-09-16T07:48:35.125287+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":20608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.008538+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:48:08.008538+0000","last_peered":"2024-09-16T07:48:08.008538+0000","last_clean":"2024-09-16T07:48:08.008538+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:48:08.008538+0000","last_undegraded":"2024-09-16T07:48:08.008538+0000","last_fullsized":"2024-09-16T07:48:08.008538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"43'347","reported_seq":359,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:36.055414+0000","last_change":"2024-09-16T07:48:07.154415+0000","last_active":"2024-09-16T07:48:36.055414+0000","last_peered":"2024-09-16T07:48:36.055414+0000","last_clean":"2024-09-16T07:48:36.055414+0000","last_became_active":"2024-09-16T07:48:07.142652+0000","last_became_peered":"2024-09-16T07:48:07.142652+0000","last_unstale":"2024-09-16T07:48:36.055414+0000","last_undegraded":"2024-09-16T07:48:36.055414+0000","last_fullsized":"2024-09-16T07:48:36.055414+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22740992,"num_objects":347,"num_object_clones":0,"num_object_copies":1041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":22208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.012738+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:08.012738+0000","last_peered":"2024-09-16T07:48:08.012738+0000","last_clean":"2024-09-16T07:48:08.012738+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:08.012738+0000","last_undegraded":"2024-09-16T07:48:08.012738+0000","last_fullsized":"2024-09-16T07:48:08.012738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"43'366","reported_seq":378,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:36.152114+0000","last_change":"2024-09-16T07:48:07.185498+0000","last_active":"2024-09-16T07:48:36.152114+0000","last_peered":"2024-09-16T07:48:36.152114+0000","last_clean":"2024-09-16T07:48:36.152114+0000","last_became_active":"2024-09-16T07:48:07.173841+0000","last_became_peered":"2024-09-16T07:48:07.173841+0000","last_unstale":"2024-09-16T07:48:36.152114+0000","last_undegraded":"2024-09-16T07:48:36.152114+0000","last_fullsized":"2024-09-16T07:48:36.152114+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23986176,"num_objects":366,"num_object_clones":0,"num_object_copies":1098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":23424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.018574+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:48:08.018574+0000","last_peered":"2024-09-16T07:48:08.018574+0000","last_clean":"2024-09-16T07:48:08.018574+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:48:08.018574+0000","last_undegraded":"2024-09-16T07:48:08.018574+0000","last_fullsized":"2024-09-16T07:48:08.018574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"43'296","reported_seq":308,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.270747+0000","last_change":"2024-09-16T07:48:07.167383+0000","last_active":"2024-09-16T07:48:35.270747+0000","last_peered":"2024-09-16T07:48:35.270747+0000","last_clean":"2024-09-16T07:48:35.270747+0000","last_became_active":"2024-09-16T07:48:07.151536+0000","last_became_peered":"2024-09-16T07:48:07.151536+0000","last_unstale":"2024-09-16T07:48:35.270747+0000","last_undegraded":"2024-09-16T07:48:35.270747+0000","last_fullsized":"2024-09-16T07:48:35.270747+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":18944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.019491+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:08.019491+0000","last_peered":"2024-09-16T07:48:08.019491+0000","last_clean":"2024-09-16T07:48:08.019491+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:08.019491+0000","last_undegraded":"2024-09-16T07:48:08.019491+0000","last_fullsized":"2024-09-16T07:48:08.019491+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":290521088,"num_objects":4433,"num_object_clones":0,"num_object_copies":13299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4433,"num_write_kb":283712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55541760,"data_stored":888668160,"data_compressed":42195390,"data_compressed_allocated":55541760,"data_compressed_original":888668160,"omap_allocated":0,"internal_metadata":0},"log_size":4433,"ondisk_log_size":4433,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65520,"kb_used_data":16480,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94306320,"statfs":{"total":96636764160,"available":96569671680,"internally_reserved":0,"allocated":16875520,"data_stored":263980273,"data_compressed":12530039,"data_compressed_allocated":16494592,"data_compressed_original":263831552,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45132,"kb_used_data":5564,"kb_used_omap":0,"kb_used_meta":39552,"kb_avail":94326708,"statfs":{"total":96636764160,"available":96590548992,"internally_reserved":0,"allocated":5697536,"data_stored":85067012,"data_compressed":4034468,"data_compressed_allocated":5312512,"data_compressed_original":84918272,"omap_allocated":0,"internal_metadata":40501248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69852,"kb_used_data":16648,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94301988,"statfs":{"total":96636764160,"available":96565235712,"internally_reserved":0,"allocated":17047552,"data_stored":267059940,"data_compressed":12674287,"data_compressed_allocated":16683008,"data_compressed_original":266928128,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888123,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48636,"kb_used_data":15916,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94323204,"statfs":{"total":96636764160,"available":96586960896,"internally_reserved":0,"allocated":16297984,"data_stored":254674180,"data_compressed":12088223,"data_compressed_allocated":15912960,"data_compressed_original":254525440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16302080,"data_stored":260833280,"data_compressed":12384942,"data_compressed_allocated":16302080,"data_compressed_original":260833280,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17059840,"data_stored":272957440,"data_compressed":12960591,"data_compressed_allocated":17059840,"data_compressed_original":272957440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5308416,"data_stored":84934656,"data_compressed":4032435,"data_compressed_allocated":5308416,"data_compressed_original":84934656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16871424,"data_stored":269942784,"data_compressed":12817422,"data_compressed_allocated":16871424,"data_compressed_original":269942784,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:38.751 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:48:38.751 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:48:38.751 INFO:tasks.thrashosds.thrasher:Killing osd 3, live_osds are [1, 3, 2, 0] 2024-09-16T07:48:38.752 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T07:48:38.752 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:48:38.846 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T07:48:39.090 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 31 16 5776 5760 11.6118 8 0.0709421 0.0852381 2024-09-16T07:48:39.120 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:39.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:39.249+0000 7f0a60391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:39.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:39.255+0000 7f0a60391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:40.090 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 32 16 5776 5760 11.2489 0 - 0.0852381 2024-09-16T07:48:41.091 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 33 16 5776 5760 10.908 0 - 0.0852381 2024-09-16T07:48:42.091 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 34 16 5776 5760 10.5872 0 - 0.0852381 2024-09-16T07:48:43.091 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 35 16 5776 5760 10.2847 0 - 0.0852381 2024-09-16T07:48:43.847 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [3] live_osds: [1, 2, 0] 2024-09-16T07:48:43.847 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:48:43.847 INFO:tasks.thrashosds.thrasher:Reviving osd 3 2024-09-16T07:48:43.847 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T07:48:43.847 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-16T07:48:43.850 INFO:tasks.ceph.osd.3:Started 2024-09-16T07:48:43.851 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T07:48:43.963 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:48:43.966 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:43.967 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-09-16T07:48:44.091 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 36 16 5776 5760 9.99899 0 - 0.0852381 2024-09-16T07:48:45.091 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 37 16 5776 5760 9.72873 0 - 0.0852381 2024-09-16T07:48:46.091 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 38 16 5776 5760 9.47271 0 - 0.0852381 2024-09-16T07:48:47.092 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 39 16 5776 5760 9.2298 0 - 0.0852381 2024-09-16T07:48:48.092 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:48:48.093806+0000 min lat: 0.0160323 max lat: 0.224872 avg lat: 0.0852381 2024-09-16T07:48:48.092 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:48:48.092 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 40 16 5776 5760 8.99905 0 - 0.0852381 2024-09-16T07:48:48.967 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T07:48:49.066 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:48:49.069 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:49.069 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-09-16T07:48:49.092 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 41 16 5776 5760 8.77955 0 - 0.0852381 2024-09-16T07:48:50.092 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 42 16 5776 5760 8.57051 0 - 0.0852381 2024-09-16T07:48:51.092 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 43 16 5776 5760 8.37118 0 - 0.0852381 2024-09-16T07:48:52.092 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 44 16 5776 5760 8.18092 0 - 0.0852381 2024-09-16T07:48:53.093 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 45 16 5776 5760 7.99911 0 - 0.0852381 2024-09-16T07:48:54.070 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T07:48:54.093 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 46 16 5776 5760 7.82521 0 - 0.0852381 2024-09-16T07:48:54.170 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:48:54.173 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:54.173 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-09-16T07:48:55.093 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 47 16 5776 5760 7.65871 0 - 0.0852381 2024-09-16T07:48:56.093 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 48 16 5776 5760 7.49914 0 - 0.0852381 2024-09-16T07:48:56.992 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-16T07:48:56.998 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:48:56.998 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:48:57.093 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 49 16 5776 5760 7.3461 0 - 0.0852381 2024-09-16T07:48:58.093 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 50 16 5776 5760 7.19918 0 - 0.0852381 2024-09-16T07:48:59.000 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:59.093 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 51 16 5776 5760 7.05802 0 - 0.0852381 2024-09-16T07:48:59.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:59.167+0000 7fed1a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:59.175 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T07:48:59.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:48:59.178+0000 7fed1a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:59.366 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-16T07:48:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "ops_in_flight": [ 2024-09-16T07:48:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "peering_event", 2024-09-16T07:48:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 166, 2024-09-16T07:48:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:48:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "PeeringEvent": { 2024-09-16T07:48:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "from": "0", 2024-09-16T07:48:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "4.6", 2024-09-16T07:48:59.366 INFO:teuthology.orchestra.run.smithi134.stdout: "sent": 46, 2024-09-16T07:48:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "requested": 46, 2024-09-16T07:48:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "evt": "epoch_sent: 46 epoch_requested: 46 MInfoRec from 0 info: 4.6( v 43'334 (0'0,43'334] local-lis/les=45/46 n=334 ec=41/41 lis/c=45/45 les/c/f=46/46/0 sis=45) pg_lease(ru 106.841995239s ub 106.841995239s int 16.000000000s)", 2024-09-16T07:48:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-16T07:48:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:48:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.352208+0000" 2024-09-16T07:48:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:48:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.352219+0000" 2024-09-16T07:48:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.367 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:48:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.352655+0000" 2024-09-16T07:48:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:48:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:48:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.353747+0000" 2024-09-16T07:48:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:48:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:48:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:48:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:48:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.372 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:48:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:48:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-16T07:48:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "peering_event", 2024-09-16T07:48:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 167, 2024-09-16T07:48:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:48:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "PeeringEvent": { 2024-09-16T07:48:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "from": "2", 2024-09-16T07:48:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "4.e", 2024-09-16T07:48:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "sent": 46, 2024-09-16T07:48:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "requested": 46, 2024-09-16T07:48:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "evt": "epoch_sent: 46 epoch_requested: 46 MLease epoch 46 from osd.2 pg_lease(ru 211.003280640s ub 211.195556641s int 16.000000000s)", 2024-09-16T07:48:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-16T07:48:59.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:48:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.352471+0000" 2024-09-16T07:48:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:48:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.352476+0000" 2024-09-16T07:48:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.375 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:48:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.352723+0000" 2024-09-16T07:48:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:48:59.376 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:48:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.353288+0000" 2024-09-16T07:48:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:48:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.353701+0000" 2024-09-16T07:48:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:48:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:48:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.379 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:48:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:48:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:48:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-16T07:48:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "background_recovery_sub", 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 168, 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": {} 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client_request", 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 159, 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.303765+0000" 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.382 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:48:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.303796+0000" 2024-09-16T07:48:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:48:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.306292+0000" 2024-09-16T07:48:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.383 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:48:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.384 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:48:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.306605+0000" 2024-09-16T07:48:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:48:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.316772+0000" 2024-09-16T07:48:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:48:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:48:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:48:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.317477+0000" 2024-09-16T07:48:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:48:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:48:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.317845+0000" 2024-09-16T07:48:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.388 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:48:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:48:59.389 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:48:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.390 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:48:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.318381+0000" 2024-09-16T07:48:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:48:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:48:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.392 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:48:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.320738+0000" 2024-09-16T07:48:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:48:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:48:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.394 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:48:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "replicated_request", 2024-09-16T07:48:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 165, 2024-09-16T07:48:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:48:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "RepRequest": { 2024-09-16T07:48:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "reqid": "client.4599.0:5778", 2024-09-16T07:48:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "4.4", 2024-09-16T07:48:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 46, 2024-09-16T07:48:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "min_epoch": 45, 2024-09-16T07:48:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "oid": "4:247b407a:::benchmark_data_smithi003_36040_object5777:head", 2024-09-16T07:48:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "from": "2" 2024-09-16T07:48:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client_request", 2024-09-16T07:48:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 64, 2024-09-16T07:48:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:48:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:48:59.396 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:58.151178+0000" 2024-09-16T07:48:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:48:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:58.151204+0000" 2024-09-16T07:48:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.397 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:48:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:58.151549+0000" 2024-09-16T07:48:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:48:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.398 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:48:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:58.152415+0000" 2024-09-16T07:48:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.399 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:48:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:58.153526+0000" 2024-09-16T07:48:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:48:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.400 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:48:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.155389+0000" 2024-09-16T07:48:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:48:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:58.153959+0000" 2024-09-16T07:48:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.401 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:48:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.402 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:48:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:58.154156+0000" 2024-09-16T07:48:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:48:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:58.154315+0000" 2024-09-16T07:48:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.403 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:48:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:48:59.404 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:48:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.154749+0000" 2024-09-16T07:48:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:48:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.406 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:48:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:48:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:48:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:48:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:48:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:48:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:48:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "peering_event", 2024-09-16T07:48:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 166, 2024-09-16T07:48:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:48:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "PeeringEvent": { 2024-09-16T07:48:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "from": "0", 2024-09-16T07:48:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "4.6", 2024-09-16T07:48:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "sent": 46, 2024-09-16T07:48:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "requested": 46, 2024-09-16T07:48:59.410 INFO:teuthology.orchestra.run.smithi134.stdout: "evt": "epoch_sent: 46 epoch_requested: 46 MInfoRec from 0 info: 4.6( v 43'334 (0'0,43'334] local-lis/les=45/46 n=334 ec=41/41 lis/c=45/45 les/c/f=46/46/0 sis=45) pg_lease(ru 106.841995239s ub 106.841995239s int 16.000000000s)", 2024-09-16T07:48:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-16T07:48:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:48:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.352208+0000" 2024-09-16T07:48:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:48:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.352219+0000" 2024-09-16T07:48:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.411 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.412 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:48:59.412 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.352655+0000" 2024-09-16T07:48:59.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.412 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.412 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.412 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:48:59.412 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.413 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.413 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.413 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:48:59.413 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.353747+0000" 2024-09-16T07:48:59.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.413 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.413 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.414 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:48:59.414 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:48:59.355778+0000", 2024-09-16T07:48:59.414 INFO:teuthology.orchestra.run.smithi134.stdout: "blocker": { 2024-09-16T07:48:59.414 INFO:teuthology.orchestra.run.smithi134.stdout: "op_type": "PerShardPipeline::create_or_wait_pg", 2024-09-16T07:48:59.414 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:48:59.414 INFO:teuthology.orchestra.run.smithi134.stdout: "waiting": 2, 2024-09-16T07:48:59.414 INFO:teuthology.orchestra.run.smithi134.stdout: "held_by_operation_id": 164 2024-09-16T07:48:59.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.415 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.415 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.415 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:48:59.415 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.415 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.415 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.416 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:48:59.416 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.416 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.416 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.416 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:48:59.416 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.416 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.416 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.417 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:48:59.417 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.417 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:48:59.417 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.417 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:48:59.417 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:48:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-16T07:48:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "background_recovery_sub", 2024-09-16T07:48:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 164, 2024-09-16T07:48:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": {} 2024-09-16T07:48:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:48:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:48:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "background_recovery_sub", 2024-09-16T07:48:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 168, 2024-09-16T07:48:59.418 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": {} 2024-09-16T07:48:59.419 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:48:59.419 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-16T07:48:59.419 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-16T07:49:00.093 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 52 16 5926 5910 7.10256 0.446429 0.122593 0.14064 2024-09-16T07:49:01.094 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 53 16 6136 6120 7.21617 13.125 0.102082 0.138447 2024-09-16T07:49:01.587 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:01.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:01.736+0000 7fcc42cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:01.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:01.746+0000 7fcc42cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:02.094 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 54 16 6334 6318 7.31168 12.375 0.0581781 0.13665 2024-09-16T07:49:02.310 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-16T07:49:02.311+0000 7fc911d32640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-16T07:49:03.094 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 55 16 6537 6521 7.4094 12.6875 0.049565 0.134878 2024-09-16T07:49:04.094 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 56 16 6741 6725 7.50475 12.75 0.084315 0.133173 2024-09-16T07:49:04.144 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:04.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:04.310+0000 7f155fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:04.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:04.325+0000 7f155fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:04.420 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [1, 2, 0, 3] 2024-09-16T07:49:04.421 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:49:04.421 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:49:04.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:04.575+0000 7f45f3951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:04.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:04.592+0000 7f45f3951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:04.990 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:49:04.991 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:49:05.009 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-16T07:49:04.335991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":348127784,"num_objects":5307,"num_object_clones":0,"num_object_copies":15921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5383,"num_write_kb":340499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5358,"ondisk_log_size":5358,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":230128,"kb_used_data":63916,"kb_used_omap":0,"kb_used_meta":166144,"kb_avail":377257232,"statfs":{"total":386547056640,"available":386311405568,"internally_reserved":0,"allocated":65449984,"data_stored":1023283677,"data_compressed":48568641,"data_compressed_allocated":63934464,"data_compressed_original":1022705664,"omap_allocated":0,"internal_metadata":170131456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.345967"},"pg_stats":[{"pgid":"4.f","version":"43'364","reported_seq":376,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:38.818039+0000","last_change":"2024-09-16T07:48:07.143237+0000","last_active":"2024-09-16T07:48:38.818039+0000","last_peered":"2024-09-16T07:48:38.818039+0000","last_clean":"2024-09-16T07:48:38.818039+0000","last_became_active":"2024-09-16T07:48:07.134157+0000","last_became_peered":"2024-09-16T07:48:07.134157+0000","last_unstale":"2024-09-16T07:48:38.818039+0000","last_undegraded":"2024-09-16T07:48:38.818039+0000","last_fullsized":"2024-09-16T07:48:38.818039+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23855104,"num_objects":364,"num_object_clones":0,"num_object_copies":1092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":23296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"43'341","reported_seq":353,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:38.516577+0000","last_change":"2024-09-16T07:48:07.121004+0000","last_active":"2024-09-16T07:48:38.516577+0000","last_peered":"2024-09-16T07:48:38.516577+0000","last_clean":"2024-09-16T07:48:38.516577+0000","last_became_active":"2024-09-16T07:48:07.113500+0000","last_became_peered":"2024-09-16T07:48:07.113500+0000","last_unstale":"2024-09-16T07:48:38.516577+0000","last_undegraded":"2024-09-16T07:48:38.516577+0000","last_fullsized":"2024-09-16T07:48:38.516577+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"43'336","reported_seq":348,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.171495+0000","last_change":"2024-09-16T07:48:07.207772+0000","last_active":"2024-09-16T07:48:35.171495+0000","last_peered":"2024-09-16T07:48:35.171495+0000","last_clean":"2024-09-16T07:48:35.171495+0000","last_became_active":"2024-09-16T07:48:07.202453+0000","last_became_peered":"2024-09-16T07:48:07.202453+0000","last_unstale":"2024-09-16T07:48:35.171495+0000","last_undegraded":"2024-09-16T07:48:35.171495+0000","last_fullsized":"2024-09-16T07:48:35.171495+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"43'312","reported_seq":324,"reported_epoch":43,"state":"stale+active+clean","last_fresh":"2024-09-16T07:48:35.204743+0000","last_change":"2024-09-16T07:48:07.139629+0000","last_active":"2024-09-16T07:48:35.204743+0000","last_peered":"2024-09-16T07:48:35.204743+0000","last_clean":"2024-09-16T07:48:35.204743+0000","last_became_active":"2024-09-16T07:48:07.134408+0000","last_became_peered":"2024-09-16T07:48:07.134408+0000","last_unstale":"2024-09-16T07:48:56.990054+0000","last_undegraded":"2024-09-16T07:48:35.204743+0000","last_fullsized":"2024-09-16T07:48:35.204743+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447232,"num_objects":312,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":19968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"43'336","reported_seq":348,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:36.137489+0000","last_change":"2024-09-16T07:48:07.155059+0000","last_active":"2024-09-16T07:48:36.137489+0000","last_peered":"2024-09-16T07:48:36.137489+0000","last_clean":"2024-09-16T07:48:36.137489+0000","last_became_active":"2024-09-16T07:48:07.136136+0000","last_became_peered":"2024-09-16T07:48:07.136136+0000","last_unstale":"2024-09-16T07:48:36.137489+0000","last_undegraded":"2024-09-16T07:48:36.137489+0000","last_fullsized":"2024-09-16T07:48:36.137489+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":21504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"43'323","reported_seq":335,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.148995+0000","last_change":"2024-09-16T07:48:07.157959+0000","last_active":"2024-09-16T07:48:35.148995+0000","last_peered":"2024-09-16T07:48:35.148995+0000","last_clean":"2024-09-16T07:48:35.148995+0000","last_became_active":"2024-09-16T07:48:07.143105+0000","last_became_peered":"2024-09-16T07:48:07.143105+0000","last_unstale":"2024-09-16T07:48:35.148995+0000","last_undegraded":"2024-09-16T07:48:35.148995+0000","last_fullsized":"2024-09-16T07:48:35.148995+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"43'310","reported_seq":322,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.298801+0000","last_change":"2024-09-16T07:48:07.133658+0000","last_active":"2024-09-16T07:48:35.298801+0000","last_peered":"2024-09-16T07:48:35.298801+0000","last_clean":"2024-09-16T07:48:35.298801+0000","last_became_active":"2024-09-16T07:48:07.120658+0000","last_became_peered":"2024-09-16T07:48:07.120658+0000","last_unstale":"2024-09-16T07:48:35.298801+0000","last_undegraded":"2024-09-16T07:48:35.298801+0000","last_fullsized":"2024-09-16T07:48:35.298801+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20316160,"num_objects":310,"num_object_clones":0,"num_object_copies":930,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":19840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"43'329","reported_seq":341,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.060085+0000","last_change":"2024-09-16T07:48:07.196679+0000","last_active":"2024-09-16T07:48:35.060085+0000","last_peered":"2024-09-16T07:48:35.060085+0000","last_clean":"2024-09-16T07:48:35.060085+0000","last_became_active":"2024-09-16T07:48:07.187590+0000","last_became_peered":"2024-09-16T07:48:07.187590+0000","last_unstale":"2024-09-16T07:48:35.060085+0000","last_undegraded":"2024-09-16T07:48:35.060085+0000","last_fullsized":"2024-09-16T07:48:35.060085+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21561344,"num_objects":329,"num_object_clones":0,"num_object_copies":987,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":21056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"43'304","reported_seq":316,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.137745+0000","last_change":"2024-09-16T07:48:07.163297+0000","last_active":"2024-09-16T07:48:35.137745+0000","last_peered":"2024-09-16T07:48:35.137745+0000","last_clean":"2024-09-16T07:48:35.137745+0000","last_became_active":"2024-09-16T07:48:07.149858+0000","last_became_peered":"2024-09-16T07:48:07.149858+0000","last_unstale":"2024-09-16T07:48:35.137745+0000","last_undegraded":"2024-09-16T07:48:35.137745+0000","last_fullsized":"2024-09-16T07:48:35.137745+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":169,"reported_epoch":43,"state":"stale+active+clean","last_fresh":"2024-09-16T07:48:08.007311+0000","last_change":"2024-09-16T07:47:37.523583+0000","last_active":"2024-09-16T07:48:08.007311+0000","last_peered":"2024-09-16T07:48:08.007311+0000","last_clean":"2024-09-16T07:48:08.007311+0000","last_became_active":"2024-09-16T07:47:37.518021+0000","last_became_peered":"2024-09-16T07:47:37.518021+0000","last_unstale":"2024-09-16T07:48:56.990056+0000","last_undegraded":"2024-09-16T07:48:08.007311+0000","last_fullsized":"2024-09-16T07:48:08.007311+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":101,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.024251+0000","last_change":"2024-09-16T07:47:38.432694+0000","last_active":"2024-09-16T07:48:08.024251+0000","last_peered":"2024-09-16T07:48:08.024251+0000","last_clean":"2024-09-16T07:48:08.024251+0000","last_became_active":"2024-09-16T07:47:37.499206+0000","last_became_peered":"2024-09-16T07:47:37.499206+0000","last_unstale":"2024-09-16T07:48:08.024251+0000","last_undegraded":"2024-09-16T07:48:08.024251+0000","last_fullsized":"2024-09-16T07:48:08.024251+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"43'303","reported_seq":315,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:36.013400+0000","last_change":"2024-09-16T07:48:07.174709+0000","last_active":"2024-09-16T07:48:36.013400+0000","last_peered":"2024-09-16T07:48:36.013400+0000","last_clean":"2024-09-16T07:48:36.013400+0000","last_became_active":"2024-09-16T07:48:07.165407+0000","last_became_peered":"2024-09-16T07:48:07.165407+0000","last_unstale":"2024-09-16T07:48:36.013400+0000","last_undegraded":"2024-09-16T07:48:36.013400+0000","last_fullsized":"2024-09-16T07:48:36.013400+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19857408,"num_objects":303,"num_object_clones":0,"num_object_copies":909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":19392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.022897+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:08.022897+0000","last_peered":"2024-09-16T07:48:08.022897+0000","last_clean":"2024-09-16T07:48:08.022897+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:48:08.022897+0000","last_undegraded":"2024-09-16T07:48:08.022897+0000","last_fullsized":"2024-09-16T07:48:08.022897+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"43'363","reported_seq":375,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:38.378934+0000","last_change":"2024-09-16T07:48:07.167154+0000","last_active":"2024-09-16T07:48:38.378934+0000","last_peered":"2024-09-16T07:48:38.378934+0000","last_clean":"2024-09-16T07:48:38.378934+0000","last_became_active":"2024-09-16T07:48:07.158060+0000","last_became_peered":"2024-09-16T07:48:07.158060+0000","last_unstale":"2024-09-16T07:48:38.378934+0000","last_undegraded":"2024-09-16T07:48:38.378934+0000","last_fullsized":"2024-09-16T07:48:38.378934+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23789568,"num_objects":363,"num_object_clones":0,"num_object_copies":1089,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":23232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":102,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.013055+0000","last_change":"2024-09-16T07:45:51.494919+0000","last_active":"2024-09-16T07:48:08.013055+0000","last_peered":"2024-09-16T07:48:08.013055+0000","last_clean":"2024-09-16T07:48:08.013055+0000","last_became_active":"2024-09-16T07:45:50.565640+0000","last_became_peered":"2024-09-16T07:45:50.565640+0000","last_unstale":"2024-09-16T07:48:08.013055+0000","last_undegraded":"2024-09-16T07:48:08.013055+0000","last_fullsized":"2024-09-16T07:48:08.013055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"43'351","reported_seq":363,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:38.653524+0000","last_change":"2024-09-16T07:48:07.107086+0000","last_active":"2024-09-16T07:48:38.653524+0000","last_peered":"2024-09-16T07:48:38.653524+0000","last_clean":"2024-09-16T07:48:38.653524+0000","last_became_active":"2024-09-16T07:48:07.099520+0000","last_became_peered":"2024-09-16T07:48:07.099520+0000","last_unstale":"2024-09-16T07:48:38.653524+0000","last_undegraded":"2024-09-16T07:48:38.653524+0000","last_fullsized":"2024-09-16T07:48:38.653524+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23003136,"num_objects":351,"num_object_clones":0,"num_object_copies":1053,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":351,"num_write_kb":22464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":72,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.022002+0000","last_change":"2024-09-16T07:47:38.451830+0000","last_active":"2024-09-16T07:48:08.022002+0000","last_peered":"2024-09-16T07:48:08.022002+0000","last_clean":"2024-09-16T07:48:08.022002+0000","last_became_active":"2024-09-16T07:47:37.619737+0000","last_became_peered":"2024-09-16T07:47:37.619737+0000","last_unstale":"2024-09-16T07:48:08.022002+0000","last_undegraded":"2024-09-16T07:48:08.022002+0000","last_fullsized":"2024-09-16T07:48:08.022002+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"43'322","reported_seq":334,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.125287+0000","last_change":"2024-09-16T07:48:07.144760+0000","last_active":"2024-09-16T07:48:35.125287+0000","last_peered":"2024-09-16T07:48:35.125287+0000","last_clean":"2024-09-16T07:48:35.125287+0000","last_became_active":"2024-09-16T07:48:07.138226+0000","last_became_peered":"2024-09-16T07:48:07.138226+0000","last_unstale":"2024-09-16T07:48:35.125287+0000","last_undegraded":"2024-09-16T07:48:35.125287+0000","last_fullsized":"2024-09-16T07:48:35.125287+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":20608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.008538+0000","last_change":"2024-09-16T07:47:38.449566+0000","last_active":"2024-09-16T07:48:08.008538+0000","last_peered":"2024-09-16T07:48:08.008538+0000","last_clean":"2024-09-16T07:48:08.008538+0000","last_became_active":"2024-09-16T07:47:37.544143+0000","last_became_peered":"2024-09-16T07:47:37.544143+0000","last_unstale":"2024-09-16T07:48:08.008538+0000","last_undegraded":"2024-09-16T07:48:08.008538+0000","last_fullsized":"2024-09-16T07:48:08.008538+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"43'347","reported_seq":359,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:36.055414+0000","last_change":"2024-09-16T07:48:07.154415+0000","last_active":"2024-09-16T07:48:36.055414+0000","last_peered":"2024-09-16T07:48:36.055414+0000","last_clean":"2024-09-16T07:48:36.055414+0000","last_became_active":"2024-09-16T07:48:07.142652+0000","last_became_peered":"2024-09-16T07:48:07.142652+0000","last_unstale":"2024-09-16T07:48:36.055414+0000","last_undegraded":"2024-09-16T07:48:36.055414+0000","last_fullsized":"2024-09-16T07:48:36.055414+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22740992,"num_objects":347,"num_object_clones":0,"num_object_copies":1041,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":347,"num_write_kb":22208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":43,"state":"stale+active+clean","last_fresh":"2024-09-16T07:48:08.012738+0000","last_change":"2024-09-16T07:47:38.437296+0000","last_active":"2024-09-16T07:48:08.012738+0000","last_peered":"2024-09-16T07:48:08.012738+0000","last_clean":"2024-09-16T07:48:08.012738+0000","last_became_active":"2024-09-16T07:47:37.557597+0000","last_became_peered":"2024-09-16T07:47:37.557597+0000","last_unstale":"2024-09-16T07:48:56.990059+0000","last_undegraded":"2024-09-16T07:48:08.012738+0000","last_fullsized":"2024-09-16T07:48:08.012738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"43'366","reported_seq":378,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:36.152114+0000","last_change":"2024-09-16T07:48:07.185498+0000","last_active":"2024-09-16T07:48:36.152114+0000","last_peered":"2024-09-16T07:48:36.152114+0000","last_clean":"2024-09-16T07:48:36.152114+0000","last_became_active":"2024-09-16T07:48:07.173841+0000","last_became_peered":"2024-09-16T07:48:07.173841+0000","last_unstale":"2024-09-16T07:48:36.152114+0000","last_undegraded":"2024-09-16T07:48:36.152114+0000","last_fullsized":"2024-09-16T07:48:36.152114+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23986176,"num_objects":366,"num_object_clones":0,"num_object_copies":1098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":23424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.018574+0000","last_change":"2024-09-16T07:47:38.436939+0000","last_active":"2024-09-16T07:48:08.018574+0000","last_peered":"2024-09-16T07:48:08.018574+0000","last_clean":"2024-09-16T07:48:08.018574+0000","last_became_active":"2024-09-16T07:47:37.582833+0000","last_became_peered":"2024-09-16T07:47:37.582833+0000","last_unstale":"2024-09-16T07:48:08.018574+0000","last_undegraded":"2024-09-16T07:48:08.018574+0000","last_fullsized":"2024-09-16T07:48:08.018574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"43'296","reported_seq":308,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:35.270747+0000","last_change":"2024-09-16T07:48:07.167383+0000","last_active":"2024-09-16T07:48:35.270747+0000","last_peered":"2024-09-16T07:48:35.270747+0000","last_clean":"2024-09-16T07:48:35.270747+0000","last_became_active":"2024-09-16T07:48:07.151536+0000","last_became_peered":"2024-09-16T07:48:07.151536+0000","last_unstale":"2024-09-16T07:48:35.270747+0000","last_undegraded":"2024-09-16T07:48:35.270747+0000","last_fullsized":"2024-09-16T07:48:35.270747+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":18944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":100,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-16T07:48:08.019491+0000","last_change":"2024-09-16T07:47:38.427696+0000","last_active":"2024-09-16T07:48:08.019491+0000","last_peered":"2024-09-16T07:48:08.019491+0000","last_clean":"2024-09-16T07:48:08.019491+0000","last_became_active":"2024-09-16T07:47:37.486189+0000","last_became_peered":"2024-09-16T07:47:37.486189+0000","last_unstale":"2024-09-16T07:48:08.019491+0000","last_undegraded":"2024-09-16T07:48:08.019491+0000","last_fullsized":"2024-09-16T07:48:08.019491+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":347537408,"num_objects":5303,"num_object_clones":0,"num_object_copies":15909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5303,"num_write_kb":339392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65036288,"data_stored":1040580608,"data_compressed":49409006,"data_compressed_allocated":65036288,"data_compressed_original":1040580608,"omap_allocated":0,"internal_metadata":0},"log_size":5303,"ondisk_log_size":5303,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65520,"kb_used_data":16480,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94306320,"statfs":{"total":96636764160,"available":96569671680,"internally_reserved":0,"allocated":16875520,"data_stored":263980273,"data_compressed":12530039,"data_compressed_allocated":16494592,"data_compressed_original":263831552,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784247987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46120,"kb_used_data":14872,"kb_used_omap":0,"kb_used_meta":31232,"kb_avail":94325720,"statfs":{"total":96636764160,"available":96589537280,"internally_reserved":0,"allocated":15228928,"data_stored":237569284,"data_compressed":11276092,"data_compressed_allocated":14843904,"data_compressed_original":237420544,"omap_allocated":0,"internal_metadata":31981568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69852,"kb_used_data":16648,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94301988,"statfs":{"total":96636764160,"available":96565235712,"internally_reserved":0,"allocated":17047552,"data_stored":267059940,"data_compressed":12674287,"data_compressed_allocated":16683008,"data_compressed_original":266928128,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888123,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48636,"kb_used_data":15916,"kb_used_omap":0,"kb_used_meta":32704,"kb_avail":94323204,"statfs":{"total":96636764160,"available":96586960896,"internally_reserved":0,"allocated":16297984,"data_stored":254674180,"data_compressed":12088223,"data_compressed_allocated":15912960,"data_compressed_original":254525440,"omap_allocated":0,"internal_metadata":33488896},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16302080,"data_stored":260833280,"data_compressed":12384942,"data_compressed_allocated":16302080,"data_compressed_original":260833280,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17059840,"data_stored":272957440,"data_compressed":12960591,"data_compressed_allocated":17059840,"data_compressed_original":272957440,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14802944,"data_stored":236847104,"data_compressed":11246051,"data_compressed_allocated":14802944,"data_compressed_original":236847104,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16871424,"data_stored":269942784,"data_compressed":12817422,"data_compressed_allocated":16871424,"data_compressed_original":269942784,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:49:05.094 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 57 16 6928 6912 7.57811 11.6875 0.0489116 0.131839 2024-09-16T07:49:06.094 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 58 16 7112 7096 7.6457 11.5 0.100226 0.130698 2024-09-16T07:49:06.762 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:06.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:06.934+0000 7f671e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:06.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:06.947+0000 7f671e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:07.094 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 59 16 7314 7298 7.73008 12.625 0.0515106 0.129267 2024-09-16T07:49:08.094 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:49:08.096196+0000 min lat: 0.0160323 max lat: 20.6776 avg lat: 0.128085 2024-09-16T07:49:08.094 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:49:08.094 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 60 16 7506 7490 7.80123 12 0.106276 0.128085 2024-09-16T07:49:09.094 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 61 16 7705 7689 7.87721 12.4375 0.0984489 0.126827 2024-09-16T07:49:09.483 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:09.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:09.665+0000 7fdde6cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:09.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:09.676+0000 7fdde6cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:10.012 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [1, 2, 0, 3] 2024-09-16T07:49:10.012 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:49:10.012 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [1, 2, 0, 3] 2024-09-16T07:49:10.012 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T07:49:10.013 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:49:10.094 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 62 16 7895 7879 7.94167 11.875 0.120445 0.125739 2024-09-16T07:49:10.103 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T07:49:11.094 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 63 16 7896 7880 7.8166 0.0625 0.0272221 0.125726 2024-09-16T07:49:12.095 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 64 16 7896 7880 7.69446 0 - 0.125726 2024-09-16T07:49:12.112 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:12.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:12.238+0000 7fa2702bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:12.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:12.244+0000 7fa2702bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:13.095 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 65 16 7896 7880 7.57608 0 - 0.125726 2024-09-16T07:49:14.095 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 66 16 7896 7880 7.46129 0 - 0.125726 2024-09-16T07:49:15.095 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 67 16 7896 7880 7.34992 0 - 0.125726 2024-09-16T07:49:15.103 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [1, 2, 3] 2024-09-16T07:49:15.104 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:49:15.104 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:49:15.104 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:49:15.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:15.231+0000 7f9fc9511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:15.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:15.242+0000 7f9fc9511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:16.095 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 68 16 7896 7880 7.24183 0 - 0.125726 2024-09-16T07:49:17.095 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 69 16 7896 7880 7.13688 0 - 0.125726 2024-09-16T07:49:18.096 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 70 16 7896 7880 7.03492 0 - 0.125726 2024-09-16T07:49:19.096 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 71 16 7896 7880 6.93583 0 - 0.125726 2024-09-16T07:49:20.096 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 72 16 7896 7880 6.83949 0 - 0.125726 2024-09-16T07:49:21.096 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 73 16 7896 7880 6.7458 0 - 0.125726 2024-09-16T07:49:22.096 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 74 16 7896 7880 6.65463 0 - 0.125726 2024-09-16T07:49:23.096 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 75 16 7896 7880 6.5659 0 - 0.125726 2024-09-16T07:49:24.096 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 76 16 7896 7880 6.4795 0 - 0.125726 2024-09-16T07:49:25.097 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 77 16 7896 7880 6.39535 0 - 0.125726 2024-09-16T07:49:26.097 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 78 16 7896 7880 6.31335 0 - 0.125726 2024-09-16T07:49:27.097 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 79 16 7896 7880 6.23343 0 - 0.125726 2024-09-16T07:49:28.097 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:49:28.099216+0000 min lat: 0.0160323 max lat: 20.6776 avg lat: 0.125726 2024-09-16T07:49:28.097 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:49:28.097 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 80 16 7896 7880 6.15551 0 - 0.125726 2024-09-16T07:49:29.097 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 81 16 7896 7880 6.07951 0 - 0.125726 2024-09-16T07:49:30.098 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 82 16 7896 7880 6.00537 0 - 0.125726 2024-09-16T07:49:31.098 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 83 16 7896 7880 5.93301 0 - 0.125726 2024-09-16T07:49:32.098 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 84 16 7896 7880 5.86238 0 - 0.125726 2024-09-16T07:49:33.098 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 85 16 7896 7880 5.79341 0 - 0.125726 2024-09-16T07:49:34.098 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 86 16 7896 7880 5.72605 0 - 0.125726 2024-09-16T07:49:35.098 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 87 16 7896 7880 5.66023 0 - 0.125726 2024-09-16T07:49:35.992 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:49:35.992 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:49:35.997 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:49:35.998 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:35.998 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:49:36.098 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 88 16 7896 7880 5.59591 0 - 0.125726 2024-09-16T07:49:36.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:36.137+0000 7f270ba6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:36.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:36.148+0000 7f270ba6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:36.165 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:36.165 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:49:36.165 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:49:36.165 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:49:36.165 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:49:36.165 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:49:36.165 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:49:36.165 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:49:36.165 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:49:36.165 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:49:36.166 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:49:36.166 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:49:36.169 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:36.169 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:36.169 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:49:36.185 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:49:36.185 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:49:36.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:36.280+0000 7fd2bda74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:36.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:36.289+0000 7fd2bda74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:36.305 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:36.305 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:49:36.305 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:49:36.305 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:49:36.305 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:49:36.305 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:49:36.305 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:49:36.305 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:49:36.305 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:49:36.305 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:49:36.306 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:49:36.306 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:49:36.308 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:36.308 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:36.308 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:49:36.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:36.418+0000 7fb9be711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:36.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:36.428+0000 7fb9be711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:36.444 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:36.444 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:49:36.444 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:49:36.444 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:49:36.444 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:49:36.445 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:49:36.445 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:49:36.445 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:49:36.445 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:49:36.445 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:49:36.445 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:49:36.445 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:49:36.447 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:36.448 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:37.098 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 89 16 7899 7883 5.53514 0.00721154 27.1161 0.135978 2024-09-16T07:49:38.098 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 90 15 8094 8079 5.60974 12.25 0.12075 0.178141 2024-09-16T07:49:38.186 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:38.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:38.296+0000 7f53c36b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:38.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:38.303+0000 7f53c36b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:38.308 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:49:38.373 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:49:38.374 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:49:39.099 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Total time run: 90.0765 2024-09-16T07:49:39.099 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Total writes made: 8094 2024-09-16T07:49:39.099 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Write size: 65536 2024-09-16T07:49:39.099 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Object size: 65536 2024-09-16T07:49:39.099 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Bandwidth (MB/sec): 5.61606 2024-09-16T07:49:39.099 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev Bandwidth: 5.94383 2024-09-16T07:49:39.099 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max bandwidth (MB/sec): 13.125 2024-09-16T07:49:39.099 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min bandwidth (MB/sec): 0 2024-09-16T07:49:39.099 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Average IOPS: 89 2024-09-16T07:49:39.099 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev IOPS: 95.1038 2024-09-16T07:49:39.099 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max IOPS: 210 2024-09-16T07:49:39.100 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min IOPS: 0 2024-09-16T07:49:39.100 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Average Latency(s): 0.177983 2024-09-16T07:49:39.100 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev Latency(s): 1.50593 2024-09-16T07:49:39.100 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max latency(s): 27.2454 2024-09-16T07:49:39.100 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min latency(s): 0.0160323 2024-09-16T07:49:39.125 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T07:49:40.375 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:40.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:40.497+0000 7fa422391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:40.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:40.504+0000 7fa422391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:40.511 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:49:40.771 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:49:40.772 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:49:41.448 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [1, 2, 3] 2024-09-16T07:49:41.448 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:49:41.449 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-16T07:49:41.449 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:49:41.449 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T07:49:41.452 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:49:41.452 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:49:41.589 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:49:41.594 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:41.594 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:49:42.773 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:42.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:42.908+0000 7fdcf3288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:42.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:42.916+0000 7fdcf3288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:42.922 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:49:43.420 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:49:43.420 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:49:45.422 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:45.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:45.579+0000 7fea664ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:45.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:45.588+0000 7fea664ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:45.594 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:49:46.204 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:49:46.205 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:49:46.595 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:49:46.743 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:49:46.747 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:46.748 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:49:48.209 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:48.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:48.356+0000 7f63b3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:48.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:48.367+0000 7f63b3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:48.375 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:49:48.765 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:49:48.766 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:49:50.767 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:50.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:50.910+0000 7f8bd0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:50.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:50.918+0000 7f8bd0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:50.926 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:49:51.396 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:49:51.396 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:49:51.749 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:49:51.885 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:49:51.889 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:51.890 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:49:53.398 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:53.558+0000 7fccde791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:53.570+0000 7fccde791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:53.580 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:49:53.981 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:49:53.982 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:49:55.983 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:56.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:56.140+0000 7fdae6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:56.148+0000 7fdae6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:49:57.089 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T07:49:57.089 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [ 2024-09-16T07:49:57.089 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.089 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:49:57.090 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 96, 2024-09-16T07:49:57.090 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:49:57.090 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:49:57.090 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "2", 2024-09-16T07:49:57.090 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.4", 2024-09-16T07:49:57.090 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 50, 2024-09-16T07:49:57.090 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 49, 2024-09-16T07:49:57.090 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 50 epoch_requested: 49 MLogRec from 2 log log((0'0,0'0], crt=0'0) pi ([0,0] all_participants={} intervals=[]) pg_lease(ru 0.000000000s ub 268.952301025s int 16.000000000s) +create_info", 2024-09-16T07:49:57.090 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:49:57.090 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.090 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:49:57.090 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.068466+0000" 2024-09-16T07:49:57.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.091 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.091 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:49:57.091 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.068472+0000" 2024-09-16T07:49:57.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.091 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.091 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.091 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.091 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.091 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:49:57.091 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.069107+0000" 2024-09-16T07:49:57.092 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.092 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.092 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.092 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.092 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.092 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.092 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:49:57.092 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.092 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.092 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.092 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.092 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.093 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.093 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:49:57.093 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.093 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.093 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.093 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.093 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.093 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:49:57.093 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.094 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.094 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.094 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.094 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.094 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:49:57.094 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.094 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.094 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.094 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.095 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.095 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:49:57.095 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.095 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.095 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.095 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.095 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.095 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:49:57.095 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.095 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.096 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.096 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.096 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.096 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:49:57.096 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.096 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.096 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.096 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.096 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.097 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:49:57.097 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.097 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.097 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:49:57.097 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.097 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.097 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.097 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:49:57.097 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 95, 2024-09-16T07:49:57.097 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:49:57.097 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:49:57.097 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "3", 2024-09-16T07:49:57.098 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.5", 2024-09-16T07:49:57.098 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 50, 2024-09-16T07:49:57.098 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 49, 2024-09-16T07:49:57.098 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 50 epoch_requested: 49 MLogRec from 3 log log((0'0,0'0], crt=0'0) pi ([0,0] all_participants={} intervals=[]) pg_lease(ru 0.000000000s ub 87.953292847s int 16.000000000s) +create_info", 2024-09-16T07:49:57.098 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:49:57.098 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.098 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:49:57.098 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.067223+0000" 2024-09-16T07:49:57.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.098 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.098 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:49:57.098 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.067231+0000" 2024-09-16T07:49:57.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.098 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.099 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.099 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.099 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.099 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.099 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:49:57.099 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.067423+0000" 2024-09-16T07:49:57.099 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.099 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.099 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.099 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.099 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.099 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.100 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:49:57.100 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.100 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.100 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.100 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.100 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.101 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:49:57.101 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.068236+0000" 2024-09-16T07:49:57.101 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.101 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.101 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.101 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.102 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.102 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:49:57.102 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.069360+0000" 2024-09-16T07:49:57.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.102 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.102 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.102 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.103 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.103 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:49:57.103 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.103 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.103 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.103 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.103 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.103 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:49:57.103 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.069572+0000" 2024-09-16T07:49:57.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.103 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.104 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.104 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.104 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.104 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:49:57.104 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.104 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.104 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.104 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.104 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.104 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:49:57.105 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.069634+0000" 2024-09-16T07:49:57.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.105 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.105 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.105 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.105 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.105 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:49:57.105 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.105 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.105 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:49:57.105 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.105 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.106 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.106 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:49:57.106 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 40, 2024-09-16T07:49:57.106 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:49:57.106 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.106 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:49:57.106 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.236380+0000" 2024-09-16T07:49:57.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.106 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.106 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:49:57.106 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.236422+0000" 2024-09-16T07:49:57.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.106 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:49:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.236966+0000" 2024-09-16T07:49:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:49:57.107 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.108 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.108 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.108 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.108 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.108 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:49:57.108 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.237438+0000" 2024-09-16T07:49:57.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.108 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.108 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.108 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.109 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.109 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:49:57.109 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.247921+0000" 2024-09-16T07:49:57.109 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.109 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.109 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.109 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.109 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.109 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.109 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:49:57.109 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.109 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.109 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.109 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.110 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.110 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.110 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:49:57.110 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.018233+0000" 2024-09-16T07:49:57.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.110 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.110 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:49:57.110 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.248621+0000" 2024-09-16T07:49:57.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.110 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.110 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.110 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.111 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.111 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:49:57.111 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.111 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.111 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.111 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.111 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.111 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:49:57.111 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.248852+0000" 2024-09-16T07:49:57.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.111 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.112 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.112 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:49:57.112 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.248960+0000" 2024-09-16T07:49:57.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.112 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.112 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.112 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.113 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:49:57.113 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.113 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.113 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.113 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.113 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.113 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:49:57.113 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.114 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.114 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.114 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.114 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.114 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:49:57.114 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.114 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.114 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.114 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.114 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.115 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:49:57.115 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.115 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.115 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.115 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.115 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.115 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.115 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.115 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:49:57.115 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.115 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.115 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.115 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.116 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.116 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.116 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:49:57.116 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.116 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.116 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.116 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.116 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.116 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:49:57.116 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.117 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.117 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.117 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.117 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.117 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:49:57.117 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.117 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.117 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.117 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.118 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.118 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:49:57.118 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.118 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.118 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.118 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.118 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:49:57.118 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 59, 2024-09-16T07:49:57.118 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:49:57.118 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.118 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:49:57.118 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.296555+0000" 2024-09-16T07:49:57.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.119 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.119 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:49:57.119 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.296571+0000" 2024-09-16T07:49:57.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.119 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.119 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.119 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.119 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.119 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:49:57.119 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.298879+0000" 2024-09-16T07:49:57.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.119 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.120 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.120 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:49:57.120 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.120 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.120 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.120 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:49:57.121 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.300702+0000" 2024-09-16T07:49:57.121 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.121 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.121 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.121 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.121 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.121 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.121 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:49:57.121 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.302425+0000" 2024-09-16T07:49:57.121 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.121 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.122 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.122 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.122 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.122 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:49:57.122 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.122 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.122 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.122 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.122 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.018331+0000" 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.303141+0000" 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.124 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.124 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.124 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.124 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.124 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:49:57.124 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.303528+0000" 2024-09-16T07:49:57.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.124 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.124 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.124 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.124 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.124 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:49:57.125 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.125 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.125 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.125 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.125 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.125 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:49:57.125 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.125 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.125 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.125 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.126 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.126 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:49:57.126 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.126 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.126 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.126 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.126 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.126 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:49:57.126 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.126 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.126 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.127 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.127 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.127 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:49:57.127 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.127 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.127 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.127 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.127 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.127 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:49:57.127 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.128 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.128 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.128 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.128 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.128 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.128 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:49:57.128 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.128 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.128 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.128 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.128 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.128 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.129 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.129 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:49:57.129 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.129 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.129 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.129 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.129 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.129 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:49:57.129 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.130 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.130 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.130 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.130 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.130 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:49:57.130 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.130 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.130 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.130 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.130 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:49:57.131 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 45, 2024-09-16T07:49:57.131 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:49:57.131 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.131 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:49:57.131 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.252759+0000" 2024-09-16T07:49:57.131 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.131 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.131 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:49:57.131 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.252776+0000" 2024-09-16T07:49:57.131 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.131 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.131 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.131 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.131 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.132 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.132 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:49:57.132 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.253842+0000" 2024-09-16T07:49:57.132 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.132 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.132 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.132 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.132 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.132 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.132 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:49:57.132 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.132 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.132 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.132 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.133 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.133 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.133 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:49:57.133 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.255396+0000" 2024-09-16T07:49:57.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.133 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.133 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.133 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.133 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.133 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:49:57.133 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.259124+0000" 2024-09-16T07:49:57.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.134 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.134 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.134 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.134 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.134 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:49:57.134 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.134 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.134 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.134 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.135 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.135 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:49:57.135 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.029239+0000" 2024-09-16T07:49:57.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.135 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.135 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:49:57.135 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.259551+0000" 2024-09-16T07:49:57.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.135 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.135 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.135 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.135 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.136 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:49:57.136 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.136 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.136 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.136 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.136 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.136 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.136 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.136 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:49:57.136 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.259751+0000" 2024-09-16T07:49:57.136 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.136 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.136 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.136 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.137 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.137 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:49:57.137 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.259852+0000" 2024-09-16T07:49:57.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.137 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.137 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.137 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.137 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.137 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:49:57.137 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.138 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.138 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.138 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.138 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.138 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.138 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.138 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:49:57.138 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.138 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.138 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.138 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.138 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.138 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.139 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.139 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:49:57.139 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.139 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.139 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.139 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.139 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.139 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.139 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.139 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:49:57.139 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.139 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.139 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.139 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.140 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.140 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.140 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:49:57.140 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.140 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.140 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.140 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.140 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.140 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:49:57.140 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.141 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.141 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.141 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.141 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.141 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:49:57.141 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.141 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.141 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.141 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.142 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.142 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.142 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:49:57.142 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.142 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.142 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.142 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.142 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.142 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.142 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.142 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:49:57.142 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.142 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.143 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.143 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.143 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.143 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:49:57.143 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 55, 2024-09-16T07:49:57.143 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:49:57.143 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.143 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:49:57.143 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.286932+0000" 2024-09-16T07:49:57.143 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.143 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.143 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:49:57.143 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.286956+0000" 2024-09-16T07:49:57.144 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.144 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.144 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.144 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.144 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.144 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.144 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:49:57.144 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.287442+0000" 2024-09-16T07:49:57.144 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.144 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.144 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.144 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.144 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.145 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.145 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:49:57.145 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.145 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.145 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.145 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.145 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.145 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.145 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.145 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:49:57.145 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.289668+0000" 2024-09-16T07:49:57.145 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.145 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.146 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.146 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.146 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.146 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.146 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:49:57.146 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.294267+0000" 2024-09-16T07:49:57.146 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.146 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.146 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.146 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.146 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.146 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.146 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:49:57.147 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.147 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.147 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.147 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.147 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.147 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.147 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.147 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:49:57.147 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.029392+0000" 2024-09-16T07:49:57.147 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.147 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.147 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:49:57.147 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.294866+0000" 2024-09-16T07:49:57.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.148 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.148 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.148 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.148 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.148 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:49:57.148 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.148 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.148 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.148 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.149 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.149 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:49:57.149 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.295159+0000" 2024-09-16T07:49:57.149 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.149 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.149 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.149 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.149 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.149 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.149 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:49:57.149 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.149 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.149 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.150 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.150 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.150 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.150 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.150 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:49:57.150 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.150 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.150 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.150 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.150 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.150 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.150 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.150 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:49:57.151 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.151 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.151 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.151 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.151 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.151 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.151 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.151 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:49:57.151 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.151 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.151 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.151 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.151 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.152 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.152 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.152 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:49:57.152 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.152 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.152 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.152 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.152 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.152 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.152 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.152 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:49:57.152 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.152 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.153 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.153 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.153 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.153 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.153 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.153 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:49:57.153 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.153 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.153 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.153 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.153 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.153 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.154 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.154 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:49:57.154 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.154 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.154 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.154 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.154 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.154 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.154 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.154 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:49:57.154 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.154 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.154 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.155 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.155 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.155 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.155 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.155 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:49:57.155 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.155 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.155 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.155 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.155 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.155 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:49:57.155 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 48, 2024-09-16T07:49:57.155 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:49:57.156 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.156 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:49:57.156 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.260264+0000" 2024-09-16T07:49:57.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.156 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.156 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:49:57.156 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.260275+0000" 2024-09-16T07:49:57.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.156 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.156 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.156 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.156 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.157 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:49:57.157 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.263407+0000" 2024-09-16T07:49:57.157 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.157 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.157 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.157 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.157 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.157 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.157 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:49:57.157 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.157 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.157 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.157 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.158 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.158 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.158 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.158 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:49:57.158 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.263669+0000" 2024-09-16T07:49:57.158 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.158 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.158 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.158 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.158 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.158 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.158 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:49:57.158 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.264942+0000" 2024-09-16T07:49:57.159 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.159 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.159 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.159 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.159 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.159 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.159 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:49:57.159 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.159 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.159 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.159 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.159 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:49:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.015758+0000" 2024-09-16T07:49:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:49:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.265444+0000" 2024-09-16T07:49:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.161 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.161 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:49:57.161 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.161 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.161 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.161 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.161 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.161 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.161 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.161 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:49:57.161 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.265676+0000" 2024-09-16T07:49:57.161 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.162 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.162 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.162 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.162 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.162 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:49:57.162 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.265805+0000" 2024-09-16T07:49:57.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.162 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.162 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.162 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.162 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.162 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:49:57.163 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.163 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.163 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.163 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.163 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.163 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.163 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.163 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:49:57.163 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.163 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.163 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.163 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.163 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.163 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.164 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.164 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:49:57.164 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.164 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.164 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.164 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.164 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.164 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:49:57.164 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.165 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.165 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.165 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.165 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.165 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:49:57.165 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.165 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.165 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.165 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.165 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.167 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.167 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:49:57.167 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.167 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.167 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.167 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.167 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.167 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.167 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.167 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:49:57.167 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.167 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.167 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.167 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.168 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:49:57.168 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:49:57.168 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 50, 2024-09-16T07:49:57.168 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:49:57.168 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.168 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:49:57.168 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.266568+0000" 2024-09-16T07:49:57.168 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.168 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.168 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:49:57.168 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.266579+0000" 2024-09-16T07:49:57.168 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.168 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.169 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.169 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.169 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.169 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.169 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:49:57.169 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.266848+0000" 2024-09-16T07:49:57.169 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.169 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.169 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.169 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.169 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.169 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.169 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:49:57.170 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.170 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.170 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.170 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.170 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.170 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.170 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.170 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:49:57.170 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.268169+0000" 2024-09-16T07:49:57.170 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.170 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.170 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.170 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.170 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.171 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.171 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:49:57.171 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.272060+0000" 2024-09-16T07:49:57.171 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.171 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.171 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.171 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.171 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.171 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.171 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:49:57.171 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.171 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.171 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.171 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.172 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.172 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.172 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:49:57.172 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:57.015859+0000" 2024-09-16T07:49:57.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.172 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.172 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:49:57.172 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.272571+0000" 2024-09-16T07:49:57.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.172 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.172 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.172 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.173 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.173 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.173 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:49:57.173 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.173 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.173 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.173 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.173 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.173 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.173 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.173 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:49:57.173 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:49:56.272887+0000" 2024-09-16T07:49:57.173 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.174 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.174 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.174 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.174 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.174 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.174 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:49:57.174 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.174 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.174 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.174 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.174 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.174 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.174 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.174 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:49:57.175 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.175 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.175 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.175 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.175 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.175 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.175 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.175 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:49:57.175 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.175 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.175 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.175 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.175 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.175 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.176 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.177 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.177 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.177 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:49:57.177 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.177 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.177 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.177 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.177 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.177 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.177 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.177 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:49:57.177 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.177 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.178 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.178 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.178 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.178 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.178 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.178 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:49:57.178 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.178 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.178 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.178 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.178 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.178 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.178 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:49:57.179 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T07:49:58.377 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:58.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:58.525+0000 7f2957e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:58.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:49:58.540+0000 7f2957e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:01.198 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:01.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:01.361+0000 7f9005ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:01.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:01.372+0000 7f9005ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:02.182 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 0] 2024-09-16T07:50:02.182 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:50:02.183 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:50:02.183 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:50:02.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:02.332+0000 7fe5344fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:02.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:02.350+0000 7fe5344fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:02.499 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:02.499 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:50:02.499 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:50:02.499 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:50:02.500 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:50:02.500 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:50:02.500 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:50:02.500 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:50:02.500 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:50:02.500 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:50:02.500 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:50:02.500 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:50:02.503 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:02.504 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:02.504 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:50:02.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:02.655+0000 7f4ded8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:02.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:02.668+0000 7f4ded8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:02.875 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:02.875 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:50:02.875 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:50:02.875 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:50:02.875 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:50:02.875 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:50:02.875 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:50:02.875 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:50:02.875 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:50:02.875 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:50:02.875 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:50:02.875 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:50:02.879 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:02.879 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:02.879 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:50:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:03.058+0000 7f36a3463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:03.080+0000 7f36a3463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:03.148 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:03.148 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:50:03.148 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:50:03.148 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:50:03.148 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:50:03.148 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:50:03.149 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:50:03.149 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:50:03.149 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:50:03.149 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:50:03.149 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:50:03.149 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:50:03.152 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:03.152 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:03.152 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:50:03.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:03.297+0000 7f22f8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:03.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:03.315+0000 7f22f8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:03.352 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:03.352 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:50:03.352 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:50:03.352 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:50:03.352 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:50:03.352 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:50:03.352 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:50:03.352 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:50:03.352 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:50:03.352 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:50:03.353 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:50:03.353 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:50:03.355 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:03.356 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:03.853 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:03.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:03.991+0000 7fcc0fd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:03.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:03.999+0000 7fcc0fd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:06.399 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:06.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:06.542+0000 7fd940591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:06.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:06.553+0000 7fd940591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:08.357 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 0] 2024-09-16T07:50:08.357 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:50:08.357 INFO:tasks.thrashosds.thrasher:Killing osd 3, live_osds are [1, 2, 3, 0] 2024-09-16T07:50:08.358 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T07:50:08.358 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:50:08.452 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T07:50:09.071 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:09.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:09.222+0000 7f26aceac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:09.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:09.232+0000 7f26aceac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:13.453 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [3] live_osds: [1, 2, 0] 2024-09-16T07:50:13.453 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:50:13.453 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:50:13.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:13.579+0000 7fbf948d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:13.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:13.588+0000 7fbf948d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:13.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:50:13.785 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:50:13.798 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-09-16T07:50:12.351289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":292291136,"num_objects":4456,"num_object_clones":0,"num_object_copies":13368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1921,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":11694,"num_write_kb":515156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":3473408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11673,"ondisk_log_size":11673,"up":70,"acting":61,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":245480,"kb_used_data":65504,"kb_used_omap":0,"kb_used_meta":179904,"kb_avail":377241880,"statfs":{"total":386547056640,"available":386295685120,"internally_reserved":0,"allocated":67076096,"data_stored":1046239616,"data_compressed":49657241,"data_compressed_allocated":65363968,"data_compressed_original":1045577728,"omap_allocated":0,"internal_metadata":184221696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-167641064,"num_objects":-2557,"num_object_clones":0,"num_object_copies":-7671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3117,"num_write_kb":17857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":2490368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002065"},"pg_stats":[{"pgid":"4.f","version":"48'635","reported_seq":673,"reported_epoch":48,"state":"active+undersized+degraded","last_fresh":"2024-09-16T07:49:48.519860+0000","last_change":"2024-09-16T07:49:37.108606+0000","last_active":"2024-09-16T07:49:48.519860+0000","last_peered":"2024-09-16T07:49:48.519860+0000","last_clean":"2024-09-16T07:49:10.054365+0000","last_became_active":"2024-09-16T07:49:37.108606+0000","last_became_peered":"2024-09-16T07:49:37.108606+0000","last_unstale":"2024-09-16T07:49:48.519860+0000","last_undegraded":"2024-09-16T07:49:37.026959+0000","last_fullsized":"2024-09-16T07:49:37.025257+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24838144,"num_objects":379,"num_object_clones":0,"num_object_copies":1137,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":379,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":635,"num_write_kb":32448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[{"shards":"2,3","objects":379}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"48'627","reported_seq":660,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-16T07:49:48.606312+0000","last_change":"2024-09-16T07:48:59.455893+0000","last_active":"2024-09-16T07:49:48.606312+0000","last_peered":"2024-09-16T07:49:48.606312+0000","last_clean":"2024-09-16T07:49:48.606312+0000","last_became_active":"2024-09-16T07:48:59.248866+0000","last_became_peered":"2024-09-16T07:48:59.248866+0000","last_unstale":"2024-09-16T07:49:48.606312+0000","last_undegraded":"2024-09-16T07:49:48.606312+0000","last_fullsized":"2024-09-16T07:49:48.606312+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23396352,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":627,"num_write_kb":31488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"51'788","reported_seq":827,"reported_epoch":51,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:05.133642+0000","last_change":"2024-09-16T07:49:58.728435+0000","last_active":"2024-09-16T07:50:05.133642+0000","last_peered":"2024-09-16T07:50:05.133642+0000","last_clean":"2024-09-16T07:49:10.022860+0000","last_became_active":"2024-09-16T07:49:58.714848+0000","last_became_peered":"2024-09-16T07:49:58.714848+0000","last_unstale":"2024-09-16T07:50:05.133642+0000","last_undegraded":"2024-09-16T07:49:58.480909+0000","last_fullsized":"2024-09-16T07:49:58.457685+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13959192,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":222,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":788,"num_write_kb":32001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":199}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"48'727","reported_seq":757,"reported_epoch":50,"state":"remapped+peering","last_fresh":"2024-09-16T07:49:57.022733+0000","last_change":"2024-09-16T07:49:57.022733+0000","last_active":"2024-09-16T07:49:56.045212+0000","last_peered":"2024-09-16T07:49:55.933965+0000","last_clean":"2024-09-16T07:49:10.032608+0000","last_became_active":"2024-09-16T07:49:37.079648+0000","last_became_peered":"2024-09-16T07:49:37.079648+0000","last_unstale":"2024-09-16T07:49:57.022733+0000","last_undegraded":"2024-09-16T07:49:57.022733+0000","last_fullsized":"2024-09-16T07:49:57.022733+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19529728,"num_objects":298,"num_object_clones":0,"num_object_copies":894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"51'807","reported_seq":972,"reported_epoch":51,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T07:50:05.313982+0000","last_change":"2024-09-16T07:50:00.575687+0000","last_active":"2024-09-16T07:50:05.313982+0000","last_peered":"2024-09-16T07:50:05.313982+0000","last_clean":"2024-09-16T07:49:09.643713+0000","last_became_active":"2024-09-16T07:49:58.698471+0000","last_became_peered":"2024-09-16T07:49:58.698471+0000","last_unstale":"2024-09-16T07:50:05.313982+0000","last_undegraded":"2024-09-16T07:50:05.313982+0000","last_fullsized":"2024-09-16T07:49:58.369312+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859712,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":806,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":917504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":242}],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"51'804","reported_seq":846,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T07:50:04.997152+0000","last_change":"2024-09-16T07:48:59.532190+0000","last_active":"2024-09-16T07:50:04.997152+0000","last_peered":"2024-09-16T07:50:04.997152+0000","last_clean":"2024-09-16T07:50:04.997152+0000","last_became_active":"2024-09-16T07:48:59.204795+0000","last_became_peered":"2024-09-16T07:48:59.204795+0000","last_unstale":"2024-09-16T07:50:04.997152+0000","last_undegraded":"2024-09-16T07:50:04.997152+0000","last_fullsized":"2024-09-16T07:50:04.997152+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15073280,"num_objects":230,"num_object_clones":0,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"51'752","reported_seq":943,"reported_epoch":51,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T07:50:05.298198+0000","last_change":"2024-09-16T07:49:59.833692+0000","last_active":"2024-09-16T07:50:05.298198+0000","last_peered":"2024-09-16T07:50:05.298198+0000","last_clean":"2024-09-16T07:49:09.862606+0000","last_became_active":"2024-09-16T07:49:58.562539+0000","last_became_peered":"2024-09-16T07:49:58.562539+0000","last_unstale":"2024-09-16T07:50:05.298198+0000","last_undegraded":"2024-09-16T07:50:05.298198+0000","last_fullsized":"2024-09-16T07:49:58.028492+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":720896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":208}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"51'814","reported_seq":864,"reported_epoch":51,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:05.242253+0000","last_change":"2024-09-16T07:49:58.778960+0000","last_active":"2024-09-16T07:50:05.242253+0000","last_peered":"2024-09-16T07:50:05.242253+0000","last_clean":"2024-09-16T07:49:09.957827+0000","last_became_active":"2024-09-16T07:49:58.764095+0000","last_became_peered":"2024-09-16T07:49:58.764095+0000","last_unstale":"2024-09-16T07:50:05.242253+0000","last_undegraded":"2024-09-16T07:49:58.387286+0000","last_fullsized":"2024-09-16T07:49:58.222276+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":233,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":209}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"51'778","reported_seq":830,"reported_epoch":51,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:05.310428+0000","last_change":"2024-09-16T07:49:58.830684+0000","last_active":"2024-09-16T07:50:05.310428+0000","last_peered":"2024-09-16T07:50:05.310428+0000","last_clean":"2024-09-16T07:49:10.093896+0000","last_became_active":"2024-09-16T07:49:58.815276+0000","last_became_peered":"2024-09-16T07:49:58.815276+0000","last_unstale":"2024-09-16T07:50:05.310428+0000","last_undegraded":"2024-09-16T07:49:58.366284+0000","last_fullsized":"2024-09-16T07:49:58.219872+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15335424,"num_objects":234,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":234,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":778,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":223}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":170,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T07:49:57.107845+0000","last_change":"2024-09-16T07:49:57.109405+0000","last_active":"2024-09-16T07:49:57.107845+0000","last_peered":"2024-09-16T07:49:57.107845+0000","last_clean":"2024-09-16T07:48:59.162759+0000","last_became_active":"2024-09-16T07:49:57.100099+0000","last_became_peered":"2024-09-16T07:49:57.100099+0000","last_unstale":"2024-09-16T07:49:57.107845+0000","last_undegraded":"2024-09-16T07:49:57.107845+0000","last_fullsized":"2024-09-16T07:49:57.107845+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":130,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T07:49:58.392018+0000","last_change":"2024-09-16T07:49:58.396557+0000","last_active":"2024-09-16T07:49:58.392018+0000","last_peered":"2024-09-16T07:49:58.392018+0000","last_clean":"2024-09-16T07:49:58.392018+0000","last_became_active":"2024-09-16T07:49:57.137470+0000","last_became_peered":"2024-09-16T07:49:57.137470+0000","last_unstale":"2024-09-16T07:49:58.392018+0000","last_undegraded":"2024-09-16T07:49:58.392018+0000","last_fullsized":"2024-09-16T07:49:58.392018+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"46'413","reported_seq":440,"reported_epoch":46,"state":"stale+active+clean","last_fresh":"2024-09-16T07:49:06.187076+0000","last_change":"2024-09-16T07:48:59.336957+0000","last_active":"2024-09-16T07:49:06.187076+0000","last_peered":"2024-09-16T07:49:06.187076+0000","last_clean":"2024-09-16T07:49:06.187076+0000","last_became_active":"2024-09-16T07:48:59.142646+0000","last_became_peered":"2024-09-16T07:48:59.142646+0000","last_unstale":"2024-09-16T07:49:35.990213+0000","last_undegraded":"2024-09-16T07:49:06.187076+0000","last_fullsized":"2024-09-16T07:49:06.187076+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27066368,"num_objects":413,"num_object_clones":0,"num_object_copies":1239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":413,"num_write_kb":26432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":46,"state":"stale+active+clean","last_fresh":"2024-09-16T07:48:59.042608+0000","last_change":"2024-09-16T07:47:38.457132+0000","last_active":"2024-09-16T07:48:59.042608+0000","last_peered":"2024-09-16T07:48:59.042608+0000","last_clean":"2024-09-16T07:48:59.042608+0000","last_became_active":"2024-09-16T07:47:37.605383+0000","last_became_peered":"2024-09-16T07:47:37.605383+0000","last_unstale":"2024-09-16T07:49:35.990215+0000","last_undegraded":"2024-09-16T07:48:59.042608+0000","last_fullsized":"2024-09-16T07:48:59.042608+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"48'657","reported_seq":691,"reported_epoch":48,"state":"active+undersized+degraded","last_fresh":"2024-09-16T07:49:48.621901+0000","last_change":"2024-09-16T07:49:37.102474+0000","last_active":"2024-09-16T07:49:48.621901+0000","last_peered":"2024-09-16T07:49:48.621901+0000","last_clean":"2024-09-16T07:49:10.122785+0000","last_became_active":"2024-09-16T07:49:37.102474+0000","last_became_peered":"2024-09-16T07:49:37.102474+0000","last_unstale":"2024-09-16T07:49:48.621901+0000","last_undegraded":"2024-09-16T07:49:37.020482+0000","last_fullsized":"2024-09-16T07:49:37.018743+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24576000,"num_objects":375,"num_object_clones":0,"num_object_copies":1125,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":375,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[{"shards":"2,3","objects":375}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":128,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T07:49:58.106493+0000","last_change":"2024-09-16T07:49:36.058494+0000","last_active":"2024-09-16T07:49:58.106493+0000","last_peered":"2024-09-16T07:49:58.106493+0000","last_clean":"2024-09-16T07:49:58.106493+0000","last_became_active":"2024-09-16T07:48:59.190243+0000","last_became_peered":"2024-09-16T07:48:59.190243+0000","last_unstale":"2024-09-16T07:49:58.106493+0000","last_undegraded":"2024-09-16T07:49:58.106493+0000","last_fullsized":"2024-09-16T07:49:58.106493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"48'614","reported_seq":642,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-16T07:49:48.650879+0000","last_change":"2024-09-16T07:48:59.237906+0000","last_active":"2024-09-16T07:49:48.650879+0000","last_peered":"2024-09-16T07:49:48.650879+0000","last_clean":"2024-09-16T07:49:48.650879+0000","last_became_active":"2024-09-16T07:48:59.226292+0000","last_became_peered":"2024-09-16T07:48:59.226292+0000","last_unstale":"2024-09-16T07:49:48.650879+0000","last_undegraded":"2024-09-16T07:49:48.650879+0000","last_fullsized":"2024-09-16T07:49:48.650879+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23724032,"num_objects":362,"num_object_clones":0,"num_object_copies":1086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":614,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":26,"reported_epoch":48,"state":"active+undersized+degraded","last_fresh":"2024-09-16T07:49:37.152814+0000","last_change":"2024-09-16T07:49:37.152072+0000","last_active":"2024-09-16T07:49:37.152814+0000","last_peered":"2024-09-16T07:49:37.152814+0000","last_clean":"2024-09-16T07:45:11.397414+0000","last_became_active":"2024-09-16T07:49:37.152072+0000","last_became_peered":"2024-09-16T07:49:37.152072+0000","last_unstale":"2024-09-16T07:49:37.152814+0000","last_undegraded":"2024-09-16T07:49:37.033719+0000","last_fullsized":"2024-09-16T07:49:37.032268+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"51'796","reported_seq":833,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T07:50:05.200440+0000","last_change":"2024-09-16T07:48:59.172353+0000","last_active":"2024-09-16T07:50:05.200440+0000","last_peered":"2024-09-16T07:50:05.200440+0000","last_clean":"2024-09-16T07:50:05.200440+0000","last_became_active":"2024-09-16T07:48:59.162338+0000","last_became_peered":"2024-09-16T07:48:59.162338+0000","last_unstale":"2024-09-16T07:50:05.200440+0000","last_undegraded":"2024-09-16T07:50:05.200440+0000","last_fullsized":"2024-09-16T07:50:05.200440+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14942208,"num_objects":228,"num_object_clones":0,"num_object_copies":684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-09-16T07:49:37.096376+0000","last_change":"2024-09-16T07:49:37.095702+0000","last_active":"2024-09-16T07:49:37.096376+0000","last_peered":"2024-09-16T07:49:37.096376+0000","last_clean":"2024-09-16T07:48:59.208719+0000","last_became_active":"2024-09-16T07:49:37.095702+0000","last_became_peered":"2024-09-16T07:49:37.095702+0000","last_unstale":"2024-09-16T07:49:37.096376+0000","last_undegraded":"2024-09-16T07:49:37.096376+0000","last_fullsized":"2024-09-16T07:49:37.013233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"51'808","reported_seq":844,"reported_epoch":51,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:05.154318+0000","last_change":"2024-09-16T07:49:58.763685+0000","last_active":"2024-09-16T07:50:05.154318+0000","last_peered":"2024-09-16T07:50:05.154318+0000","last_clean":"2024-09-16T07:49:09.929334+0000","last_became_active":"2024-09-16T07:49:58.753036+0000","last_became_peered":"2024-09-16T07:49:58.753036+0000","last_unstale":"2024-09-16T07:50:05.154318+0000","last_undegraded":"2024-09-16T07:49:58.212394+0000","last_fullsized":"2024-09-16T07:49:58.190626+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":225,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":807,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":209}],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-16T07:49:57.103227+0000","last_change":"2024-09-16T07:49:57.105128+0000","last_active":"2024-09-16T07:49:57.103227+0000","last_peered":"2024-09-16T07:49:57.103227+0000","last_clean":"2024-09-16T07:48:59.171098+0000","last_became_active":"2024-09-16T07:49:57.094727+0000","last_became_peered":"2024-09-16T07:49:57.094727+0000","last_unstale":"2024-09-16T07:49:57.103227+0000","last_undegraded":"2024-09-16T07:49:57.103227+0000","last_fullsized":"2024-09-16T07:49:57.103227+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"51'853","reported_seq":890,"reported_epoch":51,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:05.250560+0000","last_change":"2024-09-16T07:49:58.698367+0000","last_active":"2024-09-16T07:50:05.250560+0000","last_peered":"2024-09-16T07:50:05.250560+0000","last_clean":"2024-09-16T07:49:09.939114+0000","last_became_active":"2024-09-16T07:49:58.690011+0000","last_became_peered":"2024-09-16T07:49:58.690011+0000","last_unstale":"2024-09-16T07:50:05.250560+0000","last_undegraded":"2024-09-16T07:49:58.024807+0000","last_fullsized":"2024-09-16T07:49:57.996602+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15597568,"num_objects":238,"num_object_clones":0,"num_object_copies":714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":252,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":219}],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":48,"state":"active+undersized","last_fresh":"2024-09-16T07:49:37.071460+0000","last_change":"2024-09-16T07:49:37.070720+0000","last_active":"2024-09-16T07:49:37.071460+0000","last_peered":"2024-09-16T07:49:37.071460+0000","last_clean":"2024-09-16T07:48:59.224113+0000","last_became_active":"2024-09-16T07:49:37.070720+0000","last_became_peered":"2024-09-16T07:49:37.070720+0000","last_unstale":"2024-09-16T07:49:37.071460+0000","last_undegraded":"2024-09-16T07:49:37.071460+0000","last_fullsized":"2024-09-16T07:49:37.026843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"51'745","reported_seq":932,"reported_epoch":51,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T07:50:05.333395+0000","last_change":"2024-09-16T07:50:00.316863+0000","last_active":"2024-09-16T07:50:05.333395+0000","last_peered":"2024-09-16T07:50:05.333395+0000","last_clean":"2024-09-16T07:49:09.730753+0000","last_became_active":"2024-09-16T07:49:58.587279+0000","last_became_peered":"2024-09-16T07:49:58.587279+0000","last_unstale":"2024-09-16T07:50:05.333395+0000","last_undegraded":"2024-09-16T07:50:05.333395+0000","last_fullsized":"2024-09-16T07:49:58.106970+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15138816,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":745,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":70,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":231}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":129,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T07:49:58.483966+0000","last_change":"2024-09-16T07:49:58.493420+0000","last_active":"2024-09-16T07:49:58.483966+0000","last_peered":"2024-09-16T07:49:58.483966+0000","last_clean":"2024-09-16T07:49:58.483966+0000","last_became_active":"2024-09-16T07:49:57.161510+0000","last_became_peered":"2024-09-16T07:49:57.161510+0000","last_unstale":"2024-09-16T07:49:58.483966+0000","last_undegraded":"2024-09-16T07:49:58.483966+0000","last_fullsized":"2024-09-16T07:49:58.483966+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":291700760,"num_objects":4452,"num_object_clones":0,"num_object_copies":13356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1920,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11614,"num_write_kb":514049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":3473408,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64872448,"data_stored":1037828144,"data_compressed":49280814,"data_compressed_allocated":64864256,"data_compressed_original":1037828096,"omap_allocated":0,"internal_metadata":0},"log_size":11618,"ondisk_log_size":11618,"up":46,"acting":37,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":21,"acting":21,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":45,"seq":193273528379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51976,"kb_used_data":15544,"kb_used_omap":0,"kb_used_meta":36416,"kb_avail":94319864,"statfs":{"total":96636764160,"available":96583540736,"internally_reserved":0,"allocated":15917056,"data_stored":247753096,"data_compressed":11759169,"data_compressed_allocated":15478784,"data_compressed_original":247578624,"omap_allocated":0,"internal_metadata":37289984},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784248046,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77820,"kb_used_data":16044,"kb_used_omap":0,"kb_used_meta":61760,"kb_avail":94294020,"statfs":{"total":96636764160,"available":96557076480,"internally_reserved":0,"allocated":16429056,"data_stored":256068295,"data_compressed":12154393,"data_compressed_allocated":15998976,"data_compressed_original":255901696,"omap_allocated":0,"internal_metadata":63242240},"hb_peers":[1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":57388,"kb_used_data":12504,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94314452,"statfs":{"total":96636764160,"available":96577998848,"internally_reserved":0,"allocated":12804096,"data_stored":198079944,"data_compressed":9398240,"data_compressed_allocated":12369920,"data_compressed_original":197918720,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":34,"seq":146028888153,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58296,"kb_used_data":21412,"kb_used_omap":0,"kb_used_meta":36864,"kb_avail":94313544,"statfs":{"total":96636764160,"available":96577069056,"internally_reserved":0,"allocated":21925888,"data_stored":344338281,"data_compressed":16345439,"data_compressed_allocated":21516288,"data_compressed_original":344178688,"omap_allocated":0,"internal_metadata":37748736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21876736,"data_stored":350027776,"data_compressed":16620374,"data_compressed_allocated":21876736,"data_compressed_original":350027776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12062720,"data_stored":192938008,"data_compressed":9161728,"data_compressed_allocated":12058624,"data_compressed_original":192937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15495168,"data_stored":247857176,"data_compressed":11769584,"data_compressed_allocated":15491072,"data_compressed_original":247857152,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15437824,"data_stored":247005184,"data_compressed":11729128,"data_compressed_allocated":15437824,"data_compressed_original":247005184,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:50:13.801 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg force-backfill 4.f 4.d 4.7 2.2 4.0 2024-09-16T07:50:13.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:13.912+0000 7f146f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:13.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:13.927+0000 7f146f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:14.121 INFO:teuthology.orchestra.run.smithi003.stderr:instructing pg(s) [2.2] on osd.0 to force-backfill; instructing pg(s) [4.0,4.d] on osd.1 to force-backfill; instructing pg(s) [4.7,4.f] on osd.2 to force-backfill; 2024-09-16T07:50:14.121 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T07:50:19.136 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [3] live_osds: [1, 2, 0] 2024-09-16T07:50:19.136 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:50:19.136 INFO:tasks.thrashosds.thrasher:Reviving osd 3 2024-09-16T07:50:19.136 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T07:50:19.137 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-16T07:50:19.140 INFO:tasks.ceph.osd.3:Started 2024-09-16T07:50:19.140 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T07:50:19.257 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:50:19.261 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:19.261 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-09-16T07:50:24.262 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T07:50:24.363 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:50:24.366 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:24.367 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-09-16T07:50:29.368 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T07:50:29.468 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:50:29.471 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:29.472 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-09-16T07:50:33.417 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-16T07:50:33.422 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:50:33.423 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:50:34.472 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T07:50:34.691 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-16T07:50:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: "ops_in_flight": [ 2024-09-16T07:50:34.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "peering_event", 2024-09-16T07:50:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 67, 2024-09-16T07:50:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:50:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "PeeringEvent": { 2024-09-16T07:50:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "from": "1", 2024-09-16T07:50:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "4.9", 2024-09-16T07:50:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "sent": 55, 2024-09-16T07:50:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "requested": 55, 2024-09-16T07:50:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "evt": "epoch_sent: 55 epoch_requested: 55 MQuery 4.9 from 1 query_epoch 55 query: query(log 51'0 ec=41/41 lis/c=50/45 les/c/f=51/46/0 sis=55 epoch_sent 55)", 2024-09-16T07:50:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-16T07:50:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.692 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:50:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.636610+0000" 2024-09-16T07:50:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:50:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.636616+0000" 2024-09-16T07:50:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.694 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:50:34.694 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.694 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.694 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.694 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:50:34.694 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.695 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.695 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.695 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:50:34.695 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.695 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.695 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.696 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:50:34.696 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.696 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.696 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.697 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:50:34.697 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.697 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.697 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.697 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:50:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:50:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.698 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:50:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:50:34.699 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.700 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-16T07:50:34.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.700 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "peering_event", 2024-09-16T07:50:34.700 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 66, 2024-09-16T07:50:34.700 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:50:34.700 INFO:teuthology.orchestra.run.smithi134.stdout: "PeeringEvent": { 2024-09-16T07:50:34.700 INFO:teuthology.orchestra.run.smithi134.stdout: "from": "2", 2024-09-16T07:50:34.700 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "4.f", 2024-09-16T07:50:34.700 INFO:teuthology.orchestra.run.smithi134.stdout: "sent": 55, 2024-09-16T07:50:34.701 INFO:teuthology.orchestra.run.smithi134.stdout: "requested": 55, 2024-09-16T07:50:34.701 INFO:teuthology.orchestra.run.smithi134.stdout: "evt": "epoch_sent: 55 epoch_requested: 55 MQuery 4.f from 2 query_epoch 55 query: query(log 51'0 ec=41/41 lis/c=50/45 les/c/f=51/46/0 sis=55 epoch_sent 55)", 2024-09-16T07:50:34.701 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-16T07:50:34.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.701 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:50:34.701 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.635366+0000" 2024-09-16T07:50:34.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.701 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:50:34.701 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.635376+0000" 2024-09-16T07:50:34.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.701 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:50:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.635873+0000" 2024-09-16T07:50:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:50:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.703 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.703 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.703 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:50:34.703 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.636134+0000" 2024-09-16T07:50:34.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.703 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.703 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.704 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:50:34.704 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.636579+0000" 2024-09-16T07:50:34.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.704 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.704 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.704 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:50:34.704 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.705 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.705 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.705 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:50:34.705 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.636733+0000" 2024-09-16T07:50:34.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.705 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.705 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.705 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:50:34.706 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.706 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.706 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.706 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:50:34.706 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.636799+0000" 2024-09-16T07:50:34.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.706 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.706 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.707 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:50:34.707 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.707 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.707 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-16T07:50:34.707 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.707 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.707 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "peering_event", 2024-09-16T07:50:34.707 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 68, 2024-09-16T07:50:34.707 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:50:34.708 INFO:teuthology.orchestra.run.smithi134.stdout: "PeeringEvent": { 2024-09-16T07:50:34.708 INFO:teuthology.orchestra.run.smithi134.stdout: "from": "0", 2024-09-16T07:50:34.708 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "4.6", 2024-09-16T07:50:34.708 INFO:teuthology.orchestra.run.smithi134.stdout: "sent": 55, 2024-09-16T07:50:34.708 INFO:teuthology.orchestra.run.smithi134.stdout: "requested": 55, 2024-09-16T07:50:34.708 INFO:teuthology.orchestra.run.smithi134.stdout: "evt": "epoch_sent: 55 epoch_requested: 55 MQuery 4.6 from 0 query_epoch 55 query: query(log 51'0 ec=41/41 lis/c=50/45 les/c/f=51/46/0 sis=55 epoch_sent 55)", 2024-09-16T07:50:34.708 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-16T07:50:34.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.708 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:50:34.709 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.638891+0000" 2024-09-16T07:50:34.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.709 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:50:34.709 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.638898+0000" 2024-09-16T07:50:34.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.709 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.709 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.709 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:50:34.710 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.639156+0000" 2024-09-16T07:50:34.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.710 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.710 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.710 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:50:34.710 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.711 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.711 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.711 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:50:34.711 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.639299+0000" 2024-09-16T07:50:34.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.711 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.711 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.711 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:50:34.712 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.654338+0000", 2024-09-16T07:50:34.712 INFO:teuthology.orchestra.run.smithi134.stdout: "blocker": { 2024-09-16T07:50:34.712 INFO:teuthology.orchestra.run.smithi134.stdout: "op_type": "PerShardPipeline::create_or_wait_pg", 2024-09-16T07:50:34.712 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:50:34.712 INFO:teuthology.orchestra.run.smithi134.stdout: "waiting": 2 2024-09-16T07:50:34.712 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.712 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.712 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.712 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.713 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:50:34.713 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.713 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.713 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.713 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:50:34.713 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.714 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.714 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.714 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:50:34.714 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.714 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.714 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.715 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:50:34.715 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.715 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.715 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.716 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:50:34.716 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.716 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.716 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-16T07:50:34.716 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.716 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.716 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "peering_event", 2024-09-16T07:50:34.717 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 67, 2024-09-16T07:50:34.717 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:50:34.717 INFO:teuthology.orchestra.run.smithi134.stdout: "PeeringEvent": { 2024-09-16T07:50:34.717 INFO:teuthology.orchestra.run.smithi134.stdout: "from": "1", 2024-09-16T07:50:34.717 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "4.9", 2024-09-16T07:50:34.717 INFO:teuthology.orchestra.run.smithi134.stdout: "sent": 55, 2024-09-16T07:50:34.717 INFO:teuthology.orchestra.run.smithi134.stdout: "requested": 55, 2024-09-16T07:50:34.717 INFO:teuthology.orchestra.run.smithi134.stdout: "evt": "epoch_sent: 55 epoch_requested: 55 MQuery 4.9 from 1 query_epoch 55 query: query(log 51'0 ec=41/41 lis/c=50/45 les/c/f=51/46/0 sis=55 epoch_sent 55)", 2024-09-16T07:50:34.717 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-16T07:50:34.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.717 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:50:34.717 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.636610+0000" 2024-09-16T07:50:34.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.718 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:50:34.718 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.636616+0000" 2024-09-16T07:50:34.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.718 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.718 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.718 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:50:34.718 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.637356+0000" 2024-09-16T07:50:34.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.719 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.719 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.719 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:50:34.719 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.719 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.719 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.719 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:50:34.719 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.637727+0000" 2024-09-16T07:50:34.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.720 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.720 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.720 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:50:34.720 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:50:34.654393+0000", 2024-09-16T07:50:34.720 INFO:teuthology.orchestra.run.smithi134.stdout: "blocker": { 2024-09-16T07:50:34.720 INFO:teuthology.orchestra.run.smithi134.stdout: "op_type": "PerShardPipeline::create_or_wait_pg", 2024-09-16T07:50:34.720 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:50:34.720 INFO:teuthology.orchestra.run.smithi134.stdout: "waiting": 2 2024-09-16T07:50:34.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.721 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.721 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.721 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:50:34.721 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.721 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.722 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.722 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:50:34.722 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.722 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.722 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.722 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:50:34.722 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.723 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.723 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.723 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:50:34.723 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.723 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:50:34.723 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:50:34.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:50:34.724 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:50:34.724 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:50:34.724 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.724 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-16T07:50:34.724 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.724 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.724 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:50:34.724 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-16T07:50:34.724 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-16T07:50:35.424 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:35.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:35.558+0000 7fa517d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:35.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:35.565+0000 7fa517d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:38.107 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:38.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:38.270+0000 7f79d1abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:38.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:38.285+0000 7f79d1abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:39.726 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [1, 2, 0, 3] 2024-09-16T07:50:39.726 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:50:39.726 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [1, 2, 0, 3] 2024-09-16T07:50:39.727 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T07:50:39.727 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:50:39.823 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T07:50:41.000 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:41.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:41.132+0000 7fcd6df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:41.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:41.142+0000 7fcd6df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:44.823 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2] live_osds: [1, 0, 3] 2024-09-16T07:50:44.824 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:50:44.824 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:50:44.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:44.955+0000 7fb007391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:44.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:44.966+0000 7fb007391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:45.308 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:50:45.309 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:50:45.325 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-09-16T07:50:44.359400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":210502208,"num_objects":3208,"num_object_clones":0,"num_object_copies":9624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":921,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13056,"num_write_kb":518804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":869,"num_bytes_recovered":6029336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13037,"ondisk_log_size":13037,"up":75,"acting":68,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":220072,"kb_used_data":51240,"kb_used_omap":0,"kb_used_meta":168768,"kb_avail":377267288,"statfs":{"total":386547056640,"available":386321702912,"internally_reserved":0,"allocated":52469760,"data_stored":810500524,"data_compressed":38460456,"data_compressed_allocated":50626560,"data_compressed_original":809779200,"omap_allocated":0,"internal_metadata":172818432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17235968,"num_objects":-263,"num_object_clones":0,"num_object_copies":-789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-914,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":484,"num_bytes_recovered":2097176,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.940343"},"pg_stats":[{"pgid":"4.f","version":"51'828","reported_seq":891,"reported_epoch":53,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:12.027853+0000","last_change":"2024-09-16T07:49:58.841604+0000","last_active":"2024-09-16T07:50:12.027853+0000","last_peered":"2024-09-16T07:50:12.027853+0000","last_clean":"2024-09-16T07:49:10.054365+0000","last_became_active":"2024-09-16T07:49:58.521087+0000","last_became_peered":"2024-09-16T07:49:58.521087+0000","last_unstale":"2024-09-16T07:50:12.027853+0000","last_undegraded":"2024-09-16T07:49:58.087770+0000","last_fullsized":"2024-09-16T07:49:58.066039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":225,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":828,"num_write_kb":32448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[{"shards":"2,3","objects":178}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"51'797","reported_seq":845,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.040493+0000","last_change":"2024-09-16T07:48:59.455893+0000","last_active":"2024-09-16T07:50:12.040493+0000","last_peered":"2024-09-16T07:50:12.040493+0000","last_clean":"2024-09-16T07:50:12.040493+0000","last_became_active":"2024-09-16T07:48:59.248866+0000","last_became_peered":"2024-09-16T07:48:59.248866+0000","last_unstale":"2024-09-16T07:50:12.040493+0000","last_undegraded":"2024-09-16T07:50:12.040493+0000","last_fullsized":"2024-09-16T07:50:12.040493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":31488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"51'831","reported_seq":1089,"reported_epoch":55,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T07:50:35.342287+0000","last_change":"2024-09-16T07:50:33.854788+0000","last_active":"2024-09-16T07:50:35.342287+0000","last_peered":"2024-09-16T07:50:35.342287+0000","last_clean":"2024-09-16T07:49:10.022860+0000","last_became_active":"2024-09-16T07:49:58.714848+0000","last_became_peered":"2024-09-16T07:49:58.714848+0000","last_unstale":"2024-09-16T07:50:35.342287+0000","last_undegraded":"2024-09-16T07:50:35.342287+0000","last_fullsized":"2024-09-16T07:49:58.457685+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11141144,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":831,"num_write_kb":32001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":917528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":171}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"48'727","reported_seq":757,"reported_epoch":50,"state":"stale+remapped+peering","last_fresh":"2024-09-16T07:49:57.022733+0000","last_change":"2024-09-16T07:49:57.022733+0000","last_active":"2024-09-16T07:49:56.045212+0000","last_peered":"2024-09-16T07:49:55.933965+0000","last_clean":"2024-09-16T07:49:10.032608+0000","last_became_active":"2024-09-16T07:49:37.079648+0000","last_became_peered":"2024-09-16T07:49:37.079648+0000","last_unstale":"2024-09-16T07:50:33.416991+0000","last_undegraded":"2024-09-16T07:49:57.022733+0000","last_fullsized":"2024-09-16T07:49:57.022733+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19529728,"num_objects":298,"num_object_clones":0,"num_object_copies":894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"51'842","reported_seq":1079,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.075636+0000","last_change":"2024-09-16T07:50:12.078102+0000","last_active":"2024-09-16T07:50:12.075636+0000","last_peered":"2024-09-16T07:50:12.075636+0000","last_clean":"2024-09-16T07:49:09.643713+0000","last_became_active":"2024-09-16T07:50:12.071295+0000","last_became_peered":"2024-09-16T07:50:12.071295+0000","last_unstale":"2024-09-16T07:50:12.075636+0000","last_undegraded":"2024-09-16T07:50:12.075636+0000","last_fullsized":"2024-09-16T07:50:12.075636+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13565952,"num_objects":207,"num_object_clones":0,"num_object_copies":621,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":917504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"51'834","reported_seq":884,"reported_epoch":55,"state":"peering","last_fresh":"2024-09-16T07:50:33.485900+0000","last_change":"2024-09-16T07:50:33.485900+0000","last_active":"2024-09-16T07:50:33.485900+0000","last_peered":"2024-09-16T07:50:12.049292+0000","last_clean":"2024-09-16T07:50:12.049292+0000","last_became_active":"2024-09-16T07:48:59.204795+0000","last_became_peered":"2024-09-16T07:48:59.204795+0000","last_unstale":"2024-09-16T07:50:33.485900+0000","last_undegraded":"2024-09-16T07:50:33.485900+0000","last_fullsized":"2024-09-16T07:50:33.485900+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"51'781","reported_seq":1240,"reported_epoch":55,"state":"peering","last_fresh":"2024-09-16T07:50:34.441776+0000","last_change":"2024-09-16T07:50:11.038685+0000","last_active":"2024-09-16T07:50:11.038685+0000","last_peered":"2024-09-16T07:50:10.364142+0000","last_clean":"2024-09-16T07:49:09.862606+0000","last_became_active":"2024-09-16T07:49:58.562539+0000","last_became_peered":"2024-09-16T07:49:58.562539+0000","last_unstale":"2024-09-16T07:50:34.441776+0000","last_undegraded":"2024-09-16T07:50:34.441776+0000","last_fullsized":"2024-09-16T07:50:34.441776+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":781,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":720896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"51'840","reported_seq":897,"reported_epoch":55,"state":"peering","last_fresh":"2024-09-16T07:50:34.468719+0000","last_change":"2024-09-16T07:50:34.468719+0000","last_active":"2024-09-16T07:50:33.483377+0000","last_peered":"2024-09-16T07:50:12.043633+0000","last_clean":"2024-09-16T07:49:09.957827+0000","last_became_active":"2024-09-16T07:49:58.764095+0000","last_became_peered":"2024-09-16T07:49:58.764095+0000","last_unstale":"2024-09-16T07:50:34.468719+0000","last_undegraded":"2024-09-16T07:50:34.468719+0000","last_fullsized":"2024-09-16T07:50:34.468719+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"51'804","reported_seq":863,"reported_epoch":55,"state":"peering","last_fresh":"2024-09-16T07:50:34.468256+0000","last_change":"2024-09-16T07:50:34.468256+0000","last_active":"2024-09-16T07:50:33.479883+0000","last_peered":"2024-09-16T07:50:12.047807+0000","last_clean":"2024-09-16T07:49:10.093896+0000","last_became_active":"2024-09-16T07:49:58.815276+0000","last_became_peered":"2024-09-16T07:49:58.815276+0000","last_unstale":"2024-09-16T07:50:34.468256+0000","last_undegraded":"2024-09-16T07:50:34.468256+0000","last_fullsized":"2024-09-16T07:50:34.468256+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":170,"reported_epoch":50,"state":"stale+active+clean","last_fresh":"2024-09-16T07:49:57.107845+0000","last_change":"2024-09-16T07:49:57.109405+0000","last_active":"2024-09-16T07:49:57.107845+0000","last_peered":"2024-09-16T07:49:57.107845+0000","last_clean":"2024-09-16T07:48:59.162759+0000","last_became_active":"2024-09-16T07:49:57.100099+0000","last_became_peered":"2024-09-16T07:49:57.100099+0000","last_unstale":"2024-09-16T07:50:33.416994+0000","last_undegraded":"2024-09-16T07:49:57.107845+0000","last_fullsized":"2024-09-16T07:49:57.107845+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":142,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-16T07:50:34.462119+0000","last_change":"2024-09-16T07:49:58.396557+0000","last_active":"2024-09-16T07:50:34.462119+0000","last_peered":"2024-09-16T07:50:34.462119+0000","last_clean":"2024-09-16T07:50:34.462119+0000","last_became_active":"2024-09-16T07:49:57.137470+0000","last_became_peered":"2024-09-16T07:49:57.137470+0000","last_unstale":"2024-09-16T07:50:34.462119+0000","last_undegraded":"2024-09-16T07:50:34.462119+0000","last_fullsized":"2024-09-16T07:50:34.462119+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"51'762","reported_seq":810,"reported_epoch":53,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:12.029052+0000","last_change":"2024-09-16T07:49:58.677172+0000","last_active":"2024-09-16T07:50:12.029052+0000","last_peered":"2024-09-16T07:50:12.029052+0000","last_clean":"2024-09-16T07:49:09.958791+0000","last_became_active":"2024-09-16T07:49:58.672712+0000","last_became_peered":"2024-09-16T07:49:58.672712+0000","last_unstale":"2024-09-16T07:50:12.029052+0000","last_undegraded":"2024-09-16T07:49:58.061725+0000","last_fullsized":"2024-09-16T07:49:58.040772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":212,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":30080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[{"shards":"2,3","objects":163}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.040584+0000","last_change":"2024-09-16T07:49:58.011180+0000","last_active":"2024-09-16T07:50:12.040584+0000","last_peered":"2024-09-16T07:50:12.040584+0000","last_clean":"2024-09-16T07:50:12.040584+0000","last_became_active":"2024-09-16T07:49:57.236391+0000","last_became_peered":"2024-09-16T07:49:57.236391+0000","last_unstale":"2024-09-16T07:50:12.040584+0000","last_undegraded":"2024-09-16T07:50:12.040584+0000","last_fullsized":"2024-09-16T07:50:12.040584+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"51'834","reported_seq":894,"reported_epoch":53,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:12.030252+0000","last_change":"2024-09-16T07:49:58.725241+0000","last_active":"2024-09-16T07:50:12.030252+0000","last_peered":"2024-09-16T07:50:12.030252+0000","last_clean":"2024-09-16T07:49:10.122785+0000","last_became_active":"2024-09-16T07:49:58.528445+0000","last_became_peered":"2024-09-16T07:49:58.528445+0000","last_unstale":"2024-09-16T07:50:12.030252+0000","last_undegraded":"2024-09-16T07:49:58.038628+0000","last_fullsized":"2024-09-16T07:49:57.997292+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12976128,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":232,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[{"shards":"2,3","objects":189}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":136,"reported_epoch":55,"state":"peering","last_fresh":"2024-09-16T07:50:33.471773+0000","last_change":"2024-09-16T07:50:33.471773+0000","last_active":"2024-09-16T07:50:33.471773+0000","last_peered":"2024-09-16T07:50:12.038189+0000","last_clean":"2024-09-16T07:50:12.038189+0000","last_became_active":"2024-09-16T07:48:59.190243+0000","last_became_peered":"2024-09-16T07:48:59.190243+0000","last_unstale":"2024-09-16T07:50:33.471773+0000","last_undegraded":"2024-09-16T07:50:33.471773+0000","last_fullsized":"2024-09-16T07:50:33.471773+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"51'791","reported_seq":834,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.037342+0000","last_change":"2024-09-16T07:48:59.237906+0000","last_active":"2024-09-16T07:50:12.037342+0000","last_peered":"2024-09-16T07:50:12.037342+0000","last_clean":"2024-09-16T07:50:12.037342+0000","last_became_active":"2024-09-16T07:48:59.226292+0000","last_became_peered":"2024-09-16T07:48:59.226292+0000","last_unstale":"2024-09-16T07:50:12.037342+0000","last_undegraded":"2024-09-16T07:50:12.037342+0000","last_fullsized":"2024-09-16T07:50:12.037342+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12124160,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.034511+0000","last_change":"2024-09-16T07:49:58.008167+0000","last_active":"2024-09-16T07:50:12.034511+0000","last_peered":"2024-09-16T07:50:12.034511+0000","last_clean":"2024-09-16T07:50:12.034511+0000","last_became_active":"2024-09-16T07:49:57.238934+0000","last_became_peered":"2024-09-16T07:49:57.238934+0000","last_unstale":"2024-09-16T07:50:12.034511+0000","last_undegraded":"2024-09-16T07:50:12.034511+0000","last_fullsized":"2024-09-16T07:50:12.034511+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"51'828","reported_seq":874,"reported_epoch":55,"state":"peering","last_fresh":"2024-09-16T07:50:34.456126+0000","last_change":"2024-09-16T07:50:33.495941+0000","last_active":"2024-09-16T07:50:33.495941+0000","last_peered":"2024-09-16T07:50:12.054790+0000","last_clean":"2024-09-16T07:50:12.054790+0000","last_became_active":"2024-09-16T07:48:59.162338+0000","last_became_peered":"2024-09-16T07:48:59.162338+0000","last_unstale":"2024-09-16T07:50:34.456126+0000","last_undegraded":"2024-09-16T07:50:34.456126+0000","last_fullsized":"2024-09-16T07:50:34.456126+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12845056,"num_objects":196,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":828,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.037853+0000","last_change":"2024-09-16T07:49:58.104008+0000","last_active":"2024-09-16T07:50:12.037853+0000","last_peered":"2024-09-16T07:50:12.037853+0000","last_clean":"2024-09-16T07:50:12.037853+0000","last_became_active":"2024-09-16T07:49:57.121907+0000","last_became_peered":"2024-09-16T07:49:57.121907+0000","last_unstale":"2024-09-16T07:50:12.037853+0000","last_undegraded":"2024-09-16T07:50:12.037853+0000","last_fullsized":"2024-09-16T07:50:12.037853+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"51'853","reported_seq":1108,"reported_epoch":55,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T07:50:35.338313+0000","last_change":"2024-09-16T07:50:33.914755+0000","last_active":"2024-09-16T07:50:35.338313+0000","last_peered":"2024-09-16T07:50:35.338313+0000","last_clean":"2024-09-16T07:49:09.929334+0000","last_became_active":"2024-09-16T07:49:58.753036+0000","last_became_peered":"2024-09-16T07:49:58.753036+0000","last_unstale":"2024-09-16T07:50:35.338313+0000","last_undegraded":"2024-09-16T07:50:35.338313+0000","last_fullsized":"2024-09-16T07:49:58.190626+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":1179648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":182}],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":100,"reported_epoch":50,"state":"stale+active+clean","last_fresh":"2024-09-16T07:49:57.103227+0000","last_change":"2024-09-16T07:49:57.105128+0000","last_active":"2024-09-16T07:49:57.103227+0000","last_peered":"2024-09-16T07:49:57.103227+0000","last_clean":"2024-09-16T07:48:59.171098+0000","last_became_active":"2024-09-16T07:49:57.094727+0000","last_became_peered":"2024-09-16T07:49:57.094727+0000","last_unstale":"2024-09-16T07:50:33.416997+0000","last_undegraded":"2024-09-16T07:49:57.103227+0000","last_fullsized":"2024-09-16T07:49:57.103227+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"51'853","reported_seq":890,"reported_epoch":51,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:05.250560+0000","last_change":"2024-09-16T07:49:58.698367+0000","last_active":"2024-09-16T07:50:05.250560+0000","last_peered":"2024-09-16T07:50:05.250560+0000","last_clean":"2024-09-16T07:49:09.939114+0000","last_became_active":"2024-09-16T07:49:58.690011+0000","last_became_peered":"2024-09-16T07:49:58.690011+0000","last_unstale":"2024-09-16T07:50:05.250560+0000","last_undegraded":"2024-09-16T07:49:58.024807+0000","last_fullsized":"2024-09-16T07:49:57.996602+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15597568,"num_objects":238,"num_object_clones":0,"num_object_copies":714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":252,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":219}],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.042530+0000","last_change":"2024-09-16T07:49:58.098573+0000","last_active":"2024-09-16T07:50:12.042530+0000","last_peered":"2024-09-16T07:50:12.042530+0000","last_clean":"2024-09-16T07:50:12.042530+0000","last_became_active":"2024-09-16T07:49:57.173511+0000","last_became_peered":"2024-09-16T07:49:57.173511+0000","last_unstale":"2024-09-16T07:50:12.042530+0000","last_undegraded":"2024-09-16T07:50:12.042530+0000","last_fullsized":"2024-09-16T07:50:12.042530+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"51'777","reported_seq":1256,"reported_epoch":55,"state":"peering","last_fresh":"2024-09-16T07:50:34.454146+0000","last_change":"2024-09-16T07:50:11.042584+0000","last_active":"2024-09-16T07:50:11.042584+0000","last_peered":"2024-09-16T07:50:10.545674+0000","last_clean":"2024-09-16T07:49:09.730753+0000","last_became_active":"2024-09-16T07:49:58.587279+0000","last_became_peered":"2024-09-16T07:49:58.587279+0000","last_unstale":"2024-09-16T07:50:34.454146+0000","last_undegraded":"2024-09-16T07:50:34.454146+0000","last_fullsized":"2024-09-16T07:50:34.454146+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13041664,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":141,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-16T07:50:34.460898+0000","last_change":"2024-09-16T07:49:58.493420+0000","last_active":"2024-09-16T07:50:34.460898+0000","last_peered":"2024-09-16T07:50:34.460898+0000","last_clean":"2024-09-16T07:50:34.460898+0000","last_became_active":"2024-09-16T07:49:57.161510+0000","last_became_peered":"2024-09-16T07:49:57.161510+0000","last_unstale":"2024-09-16T07:50:34.460898+0000","last_undegraded":"2024-09-16T07:50:34.460898+0000","last_fullsized":"2024-09-16T07:50:34.460898+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":209911832,"num_objects":3204,"num_object_clones":0,"num_object_copies":9612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":921,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12976,"num_write_kb":517697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":869,"num_bytes_recovered":6029336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50511872,"data_stored":808058928,"data_compressed":38370333,"data_compressed_allocated":50503680,"data_compressed_original":808058880,"omap_allocated":0,"internal_metadata":0},"log_size":12982,"ondisk_log_size":12982,"up":48,"acting":41,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":45,"seq":193273528379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51976,"kb_used_data":15544,"kb_used_omap":0,"kb_used_meta":36416,"kb_avail":94319864,"statfs":{"total":96636764160,"available":96583540736,"internally_reserved":0,"allocated":15917056,"data_stored":247753096,"data_compressed":11759169,"data_compressed_allocated":15478784,"data_compressed_original":247578624,"omap_allocated":0,"internal_metadata":37289984},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784248076,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61528,"kb_used_data":8072,"kb_used_omap":0,"kb_used_meta":53440,"kb_avail":94310312,"statfs":{"total":96636764160,"available":96573759488,"internally_reserved":0,"allocated":8265728,"data_stored":124818379,"data_compressed":5921057,"data_compressed_allocated":7794688,"data_compressed_original":124633088,"omap_allocated":0,"internal_metadata":54722560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55424,"kb_used_data":10544,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94316416,"statfs":{"total":96636764160,"available":96580009984,"internally_reserved":0,"allocated":10797056,"data_stored":165458086,"data_compressed":7848464,"data_compressed_allocated":10330112,"data_compressed_original":165281792,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":49,"seq":210453397534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51144,"kb_used_data":17080,"kb_used_omap":0,"kb_used_meta":34048,"kb_avail":94320696,"statfs":{"total":96636764160,"available":96584392704,"internally_reserved":0,"allocated":17489920,"data_stored":272470963,"data_compressed":12931766,"data_compressed_allocated":17022976,"data_compressed_original":272285696,"omap_allocated":0,"internal_metadata":34865152},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16982016,"data_stored":271712256,"data_compressed":12901725,"data_compressed_allocated":16982016,"data_compressed_original":271712256,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10334208,"data_stored":165281816,"data_compressed":7848464,"data_compressed_allocated":10330112,"data_compressed_original":165281792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7757824,"data_stored":124059672,"data_compressed":5891016,"data_compressed_allocated":7753728,"data_compressed_original":124059648,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15437824,"data_stored":247005184,"data_compressed":11729128,"data_compressed_allocated":15437824,"data_compressed_original":247005184,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:50:45.326 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg force-backfill 4.f 4.0 2024-09-16T07:50:45.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:45.449+0000 7f55c0f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:45.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:50:45.461+0000 7f55c0f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:45.659 INFO:teuthology.orchestra.run.smithi003.stderr:instructing pg(s) [4.0] on osd.0 to force-backfill; instructing pg(s) [4.f] on osd.2 to force-backfill; 2024-09-16T07:50:45.659 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T07:50:50.675 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2] live_osds: [1, 0, 3] 2024-09-16T07:50:50.675 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:50:50.675 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [1, 0, 3] 2024-09-16T07:50:50.675 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T07:50:50.676 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:50:50.770 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T07:50:55.771 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2, 0] live_osds: [1, 3] 2024-09-16T07:50:55.771 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:50:55.771 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-09-16T07:50:55.772 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T07:50:55.772 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T07:50:55.775 INFO:tasks.ceph.osd.2:Started 2024-09-16T07:50:55.775 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T07:50:55.887 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:50:55.890 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:55.891 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-16T07:51:00.892 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T07:51:00.990 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:51:01.029 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:01.029 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-16T07:51:05.476 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:51:05.587 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:51:05.587 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:51:06.030 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T07:51:06.134 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-16T07:51:06.134 INFO:teuthology.orchestra.run.smithi134.stdout: "ops_in_flight": [] 2024-09-16T07:51:06.134 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-16T07:51:07.588 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:07.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:07.703+0000 7f2b35d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:07.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:07.709+0000 7f2b35d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:11.144 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [1, 3, 2] 2024-09-16T07:51:11.144 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:51:11.145 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:51:11.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:11.269+0000 7fae4bd48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:11.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:11.278+0000 7fae4bd48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:11.473 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:51:11.706 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:51:11.707 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-09-16T07:51:10.365613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":178389568,"num_objects":2718,"num_object_clones":0,"num_object_copies":8154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1139,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13546,"num_write_kb":518804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1583,"num_bytes_recovered":8126488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13528,"ondisk_log_size":13528,"up":75,"acting":69,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":207272,"kb_used_data":41832,"kb_used_omap":0,"kb_used_meta":165376,"kb_avail":377280088,"statfs":{"total":386547056640,"available":386334810112,"internally_reserved":0,"allocated":42835968,"data_stored":655467765,"data_compressed":31097464,"data_compressed_allocated":40935424,"data_compressed_original":654721024,"omap_allocated":0,"internal_metadata":169345024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-23396352,"num_objects":-357,"num_object_clones":0,"num_object_copies":-1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":218,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":486,"num_bytes_recovered":1179648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001485"},"pg_stats":[{"pgid":"4.f","version":"51'828","reported_seq":891,"reported_epoch":53,"state":"stale+active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:12.027853+0000","last_change":"2024-09-16T07:49:58.841604+0000","last_active":"2024-09-16T07:50:12.027853+0000","last_peered":"2024-09-16T07:50:12.027853+0000","last_clean":"2024-09-16T07:49:10.054365+0000","last_became_active":"2024-09-16T07:49:58.521087+0000","last_became_peered":"2024-09-16T07:49:58.521087+0000","last_unstale":"2024-09-16T07:51:05.474984+0000","last_undegraded":"2024-09-16T07:49:58.087770+0000","last_fullsized":"2024-09-16T07:49:58.066039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":225,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":828,"num_write_kb":32448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[{"shards":"2,3","objects":178}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"51'797","reported_seq":845,"reported_epoch":53,"state":"stale+active+clean","last_fresh":"2024-09-16T07:50:12.040493+0000","last_change":"2024-09-16T07:48:59.455893+0000","last_active":"2024-09-16T07:50:12.040493+0000","last_peered":"2024-09-16T07:50:12.040493+0000","last_clean":"2024-09-16T07:50:12.040493+0000","last_became_active":"2024-09-16T07:48:59.248866+0000","last_became_peered":"2024-09-16T07:48:59.248866+0000","last_unstale":"2024-09-16T07:51:05.474986+0000","last_undegraded":"2024-09-16T07:50:12.040493+0000","last_fullsized":"2024-09-16T07:50:12.040493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":31488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"56'871","reported_seq":1153,"reported_epoch":56,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:39.680601+0000","last_change":"2024-09-16T07:50:35.900063+0000","last_active":"2024-09-16T07:50:39.680601+0000","last_peered":"2024-09-16T07:50:39.680601+0000","last_clean":"2024-09-16T07:49:10.022860+0000","last_became_active":"2024-09-16T07:49:58.714848+0000","last_became_peered":"2024-09-16T07:49:58.714848+0000","last_unstale":"2024-09-16T07:50:39.680601+0000","last_undegraded":"2024-09-16T07:50:35.895007+0000","last_fullsized":"2024-09-16T07:49:58.457685+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519704,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":107,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":871,"num_write_kb":32001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":917528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":131}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"56'861","reported_seq":1365,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:50:46.024541+0000","last_change":"2024-09-16T07:50:46.025662+0000","last_active":"2024-09-16T07:50:46.024541+0000","last_peered":"2024-09-16T07:50:46.024541+0000","last_clean":"2024-09-16T07:49:10.032608+0000","last_became_active":"2024-09-16T07:50:35.763979+0000","last_became_peered":"2024-09-16T07:50:35.763979+0000","last_unstale":"2024-09-16T07:50:46.024541+0000","last_undegraded":"2024-09-16T07:50:46.024541+0000","last_fullsized":"2024-09-16T07:50:46.024541+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813440,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":917504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"51'842","reported_seq":1079,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.075636+0000","last_change":"2024-09-16T07:50:12.078102+0000","last_active":"2024-09-16T07:50:12.075636+0000","last_peered":"2024-09-16T07:50:12.075636+0000","last_clean":"2024-09-16T07:49:09.643713+0000","last_became_active":"2024-09-16T07:50:12.071295+0000","last_became_peered":"2024-09-16T07:50:12.071295+0000","last_unstale":"2024-09-16T07:50:12.075636+0000","last_undegraded":"2024-09-16T07:50:12.075636+0000","last_fullsized":"2024-09-16T07:50:12.075636+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13565952,"num_objects":207,"num_object_clones":0,"num_object_copies":621,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":917504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"56'874","reported_seq":932,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:50:39.524847+0000","last_change":"2024-09-16T07:50:35.724659+0000","last_active":"2024-09-16T07:50:39.524847+0000","last_peered":"2024-09-16T07:50:39.524847+0000","last_clean":"2024-09-16T07:50:39.524847+0000","last_became_active":"2024-09-16T07:50:35.714550+0000","last_became_peered":"2024-09-16T07:50:35.714550+0000","last_unstale":"2024-09-16T07:50:39.524847+0000","last_undegraded":"2024-09-16T07:50:39.524847+0000","last_fullsized":"2024-09-16T07:50:39.524847+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":160,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"56'827","reported_seq":1299,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:50:45.337939+0000","last_change":"2024-09-16T07:50:45.339475+0000","last_active":"2024-09-16T07:50:45.337939+0000","last_peered":"2024-09-16T07:50:45.337939+0000","last_clean":"2024-09-16T07:49:09.862606+0000","last_became_active":"2024-09-16T07:50:35.756757+0000","last_became_peered":"2024-09-16T07:50:35.756757+0000","last_unstale":"2024-09-16T07:50:45.337939+0000","last_undegraded":"2024-09-16T07:50:45.337939+0000","last_fullsized":"2024-09-16T07:50:45.337939+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":720896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"56'883","reported_seq":1419,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:50:42.641642+0000","last_change":"2024-09-16T07:50:42.643281+0000","last_active":"2024-09-16T07:50:42.641642+0000","last_peered":"2024-09-16T07:50:42.641642+0000","last_clean":"2024-09-16T07:49:09.957827+0000","last_became_active":"2024-09-16T07:50:35.781477+0000","last_became_peered":"2024-09-16T07:50:35.781477+0000","last_unstale":"2024-09-16T07:50:42.641642+0000","last_undegraded":"2024-09-16T07:50:42.641642+0000","last_fullsized":"2024-09-16T07:50:42.641642+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":883,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":589824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"56'858","reported_seq":1401,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:50:45.301703+0000","last_change":"2024-09-16T07:50:45.303707+0000","last_active":"2024-09-16T07:50:45.301703+0000","last_peered":"2024-09-16T07:50:45.301703+0000","last_clean":"2024-09-16T07:49:10.093896+0000","last_became_active":"2024-09-16T07:50:35.779557+0000","last_became_peered":"2024-09-16T07:50:35.779557+0000","last_unstale":"2024-09-16T07:50:45.301703+0000","last_undegraded":"2024-09-16T07:50:45.301703+0000","last_fullsized":"2024-09-16T07:50:45.301703+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":858,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":237,"num_bytes_recovered":917504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":179,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:50:35.759970+0000","last_change":"2024-09-16T07:50:35.762014+0000","last_active":"2024-09-16T07:50:35.759970+0000","last_peered":"2024-09-16T07:50:35.759970+0000","last_clean":"2024-09-16T07:49:57.109405+0000","last_became_active":"2024-09-16T07:50:35.751163+0000","last_became_peered":"2024-09-16T07:50:35.751163+0000","last_unstale":"2024-09-16T07:50:35.759970+0000","last_undegraded":"2024-09-16T07:50:35.759970+0000","last_fullsized":"2024-09-16T07:50:35.759970+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":145,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:50:35.571363+0000","last_change":"2024-09-16T07:49:58.396557+0000","last_active":"2024-09-16T07:50:35.571363+0000","last_peered":"2024-09-16T07:50:35.571363+0000","last_clean":"2024-09-16T07:50:35.571363+0000","last_became_active":"2024-09-16T07:49:57.137470+0000","last_became_peered":"2024-09-16T07:49:57.137470+0000","last_unstale":"2024-09-16T07:50:35.571363+0000","last_undegraded":"2024-09-16T07:50:35.571363+0000","last_fullsized":"2024-09-16T07:50:35.571363+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"51'762","reported_seq":810,"reported_epoch":53,"state":"stale+active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:12.029052+0000","last_change":"2024-09-16T07:49:58.677172+0000","last_active":"2024-09-16T07:50:12.029052+0000","last_peered":"2024-09-16T07:50:12.029052+0000","last_clean":"2024-09-16T07:49:09.958791+0000","last_became_active":"2024-09-16T07:49:58.672712+0000","last_became_peered":"2024-09-16T07:49:58.672712+0000","last_unstale":"2024-09-16T07:51:05.474990+0000","last_undegraded":"2024-09-16T07:49:58.061725+0000","last_fullsized":"2024-09-16T07:49:58.040772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":212,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":30080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[{"shards":"2,3","objects":163}],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.040584+0000","last_change":"2024-09-16T07:49:58.011180+0000","last_active":"2024-09-16T07:50:12.040584+0000","last_peered":"2024-09-16T07:50:12.040584+0000","last_clean":"2024-09-16T07:50:12.040584+0000","last_became_active":"2024-09-16T07:49:57.236391+0000","last_became_peered":"2024-09-16T07:49:57.236391+0000","last_unstale":"2024-09-16T07:50:12.040584+0000","last_undegraded":"2024-09-16T07:50:12.040584+0000","last_fullsized":"2024-09-16T07:50:12.040584+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"51'834","reported_seq":894,"reported_epoch":53,"state":"stale+active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:12.030252+0000","last_change":"2024-09-16T07:49:58.725241+0000","last_active":"2024-09-16T07:50:12.030252+0000","last_peered":"2024-09-16T07:50:12.030252+0000","last_clean":"2024-09-16T07:49:10.122785+0000","last_became_active":"2024-09-16T07:49:58.528445+0000","last_became_peered":"2024-09-16T07:49:58.528445+0000","last_unstale":"2024-09-16T07:51:05.474992+0000","last_undegraded":"2024-09-16T07:49:58.038628+0000","last_fullsized":"2024-09-16T07:49:57.997292+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12976128,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":232,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[{"shards":"2,3","objects":189}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":144,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:50:35.714739+0000","last_change":"2024-09-16T07:50:35.716295+0000","last_active":"2024-09-16T07:50:35.714739+0000","last_peered":"2024-09-16T07:50:35.714739+0000","last_clean":"2024-09-16T07:50:12.038189+0000","last_became_active":"2024-09-16T07:50:35.709962+0000","last_became_peered":"2024-09-16T07:50:35.709962+0000","last_unstale":"2024-09-16T07:50:35.714739+0000","last_undegraded":"2024-09-16T07:50:35.714739+0000","last_fullsized":"2024-09-16T07:50:35.714739+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"51'791","reported_seq":834,"reported_epoch":53,"state":"stale+active+clean","last_fresh":"2024-09-16T07:50:12.037342+0000","last_change":"2024-09-16T07:48:59.237906+0000","last_active":"2024-09-16T07:50:12.037342+0000","last_peered":"2024-09-16T07:50:12.037342+0000","last_clean":"2024-09-16T07:50:12.037342+0000","last_became_active":"2024-09-16T07:48:59.226292+0000","last_became_peered":"2024-09-16T07:48:59.226292+0000","last_unstale":"2024-09-16T07:51:05.474994+0000","last_undegraded":"2024-09-16T07:50:12.037342+0000","last_fullsized":"2024-09-16T07:50:12.037342+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12124160,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.034511+0000","last_change":"2024-09-16T07:49:58.008167+0000","last_active":"2024-09-16T07:50:12.034511+0000","last_peered":"2024-09-16T07:50:12.034511+0000","last_clean":"2024-09-16T07:50:12.034511+0000","last_became_active":"2024-09-16T07:49:57.238934+0000","last_became_peered":"2024-09-16T07:49:57.238934+0000","last_unstale":"2024-09-16T07:50:12.034511+0000","last_undegraded":"2024-09-16T07:50:12.034511+0000","last_fullsized":"2024-09-16T07:50:12.034511+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"56'879","reported_seq":935,"reported_epoch":56,"state":"active+recovery_wait","last_fresh":"2024-09-16T07:50:39.710449+0000","last_change":"2024-09-16T07:50:35.962234+0000","last_active":"2024-09-16T07:50:39.710449+0000","last_peered":"2024-09-16T07:50:39.710449+0000","last_clean":"2024-09-16T07:50:12.054790+0000","last_became_active":"2024-09-16T07:50:35.756461+0000","last_became_peered":"2024-09-16T07:50:35.756461+0000","last_unstale":"2024-09-16T07:50:39.710449+0000","last_undegraded":"2024-09-16T07:50:39.710449+0000","last_fullsized":"2024-09-16T07:50:39.710449+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":879,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":["1","2","3"],"object_location_counts":[{"shards":"1,2,3","objects":145}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"stale+active+clean","last_fresh":"2024-09-16T07:50:12.037853+0000","last_change":"2024-09-16T07:49:58.104008+0000","last_active":"2024-09-16T07:50:12.037853+0000","last_peered":"2024-09-16T07:50:12.037853+0000","last_clean":"2024-09-16T07:50:12.037853+0000","last_became_active":"2024-09-16T07:49:57.121907+0000","last_became_peered":"2024-09-16T07:49:57.121907+0000","last_unstale":"2024-09-16T07:51:05.474996+0000","last_undegraded":"2024-09-16T07:50:12.037853+0000","last_fullsized":"2024-09-16T07:50:12.037853+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"56'893","reported_seq":1170,"reported_epoch":56,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:39.603342+0000","last_change":"2024-09-16T07:50:35.804732+0000","last_active":"2024-09-16T07:50:39.603342+0000","last_peered":"2024-09-16T07:50:39.603342+0000","last_clean":"2024-09-16T07:49:09.929334+0000","last_became_active":"2024-09-16T07:49:58.753036+0000","last_became_peered":"2024-09-16T07:49:58.753036+0000","last_unstale":"2024-09-16T07:50:39.603342+0000","last_undegraded":"2024-09-16T07:50:35.801430+0000","last_fullsized":"2024-09-16T07:49:58.190626+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306112,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":111,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":1179648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1,2","objects":142}],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:50:35.764683+0000","last_change":"2024-09-16T07:50:35.766370+0000","last_active":"2024-09-16T07:50:35.764683+0000","last_peered":"2024-09-16T07:50:35.764683+0000","last_clean":"2024-09-16T07:49:57.105128+0000","last_became_active":"2024-09-16T07:50:35.756606+0000","last_became_peered":"2024-09-16T07:50:35.756606+0000","last_unstale":"2024-09-16T07:50:35.764683+0000","last_undegraded":"2024-09-16T07:50:35.764683+0000","last_fullsized":"2024-09-16T07:50:35.764683+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"51'853","reported_seq":890,"reported_epoch":51,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:50:05.250560+0000","last_change":"2024-09-16T07:49:58.698367+0000","last_active":"2024-09-16T07:50:05.250560+0000","last_peered":"2024-09-16T07:50:05.250560+0000","last_clean":"2024-09-16T07:49:09.939114+0000","last_became_active":"2024-09-16T07:49:58.690011+0000","last_became_peered":"2024-09-16T07:49:58.690011+0000","last_unstale":"2024-09-16T07:50:05.250560+0000","last_undegraded":"2024-09-16T07:49:58.024807+0000","last_fullsized":"2024-09-16T07:49:57.996602+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15597568,"num_objects":238,"num_object_clones":0,"num_object_copies":714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":252,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":219}],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"stale+active+clean","last_fresh":"2024-09-16T07:50:12.042530+0000","last_change":"2024-09-16T07:49:58.098573+0000","last_active":"2024-09-16T07:50:12.042530+0000","last_peered":"2024-09-16T07:50:12.042530+0000","last_clean":"2024-09-16T07:50:12.042530+0000","last_became_active":"2024-09-16T07:49:57.173511+0000","last_became_peered":"2024-09-16T07:49:57.173511+0000","last_unstale":"2024-09-16T07:51:05.474998+0000","last_undegraded":"2024-09-16T07:50:12.042530+0000","last_fullsized":"2024-09-16T07:50:12.042530+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"56'820","reported_seq":1312,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:50:39.711833+0000","last_change":"2024-09-16T07:50:35.887448+0000","last_active":"2024-09-16T07:50:39.711833+0000","last_peered":"2024-09-16T07:50:39.711833+0000","last_clean":"2024-09-16T07:50:39.711833+0000","last_became_active":"2024-09-16T07:50:35.734820+0000","last_became_peered":"2024-09-16T07:50:35.734820+0000","last_unstale":"2024-09-16T07:50:39.711833+0000","last_undegraded":"2024-09-16T07:50:39.711833+0000","last_fullsized":"2024-09-16T07:50:39.711833+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:05.986264+0000","last_clean_scrub_stamp":"2024-09-16T07:48:05.986264+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":820,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-16T07:50:35.498924+0000","last_change":"2024-09-16T07:49:58.493420+0000","last_active":"2024-09-16T07:50:35.498924+0000","last_peered":"2024-09-16T07:50:35.498924+0000","last_clean":"2024-09-16T07:50:35.498924+0000","last_became_active":"2024-09-16T07:49:57.161510+0000","last_became_peered":"2024-09-16T07:49:57.161510+0000","last_unstale":"2024-09-16T07:50:35.498924+0000","last_undegraded":"2024-09-16T07:50:35.498924+0000","last_fullsized":"2024-09-16T07:50:35.498924+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":177799192,"num_objects":2714,"num_object_clones":0,"num_object_copies":8142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1139,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13466,"num_write_kb":517697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1583,"num_bytes_recovered":8126488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40820736,"data_stored":653000752,"data_compressed":31007341,"data_compressed_allocated":40812544,"data_compressed_original":653000704,"omap_allocated":0,"internal_metadata":0},"log_size":13473,"ondisk_log_size":13473,"up":48,"acting":42,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201309,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37272,"kb_used_data":8392,"kb_used_omap":0,"kb_used_meta":28864,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":8593408,"data_stored":129810358,"data_compressed":6157569,"data_compressed_allocated":8105984,"data_compressed_original":129613824,"omap_allocated":0,"internal_metadata":29556736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":23,"seq":98784248076,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61528,"kb_used_data":8072,"kb_used_omap":0,"kb_used_meta":53440,"kb_avail":94310312,"statfs":{"total":96636764160,"available":96573759488,"internally_reserved":0,"allocated":8265728,"data_stored":124818379,"data_compressed":5921057,"data_compressed_allocated":7794688,"data_compressed_original":124633088,"omap_allocated":0,"internal_metadata":54722560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":57328,"kb_used_data":8288,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94314512,"statfs":{"total":96636764160,"available":96578060288,"internally_reserved":0,"allocated":8486912,"data_stored":128368065,"data_compressed":6087072,"data_compressed_allocated":8011776,"data_compressed_original":128188416,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":49,"seq":210453397534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51144,"kb_used_data":17080,"kb_used_omap":0,"kb_used_meta":34048,"kb_avail":94320696,"statfs":{"total":96636764160,"available":96584392704,"internally_reserved":0,"allocated":17489920,"data_stored":272470963,"data_compressed":12931766,"data_compressed_allocated":17022976,"data_compressed_original":272285696,"omap_allocated":0,"internal_metadata":34865152},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16982016,"data_stored":271712256,"data_compressed":12901725,"data_compressed_allocated":16982016,"data_compressed_original":271712256,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8015872,"data_stored":128188440,"data_compressed":6087072,"data_compressed_allocated":8011776,"data_compressed_original":128188416,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7757824,"data_stored":124059672,"data_compressed":5891016,"data_compressed_allocated":7753728,"data_compressed_original":124059648,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8065024,"data_stored":129040384,"data_compressed":6127528,"data_compressed_allocated":8065024,"data_compressed_original":129040384,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:51:16.710 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [1, 3, 2] 2024-09-16T07:51:16.710 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:51:16.710 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-16T07:51:16.710 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:51:16.711 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T07:51:16.720 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:51:16.720 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:51:16.853 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:51:16.858 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:16.859 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:51:16.996 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:51:17.198 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:51:17.198 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:51:19.199 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:19.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:19.331+0000 7ff65c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:19.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:19.340+0000 7ff65c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:19.348 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:51:19.844 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:51:19.844 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:51:21.845 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:21.860 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:51:21.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:21.978+0000 7f834baac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:21.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:21.985+0000 7f834baac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:21.993 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:51:22.036 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:51:22.040 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:22.040 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:51:22.429 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:51:22.430 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:51:24.430 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:24.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:24.626+0000 7fe3c9d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:24.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:24.638+0000 7fe3c9d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:24.652 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:51:25.095 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:51:25.096 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:51:27.041 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:51:27.097 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:27.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:27.255+0000 7fd149751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:27.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:27.265+0000 7fd149751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:27.310 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T07:51:27.310 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [ 2024-09-16T07:51:27.310 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.310 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:27.310 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777299, 2024-09-16T07:51:27.310 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.310 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:27.310 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "2", 2024-09-16T07:51:27.311 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "4.f", 2024-09-16T07:51:27.311 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 63, 2024-09-16T07:51:27.311 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 63, 2024-09-16T07:51:27.311 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 63 epoch_requested: 63 MQuery 4.f from 2 query_epoch 63 query: query(info 0'0 epoch_sent 63)", 2024-09-16T07:51:27.311 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:27.311 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.311 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.311 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.197298+0000" 2024-09-16T07:51:27.311 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.311 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.311 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:27.311 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.197307+0000" 2024-09-16T07:51:27.312 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.312 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.312 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.312 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.312 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:27.312 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.197543+0000" 2024-09-16T07:51:27.312 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.312 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.313 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.313 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.313 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.313 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:27.313 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.313 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.313 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.313 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.313 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.313 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.313 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.313 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:27.313 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.197844+0000" 2024-09-16T07:51:27.314 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.314 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.314 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.314 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.314 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.314 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.314 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:27.314 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.207000+0000" 2024-09-16T07:51:27.314 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.314 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.314 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.314 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.315 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.315 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.315 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:27.315 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.315 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.315 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.315 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.315 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.315 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.315 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.315 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:27.316 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.262114+0000" 2024-09-16T07:51:27.316 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.316 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.316 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.316 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.316 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.316 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.316 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.316 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.316 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.317 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.317 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.317 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:27.317 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.264978+0000" 2024-09-16T07:51:27.317 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.317 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.317 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.317 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.317 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.317 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.317 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.317 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.318 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.318 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:27.318 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.318 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.318 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.318 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.318 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:27.318 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777298, 2024-09-16T07:51:27.318 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.318 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:27.318 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "2", 2024-09-16T07:51:27.318 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.4", 2024-09-16T07:51:27.318 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 63, 2024-09-16T07:51:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 62, 2024-09-16T07:51:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 63 epoch_requested: 62 MLogRec from 2 log log((0'0,0'0], crt=0'0) pi ([0,0] all_participants={} intervals=[]) pg_lease(ru 0.000000000s ub 46.205341339s int 16.000000000s) +create_info", 2024-09-16T07:51:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.196155+0000" 2024-09-16T07:51:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.196165+0000" 2024-09-16T07:51:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.319 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.320 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:27.320 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.196409+0000" 2024-09-16T07:51:27.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.320 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.320 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.320 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:27.320 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.321 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.321 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:27.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.196686+0000" 2024-09-16T07:51:27.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.321 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.322 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:27.322 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.205128+0000" 2024-09-16T07:51:27.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.322 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.322 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.322 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:27.322 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.322 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.323 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.323 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:27.323 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.256772+0000" 2024-09-16T07:51:27.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.323 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.323 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.323 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.323 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.324 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.324 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:27.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.262152+0000" 2024-09-16T07:51:27.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.324 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.324 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.325 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.325 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.325 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.325 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:27.325 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.325 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.325 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.325 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.325 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:27.325 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777301, 2024-09-16T07:51:27.325 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.325 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:27.325 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "2", 2024-09-16T07:51:27.325 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.2", 2024-09-16T07:51:27.326 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 63, 2024-09-16T07:51:27.326 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 63, 2024-09-16T07:51:27.326 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 63 epoch_requested: 63 MInfoRec from 2 info: 2.2( v 15'2 (0'0,15'2] local-lis/les=62/63 n=1 ec=12/12 lis/c=62/49 les/c/f=63/50/0 sis=62 pruub=7.013277054s) pg_lease_ack(ruub 24.981243134s)", 2024-09-16T07:51:27.326 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:27.326 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.216477+0000" 2024-09-16T07:51:27.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.326 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:27.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.216487+0000" 2024-09-16T07:51:27.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.326 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.327 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.327 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:27.327 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.216783+0000" 2024-09-16T07:51:27.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.327 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.327 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.327 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:27.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.328 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.328 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:27.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.217222+0000" 2024-09-16T07:51:27.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.329 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.329 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.329 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:27.329 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.253139+0000" 2024-09-16T07:51:27.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.329 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.330 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.330 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:27.330 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.330 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.330 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.330 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:27.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.274121+0000" 2024-09-16T07:51:27.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.331 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.331 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.332 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.332 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.332 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:27.332 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.277575+0000" 2024-09-16T07:51:27.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.332 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.333 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.333 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.333 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.333 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.333 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.333 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.333 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.333 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:27.333 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.334 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.334 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.334 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:27.334 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777303, 2024-09-16T07:51:27.334 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.334 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:27.334 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "2", 2024-09-16T07:51:27.334 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "4.f", 2024-09-16T07:51:27.334 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 63, 2024-09-16T07:51:27.334 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 63, 2024-09-16T07:51:27.335 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 63 epoch_requested: 63 MQuery 4.f from 2 query_epoch 63 query: query(log 56'0 ec=41/41 lis/c=60/45 les/c/f=61/46/0 sis=63 pruub=6.863919258s epoch_sent 63)", 2024-09-16T07:51:27.335 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:27.335 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.335 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.235682+0000" 2024-09-16T07:51:27.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.335 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:27.335 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.235697+0000" 2024-09-16T07:51:27.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.336 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.336 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.336 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:27.336 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.236028+0000" 2024-09-16T07:51:27.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.336 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.337 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.337 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:27.337 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.337 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.338 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.338 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:27.338 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.236217+0000" 2024-09-16T07:51:27.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.338 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.338 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.339 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.339 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:27.339 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.253723+0000" 2024-09-16T07:51:27.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.339 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.339 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.339 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.339 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.339 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:27.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.340 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.340 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:27.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.276595+0000" 2024-09-16T07:51:27.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.341 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.341 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.341 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.341 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.341 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.342 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:27.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.277741+0000", 2024-09-16T07:51:27.343 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:51:27.343 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PeeringEvent::PGPipeline::process", 2024-09-16T07:51:27.343 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.343 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T07:51:27.343 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 16777299 2024-09-16T07:51:27.343 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.343 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.343 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.343 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.343 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.344 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.344 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.344 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.344 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:27.344 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.344 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.344 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.344 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:27.344 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 103, 2024-09-16T07:51:27.344 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.344 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:27.345 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "0", 2024-09-16T07:51:27.345 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "4.1", 2024-09-16T07:51:27.345 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 63, 2024-09-16T07:51:27.345 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 63, 2024-09-16T07:51:27.345 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 63 epoch_requested: 63 ActivateCommitted from 63 processed at 63", 2024-09-16T07:51:27.345 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:27.345 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.345 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.345 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:27.345 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.261478+0000" 2024-09-16T07:51:27.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.346 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.346 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.346 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.347 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:27.347 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.271271+0000" 2024-09-16T07:51:27.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.347 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.347 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.347 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.347 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.347 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.347 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:27.348 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.348 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.348 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.348 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:27.348 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 105, 2024-09-16T07:51:27.348 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.348 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:27.348 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "0", 2024-09-16T07:51:27.348 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "4.7", 2024-09-16T07:51:27.348 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 63, 2024-09-16T07:51:27.348 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 63, 2024-09-16T07:51:27.349 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 63 epoch_requested: 63 ActivateCommitted from 63 processed at 63", 2024-09-16T07:51:27.349 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:27.349 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.349 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.349 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:27.349 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.272146+0000" 2024-09-16T07:51:27.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.349 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.349 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.273725+0000" 2024-09-16T07:51:27.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.351 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:51:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 57, 2024-09-16T07:51:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.368385+0000" 2024-09-16T07:51:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.368403+0000" 2024-09-16T07:51:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.352 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.370078+0000" 2024-09-16T07:51:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.371287+0000" 2024-09-16T07:51:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.375551+0000" 2024-09-16T07:51:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:51:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.375970+0000" 2024-09-16T07:51:27.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.357 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:51:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.376182+0000" 2024-09-16T07:51:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:51:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.376280+0000", 2024-09-16T07:51:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:51:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PGActivationBlocker", 2024-09-16T07:51:27.358 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "4.0" 2024-09-16T07:51:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:51:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.359 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:51:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:51:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:51:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.362 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:51:27.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.362 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:51:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:51:27.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.364 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.364 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.364 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:51:27.364 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.365 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:51:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 60, 2024-09-16T07:51:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.376494+0000" 2024-09-16T07:51:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.376510+0000" 2024-09-16T07:51:27.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.367 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.367 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.367 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:27.367 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.376923+0000" 2024-09-16T07:51:27.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.369 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.369 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:27.369 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.377335+0000" 2024-09-16T07:51:27.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.369 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.369 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.370 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:27.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.379059+0000" 2024-09-16T07:51:27.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.370 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.370 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:27.371 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.371 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.371 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.371 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.372 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.372 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:51:27.372 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.379548+0000" 2024-09-16T07:51:27.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.372 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.372 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.373 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.373 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.373 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.373 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:51:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.379862+0000" 2024-09-16T07:51:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.374 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:51:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.380049+0000" 2024-09-16T07:51:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:51:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:51:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:51:27.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.377 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.377 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.377 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:51:27.377 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.378 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.378 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:51:27.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.378 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:51:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:51:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.380 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:51:27.381 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.381 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.381 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.381 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.381 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 99, 2024-09-16T07:51:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "3", 2024-09-16T07:51:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "4.6", 2024-09-16T07:51:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 63, 2024-09-16T07:51:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 63, 2024-09-16T07:51:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 63 epoch_requested: 63 MInfoRec from 3 info: 4.6( v 61'885 (0'0,61'885] local-lis/les=62/63 n=58 ec=41/41 lis/c=62/55 les/c/f=63/56/0 sis=62 pruub=7.061494827s) pg_lease_ack(ruub 24.995035172s)", 2024-09-16T07:51:27.382 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.084988+0000" 2024-09-16T07:51:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.085001+0000" 2024-09-16T07:51:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.383 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.204225+0000" 2024-09-16T07:51:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.384 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.207396+0000" 2024-09-16T07:51:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.250883+0000" 2024-09-16T07:51:27.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.386 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.251120+0000" 2024-09-16T07:51:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.261125+0000" 2024-09-16T07:51:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777307, 2024-09-16T07:51:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "2", 2024-09-16T07:51:27.389 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.6", 2024-09-16T07:51:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 63, 2024-09-16T07:51:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 63, 2024-09-16T07:51:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 63 epoch_requested: 63 MLease epoch 63 from osd.2 pg_lease(ru 46.069393158s ub 46.294532776s int 16.000000000s)", 2024-09-16T07:51:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.272592+0000" 2024-09-16T07:51:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.272605+0000" 2024-09-16T07:51:27.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.272913+0000" 2024-09-16T07:51:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.391 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.273271+0000" 2024-09-16T07:51:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.392 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.273499+0000" 2024-09-16T07:51:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:27.394 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.394 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.394 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.394 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.394 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.273727+0000" 2024-09-16T07:51:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.273827+0000" 2024-09-16T07:51:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.396 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777308, 2024-09-16T07:51:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "2", 2024-09-16T07:51:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.6", 2024-09-16T07:51:27.397 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 63, 2024-09-16T07:51:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 63, 2024-09-16T07:51:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 63 epoch_requested: 63 MInfoRec from 2 info: 2.6( empty local-lis/les=62/63 n=0 ec=12/12 lis/c=62/55 les/c/f=63/56/0 sis=62) pg_lease(ru 46.069393158s ub 46.294532776s int 16.000000000s)", 2024-09-16T07:51:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.276551+0000" 2024-09-16T07:51:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.276561+0000" 2024-09-16T07:51:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.398 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:27.399 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.401 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.403 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777309, 2024-09-16T07:51:27.404 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "0", 2024-09-16T07:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "4.6", 2024-09-16T07:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 63, 2024-09-16T07:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 63, 2024-09-16T07:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 63 epoch_requested: 63 DoRecovery", 2024-09-16T07:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:27.406 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.406 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.406 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.406 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.406 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.406 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.406 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.407 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.407 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:27.407 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.407 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.407 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.407 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.407 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.407 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.407 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.407 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.407 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:27.408 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.408 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.408 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.408 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.408 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:51:27.408 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 54, 2024-09-16T07:51:27.408 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.408 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.408 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.408 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.329192+0000" 2024-09-16T07:51:27.408 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.408 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.408 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:27.409 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.329209+0000" 2024-09-16T07:51:27.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.409 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.409 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.409 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.409 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.409 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:27.409 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.331388+0000" 2024-09-16T07:51:27.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.409 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.409 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.409 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.410 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:27.410 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.410 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.410 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.410 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:27.410 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.334271+0000" 2024-09-16T07:51:27.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.410 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.411 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.411 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:27.411 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.337561+0000" 2024-09-16T07:51:27.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.411 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.411 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.411 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:27.411 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.412 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.412 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.412 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.412 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.412 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.412 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:27.069798+0000" 2024-09-16T07:51:27.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.412 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.412 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:51:27.412 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.338332+0000" 2024-09-16T07:51:27.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.412 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.413 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.413 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.413 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.413 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.413 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.413 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:51:27.413 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.338701+0000" 2024-09-16T07:51:27.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.414 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.414 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.414 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.414 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.414 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:51:27.414 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.338887+0000" 2024-09-16T07:51:27.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.414 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.414 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.414 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.414 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.415 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:51:27.415 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.415 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.415 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.415 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.415 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.415 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.415 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.415 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:51:27.415 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.415 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.415 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.415 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.416 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.416 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.416 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.416 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:51:27.416 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.416 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.416 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.416 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.416 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.416 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.416 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.416 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:51:27.416 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:51:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:51:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:51:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.418 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:51:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.420 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.420 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.420 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.420 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.420 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:51:27.420 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 47, 2024-09-16T07:51:27.420 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.420 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.420 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.297957+0000" 2024-09-16T07:51:27.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.421 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:27.421 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.297993+0000" 2024-09-16T07:51:27.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.421 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.421 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.421 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:27.421 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.298399+0000" 2024-09-16T07:51:27.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.421 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.422 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.422 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.422 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:27.422 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.422 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.422 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.422 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.422 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.422 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:27.423 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.298815+0000" 2024-09-16T07:51:27.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.423 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.423 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.423 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:27.423 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.300070+0000" 2024-09-16T07:51:27.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.423 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.423 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.424 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.424 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.424 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:27.424 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.424 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.424 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.424 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.424 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.424 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.424 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.424 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.424 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.424 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.425 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.425 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:51:27.425 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.300637+0000" 2024-09-16T07:51:27.425 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.425 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.425 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.425 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.425 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.425 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.425 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.425 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.425 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.425 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.425 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.426 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.426 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:51:27.426 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.302880+0000" 2024-09-16T07:51:27.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.426 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.426 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.426 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:51:27.426 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.303046+0000", 2024-09-16T07:51:27.427 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:51:27.427 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PGActivationBlocker", 2024-09-16T07:51:27.427 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.427 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "4.3" 2024-09-16T07:51:27.427 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.427 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.427 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.427 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.427 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.427 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.427 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.427 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.427 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:51:27.428 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.428 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.428 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.428 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.428 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.428 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.428 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.428 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:51:27.428 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.428 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.428 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.428 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.428 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.429 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:51:27.429 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.429 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.429 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.429 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:51:27.429 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.430 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.430 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.430 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:51:27.430 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.430 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.430 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.430 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:51:27.431 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.431 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.431 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.431 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:51:27.431 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.431 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.432 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.432 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:51:27.432 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.432 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.432 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.432 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.433 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.433 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.433 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.433 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.433 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.433 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:51:27.433 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 50, 2024-09-16T07:51:27.433 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.433 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.433 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.303184+0000" 2024-09-16T07:51:27.433 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.433 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:27.434 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.303202+0000" 2024-09-16T07:51:27.434 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.434 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.434 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.434 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.434 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.434 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.434 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:27.434 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.303492+0000" 2024-09-16T07:51:27.434 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.434 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.434 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.434 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.435 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:27.435 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.435 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.435 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.435 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:27.435 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.303910+0000" 2024-09-16T07:51:27.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.435 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.436 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.436 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.436 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:27.436 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.308209+0000" 2024-09-16T07:51:27.436 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.436 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.436 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.437 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.437 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:27.437 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.437 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.437 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.437 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.437 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.437 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.437 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.438 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:51:27.438 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.308617+0000" 2024-09-16T07:51:27.438 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.438 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.438 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.438 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.438 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.438 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.438 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.438 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.439 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.439 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:51:27.439 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.308854+0000", 2024-09-16T07:51:27.439 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:51:27.439 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "CommonPGPipeline:::wait_for_active", 2024-09-16T07:51:27.439 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.439 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T07:51:27.439 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 47 2024-09-16T07:51:27.439 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.439 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.440 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.440 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.440 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.440 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.440 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:51:27.440 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.440 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.440 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.440 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.441 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.441 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:51:27.441 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.441 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.441 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.441 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.441 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.441 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.441 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.441 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:51:27.441 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.441 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.441 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.442 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.442 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.442 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:51:27.442 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.442 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.442 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.442 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.442 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.442 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:51:27.443 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.443 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.443 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.443 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:51:27.443 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.443 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.443 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.444 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.444 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:51:27.444 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.444 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.444 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.444 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.444 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.444 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:51:27.444 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.444 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.445 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.445 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.445 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:51:27.445 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.445 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.445 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.445 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.445 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.445 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.446 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.446 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.446 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.446 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.446 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.446 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:27.446 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:51:27.446 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 53, 2024-09-16T07:51:27.446 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.446 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.446 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:27.446 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.311665+0000" 2024-09-16T07:51:27.446 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.446 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:27.447 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.311684+0000" 2024-09-16T07:51:27.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.447 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.447 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.447 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:27.447 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.312147+0000" 2024-09-16T07:51:27.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.447 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.448 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.448 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:27.448 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.448 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.448 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.448 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:27.448 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.315886+0000" 2024-09-16T07:51:27.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.449 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.449 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.449 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:27.449 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.325170+0000" 2024-09-16T07:51:27.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.449 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.449 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.449 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:27.450 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.450 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.450 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.450 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.450 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.450 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.450 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.450 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.450 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:51:27.450 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:26.325829+0000", 2024-09-16T07:51:27.451 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:51:27.451 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "ClientRequest::PGPipeline::await_map", 2024-09-16T07:51:27.451 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:27.451 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T07:51:27.451 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 50 2024-09-16T07:51:27.451 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.451 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.451 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.451 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.451 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.451 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.451 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:27.452 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.452 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.452 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.452 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.452 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.452 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:51:27.452 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.452 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.452 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.452 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.453 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.453 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.453 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:51:27.453 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.453 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.453 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.453 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.453 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.453 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.453 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.453 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:51:27.453 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.453 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.453 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.454 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.454 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:51:27.454 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.454 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.454 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.454 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:51:27.454 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:51:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.455 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:51:27.456 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.456 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.456 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.456 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.456 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.456 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:51:27.456 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.456 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.456 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.457 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.457 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.457 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:51:27.457 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.457 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.457 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.457 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.457 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:51:27.457 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:51:27.457 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.458 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:27.458 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.458 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:27.458 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:51:27.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:27.458 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:27.458 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.458 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.458 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:27.458 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:27.458 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T07:51:29.792 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:29.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:29.962+0000 7f24bb391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:29.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:29.973+0000 7f24bb391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:32.425 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:32.460 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [1, 3, 2, 0] 2024-09-16T07:51:32.460 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:51:32.461 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:51:32.461 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:51:32.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:32.585+0000 7ffb67c88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:32.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:32.599+0000 7ffb67c88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:32.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:32.635+0000 7f6485874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:32.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:32.655+0000 7f6485874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:32.717 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:32.717 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:51:32.717 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:51:32.717 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:51:32.717 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:51:32.717 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:51:32.717 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:51:32.718 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:51:32.718 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:51:32.718 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:51:32.718 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:51:32.718 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:51:32.722 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:32.722 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:32.722 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:51:32.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:32.896+0000 7f25f0311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:32.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:32.917+0000 7f25f0311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:51:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:51:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:51:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:51:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:51:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:51:32.964 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:51:32.965 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:51:32.965 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:51:32.965 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:51:32.965 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:51:32.968 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:32.968 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:32.968 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:51:33.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:33.141+0000 7f682dc5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:33.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:33.160+0000 7f682dc5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:33.293 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:33.293 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:51:33.293 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:51:33.293 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:51:33.293 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:51:33.293 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:51:33.294 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:51:33.294 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:51:33.294 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:51:33.294 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:51:33.294 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:51:33.294 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:51:33.297 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:33.297 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:33.298 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:51:33.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:33.454+0000 7fe2bd0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:33.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:33.474+0000 7fe2bd0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:33.562 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:33.562 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:51:33.562 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:51:33.562 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:51:33.562 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:51:33.562 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:51:33.562 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:51:33.562 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:51:33.562 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:51:33.563 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:51:33.563 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:51:33.563 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:51:33.569 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:33.569 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:34.136 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Removed 8094 objects 2024-09-16T07:51:34.136 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Clean up completed and total clean up time :115.011 2024-09-16T07:51:35.210 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:35.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:35.347+0000 7fda62f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:35.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:35.355+0000 7fda62f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:35.463 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2024-09-16T07:51:35.464 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2024-09-16T07:51:35.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:35.613+0000 7ff540111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:35.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:35.632+0000 7ff540111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:36.482 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'unique_pool_1' removed 2024-09-16T07:51:36.505 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T07:51:36.506 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T07:51:36.506 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_2 2024-09-16T07:51:36.507 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_2 16 2024-09-16T07:51:36.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:36.677+0000 7fc6ff991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:36.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:36.695+0000 7fc6ff991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:37.488 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'unique_pool_2' created 2024-09-16T07:51:37.506 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2024-09-16T07:51:37.592 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:37.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:37.653+0000 7f266ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:37.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:37.668+0000 7f266ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:37.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:37.711+0000 7f4ec6e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:37.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:37.718+0000 7f4ec6e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:37.980 INFO:teuthology.orchestra.run.smithi003.stderr:enabled application 'rados' on pool 'unique_pool_2' 2024-09-16T07:51:38.570 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [1, 3, 2, 0] 2024-09-16T07:51:38.570 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:51:38.570 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [1, 3, 2, 0] 2024-09-16T07:51:38.571 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T07:51:38.571 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:51:38.650 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T07:51:39.000 DEBUG:teuthology.orchestra.run.smithi003:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_2 bench 90 write' 2024-09-16T07:51:39.002 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T07:51:39.002 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T07:51:39.068 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:hints = 1 2024-09-16T07:51:39.068 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T07:51:39.068 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Object prefix: benchmark_data_smithi003_40244 2024-09-16T07:51:39.069 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:51:39.069 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 0 0 0 0 0 0 - 0 2024-09-16T07:51:39.821 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:39.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:39.945+0000 7fb19eb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:39.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:51:39.952+0000 7fb19eb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:40.068 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 1 16 26 10 0.624933 0.625 0.0231535 0.0525421 2024-09-16T07:51:41.069 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 2 16 26 10 0.312458 0 - 0.0525421 2024-09-16T07:51:42.069 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 3 16 26 10 0.208306 0 - 0.0525421 2024-09-16T07:51:43.069 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 4 16 26 10 0.156229 0 - 0.0525421 2024-09-16T07:51:43.651 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [1] live_osds: [3, 2, 0] 2024-09-16T07:51:43.652 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:51:43.652 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-09-16T07:51:43.652 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T07:51:43.652 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T07:51:43.656 INFO:tasks.ceph.osd.1:Started 2024-09-16T07:51:43.656 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T07:51:43.770 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:51:43.774 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:43.774 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-16T07:51:44.069 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 5 16 26 10 0.124985 0 - 0.0525421 2024-09-16T07:51:45.069 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 6 16 26 10 0.104154 0 - 0.0525421 2024-09-16T07:51:46.069 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 7 16 26 10 0.089275 0 - 0.0525421 2024-09-16T07:51:47.069 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 8 16 26 10 0.0781158 0 - 0.0525421 2024-09-16T07:51:48.070 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 9 16 26 10 0.0694364 0 - 0.0525421 2024-09-16T07:51:48.775 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T07:51:48.878 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:51:48.881 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:48.881 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-16T07:51:49.069 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 10 16 26 10 0.062493 0 - 0.0525421 2024-09-16T07:51:50.070 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 11 16 26 10 0.0568119 0 - 0.0525421 2024-09-16T07:51:51.070 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 12 16 26 10 0.0520773 0 - 0.0525421 2024-09-16T07:51:52.070 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 13 16 26 10 0.0480714 0 - 0.0525421 2024-09-16T07:51:53.070 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 14 16 26 10 0.0446378 0 - 0.0525421 2024-09-16T07:51:53.882 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T07:51:53.984 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:51:53.987 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:53.987 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-16T07:51:54.070 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 15 16 26 10 0.041662 0 - 0.0525421 2024-09-16T07:51:55.070 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 16 16 26 10 0.0390582 0 - 0.0525421 2024-09-16T07:51:56.070 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 17 16 26 10 0.0367607 0 - 0.0525421 2024-09-16T07:51:57.070 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 18 16 26 10 0.0347185 0 - 0.0525421 2024-09-16T07:51:58.070 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 19 16 26 10 0.0328912 0 - 0.0525421 2024-09-16T07:51:58.989 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T07:51:59.070 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:51:59.072711+0000 min lat: 0.0231535 max lat: 0.0892619 avg lat: 0.0525421 2024-09-16T07:51:59.071 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:51:59.071 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 20 16 26 10 0.0312467 0 - 0.0525421 2024-09-16T07:51:59.182 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T07:51:59.182 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [ 2024-09-16T07:51:59.182 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.182 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:59.182 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 98, 2024-09-16T07:51:59.182 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:59.182 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:59.183 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "2", 2024-09-16T07:51:59.183 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "5.9", 2024-09-16T07:51:59.183 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 74, 2024-09-16T07:51:59.183 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 74, 2024-09-16T07:51:59.183 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 74 epoch_requested: 74 MInfoRec from 2 info: 5.9( empty local-lis/les=73/74 n=0 ec=66/66 lis/c=73/66 les/c/f=74/67/0 sis=73) pg_lease_ack(ruub 30.096652985s)", 2024-09-16T07:51:59.183 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:59.183 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.183 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:59.183 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.172601+0000" 2024-09-16T07:51:59.183 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.184 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.184 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:59.184 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.172612+0000" 2024-09-16T07:51:59.184 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.184 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.184 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.184 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.184 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.184 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.184 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:59.185 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.173248+0000" 2024-09-16T07:51:59.185 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.185 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.185 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.185 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.185 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.185 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.185 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:59.185 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.185 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.186 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.186 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.186 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.186 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.186 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.186 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:59.186 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.175551+0000", 2024-09-16T07:51:59.186 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:51:59.186 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "ConnectionPipeline::get_pg_mapping", 2024-09-16T07:51:59.186 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:59.186 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1 2024-09-16T07:51:59.187 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.187 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.187 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.187 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.187 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.187 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.187 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.187 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.187 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:59.187 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.187 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.188 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.188 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.188 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.188 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.188 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.188 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:59.188 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.188 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.188 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.188 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.188 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.189 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.189 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.189 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:59.189 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.189 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.189 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.189 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.189 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.189 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.189 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.192 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:59.193 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.193 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.193 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.193 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.193 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.193 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:59.193 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.194 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.194 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.194 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.194 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.194 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:59.194 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.194 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.194 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:59.194 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.194 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.195 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.195 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:59.195 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777255, 2024-09-16T07:51:59.195 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:59.195 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:59.195 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "1", 2024-09-16T07:51:59.195 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "5.0", 2024-09-16T07:51:59.196 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 74, 2024-09-16T07:51:59.196 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 74, 2024-09-16T07:51:59.196 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 74 epoch_requested: 74 ActivateCommitted from 74 processed at 74", 2024-09-16T07:51:59.196 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:59.196 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.196 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:59.196 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.196 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.196 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.196 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:59.196 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.170886+0000" 2024-09-16T07:51:59.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.197 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.197 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.197 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.197 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.197 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:59.197 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.197 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.197 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.198 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.198 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.198 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.198 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:59.198 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.172664+0000" 2024-09-16T07:51:59.198 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.198 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.198 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.198 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.198 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.198 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.199 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:59.199 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.199 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.199 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:59.199 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.199 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.199 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.199 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.199 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:59.199 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777256, 2024-09-16T07:51:59.199 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:59.200 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:59.200 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "1", 2024-09-16T07:51:59.200 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "5.8", 2024-09-16T07:51:59.200 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 74, 2024-09-16T07:51:59.200 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 74, 2024-09-16T07:51:59.200 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 74 epoch_requested: 74 ActivateCommitted from 74 processed at 74", 2024-09-16T07:51:59.200 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:59.200 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.200 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:59.200 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.200 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.201 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.201 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:59.201 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.173634+0000" 2024-09-16T07:51:59.201 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.201 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.201 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.201 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.201 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.201 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.201 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:59.201 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.202 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.202 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.202 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.202 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.202 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:59.202 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.173679+0000" 2024-09-16T07:51:59.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.202 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.202 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.203 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.203 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.203 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:59.203 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.203 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.203 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:59.203 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.203 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.203 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.203 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:59.204 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 33554472, 2024-09-16T07:51:59.204 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:59.204 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:59.204 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "1", 2024-09-16T07:51:59.204 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "5.2", 2024-09-16T07:51:59.204 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 74, 2024-09-16T07:51:59.204 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 74, 2024-09-16T07:51:59.204 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 74 epoch_requested: 74 ActivateCommitted from 74 processed at 74", 2024-09-16T07:51:59.205 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:59.205 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.205 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:59.205 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.205 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.205 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.205 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:59.205 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.175537+0000" 2024-09-16T07:51:59.205 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.205 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.205 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.206 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.206 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.206 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.206 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:59.206 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.206 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.206 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.206 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.206 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.206 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.206 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.207 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:59.207 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.175579+0000" 2024-09-16T07:51:59.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.207 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.207 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.207 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.207 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.207 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:59.207 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.207 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.207 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:59.208 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.208 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.208 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.208 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.208 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:51:59.208 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 98, 2024-09-16T07:51:59.208 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:51:59.208 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:51:59.208 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "2", 2024-09-16T07:51:59.208 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "5.9", 2024-09-16T07:51:59.209 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 74, 2024-09-16T07:51:59.209 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 74, 2024-09-16T07:51:59.209 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 74 epoch_requested: 74 MInfoRec from 2 info: 5.9( empty local-lis/les=73/74 n=0 ec=66/66 lis/c=73/66 les/c/f=74/67/0 sis=73) pg_lease_ack(ruub 30.096652985s)", 2024-09-16T07:51:59.209 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:51:59.209 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.209 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:51:59.209 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.172601+0000" 2024-09-16T07:51:59.209 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.210 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.210 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:51:59.210 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.172612+0000" 2024-09-16T07:51:59.210 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.210 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.210 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.210 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.210 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.210 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.210 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:51:59.211 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.173248+0000" 2024-09-16T07:51:59.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.211 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.211 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.211 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.211 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.211 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:51:59.211 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.211 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.212 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.212 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.212 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.212 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.212 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:51:59.212 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.175551+0000" 2024-09-16T07:51:59.212 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.212 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.212 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.212 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.212 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.213 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.213 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:51:59.213 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.179073+0000" 2024-09-16T07:51:59.213 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.213 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.213 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.213 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.213 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.213 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.214 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:51:59.214 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.214 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.214 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.214 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.214 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.214 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.214 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.214 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:51:59.214 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.179218+0000" 2024-09-16T07:51:59.214 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.214 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.215 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.215 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.215 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.215 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:51:59.215 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.215 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.215 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.215 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.215 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.215 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:51:59.216 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:51:59.179458+0000" 2024-09-16T07:51:59.216 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.216 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.216 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:51:59.216 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.216 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:51:59.216 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:51:59.216 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:51:59.216 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:51:59.216 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.216 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:59.216 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.216 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.217 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:51:59.217 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:51:59.217 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T07:52:00.071 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 21 16 179 163 0.485067 0.478125 0.0883435 2.05816 2024-09-16T07:52:01.071 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 22 16 369 353 1.00273 11.875 0.0809707 0.995332 2024-09-16T07:52:02.071 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 23 16 585 569 1.54603 13.5 0.0865455 0.645828 2024-09-16T07:52:02.239 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:02.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:02.397+0000 7f0c5b874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:02.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:02.406+0000 7f0c5b874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:03.071 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 24 16 799 783 2.03885 13.375 0.0346077 0.489414 2024-09-16T07:52:04.071 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 25 16 1006 990 2.47474 12.9375 0.0378201 0.403421 2024-09-16T07:52:04.218 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 2, 0, 1] 2024-09-16T07:52:04.219 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:52:04.219 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:52:04.219 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:52:04.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:04.398+0000 7fdc22151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:04.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:04.410+0000 7fdc22151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:04.449 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:04.450 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:52:04.450 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:52:04.450 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:52:04.450 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:52:04.450 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:52:04.450 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:52:04.450 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:52:04.450 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:52:04.450 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:52:04.450 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:52:04.450 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:52:04.454 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:04.454 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:04.454 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:52:04.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:04.609+0000 7f84fcf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:04.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:04.630+0000 7f84fcf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:04.671 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:04.672 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:52:04.672 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:52:04.672 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:52:04.672 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:52:04.672 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:52:04.672 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:52:04.672 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:52:04.672 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:52:04.672 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:52:04.672 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:52:04.672 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:52:04.677 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:04.677 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:04.677 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:52:04.779 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:04.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:04.852+0000 7ff650b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:04.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:04.865+0000 7ff650b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:04.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:04.959+0000 7ff689191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:04.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:04.972+0000 7ff689191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:04.977 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:04.977 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:52:04.977 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:52:04.977 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:52:04.977 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:52:04.977 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:52:04.977 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:52:04.977 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:52:04.978 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:52:04.978 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:52:04.978 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:52:04.978 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:52:04.982 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:04.983 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:04.983 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:52:05.071 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 26 16 1217 1201 2.88672 13.1875 0.063512 0.345939 2024-09-16T07:52:05.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:05.144+0000 7f12852c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:05.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:05.159+0000 7f12852c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:05.197 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:05.197 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:52:05.197 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:52:05.197 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:52:05.197 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:52:05.198 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:52:05.198 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:52:05.198 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:52:05.198 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:52:05.198 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:52:05.198 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:52:05.198 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:52:05.201 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:05.202 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:06.071 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 27 16 1400 1384 3.20338 11.4375 0.0788718 0.311777 2024-09-16T07:52:07.071 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 28 16 1599 1583 3.53312 12.4375 0.14762 0.282529 2024-09-16T07:52:07.252 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:07.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:07.418+0000 7f0c55ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:07.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:07.427+0000 7f0c55ea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:08.071 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 29 16 1790 1774 3.82289 11.9375 0.0295925 0.261086 2024-09-16T07:52:09.072 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 30 16 2010 1994 4.15375 13.75 0.0873449 0.240384 2024-09-16T07:52:09.738 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:09.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:09.899+0000 7f82c4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:09.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:09.909+0000 7f82c4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:10.071 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 31 16 2225 2209 4.45318 13.4375 0.0620049 0.224239 2024-09-16T07:52:10.203 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 2, 0, 1] 2024-09-16T07:52:10.203 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:52:10.203 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:10.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:10.385+0000 7f7fec551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:10.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:10.400+0000 7f7fec551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:10.736 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:52:10.736 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:52:10.761 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-09-16T07:52:10.380047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":45023784,"num_objects":682,"num_object_clones":0,"num_object_copies":2046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":758,"num_write_kb":44499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":733,"ondisk_log_size":733,"up":72,"acting":72,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":184188,"kb_used_data":9660,"kb_used_omap":0,"kb_used_meta":174464,"kb_avail":377303172,"statfs":{"total":386547056640,"available":386358448128,"internally_reserved":0,"allocated":9891840,"data_stored":120007490,"data_compressed":5658867,"data_compressed_allocated":7454720,"data_compressed_original":119029760,"omap_allocated":0,"internal_metadata":178651136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43712512,"num_objects":667,"num_object_clones":0,"num_object_copies":2001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":42688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.377795"},"pg_stats":[{"pgid":"5.f","version":"74'86","reported_seq":116,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:52:05.713501+0000","last_change":"2024-09-16T07:51:38.204751+0000","last_active":"2024-09-16T07:52:05.713501+0000","last_peered":"2024-09-16T07:52:05.713501+0000","last_clean":"2024-09-16T07:52:05.713501+0000","last_became_active":"2024-09-16T07:51:38.196461+0000","last_became_peered":"2024-09-16T07:51:38.196461+0000","last_unstale":"2024-09-16T07:52:05.713501+0000","last_undegraded":"2024-09-16T07:52:05.713501+0000","last_fullsized":"2024-09-16T07:52:05.713501+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:53.003910+0000","last_change":"2024-09-16T07:51:38.176497+0000","last_active":"2024-09-16T07:51:53.003910+0000","last_peered":"2024-09-16T07:51:53.003910+0000","last_clean":"2024-09-16T07:51:53.003910+0000","last_became_active":"2024-09-16T07:51:38.159939+0000","last_became_peered":"2024-09-16T07:51:38.159939+0000","last_unstale":"2024-09-16T07:51:53.003910+0000","last_undegraded":"2024-09-16T07:51:53.003910+0000","last_fullsized":"2024-09-16T07:51:53.003910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:53.001960+0000","last_change":"2024-09-16T07:51:38.115751+0000","last_active":"2024-09-16T07:51:53.001960+0000","last_peered":"2024-09-16T07:51:53.001960+0000","last_clean":"2024-09-16T07:51:53.001960+0000","last_became_active":"2024-09-16T07:51:38.099152+0000","last_became_peered":"2024-09-16T07:51:38.099152+0000","last_unstale":"2024-09-16T07:51:53.001960+0000","last_undegraded":"2024-09-16T07:51:53.001960+0000","last_fullsized":"2024-09-16T07:51:53.001960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"74'87","reported_seq":124,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:52:04.299716+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:52:04.299716+0000","last_peered":"2024-09-16T07:52:04.299716+0000","last_clean":"2024-09-16T07:52:04.299716+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:52:04.299716+0000","last_undegraded":"2024-09-16T07:52:04.299716+0000","last_fullsized":"2024-09-16T07:52:04.299716+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:53.004830+0000","last_change":"2024-09-16T07:51:38.154961+0000","last_active":"2024-09-16T07:51:53.004830+0000","last_peered":"2024-09-16T07:51:53.004830+0000","last_clean":"2024-09-16T07:51:53.004830+0000","last_became_active":"2024-09-16T07:51:38.134473+0000","last_became_peered":"2024-09-16T07:51:38.134473+0000","last_unstale":"2024-09-16T07:51:53.004830+0000","last_undegraded":"2024-09-16T07:51:53.004830+0000","last_fullsized":"2024-09-16T07:51:53.004830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"74'99","reported_seq":129,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:52:05.558832+0000","last_change":"2024-09-16T07:51:38.143552+0000","last_active":"2024-09-16T07:52:05.558832+0000","last_peered":"2024-09-16T07:52:05.558832+0000","last_clean":"2024-09-16T07:52:05.558832+0000","last_became_active":"2024-09-16T07:51:38.131989+0000","last_became_peered":"2024-09-16T07:51:38.131989+0000","last_unstale":"2024-09-16T07:52:05.558832+0000","last_undegraded":"2024-09-16T07:52:05.558832+0000","last_fullsized":"2024-09-16T07:52:05.558832+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:51:37.483608+0000","last_change":"2024-09-16T07:51:37.483608+0000","last_active":"2024-09-16T07:51:37.483608+0000","last_peered":"2024-09-16T07:51:37.483608+0000","last_clean":"2024-09-16T07:51:37.483608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:51:37.483608+0000","last_undegraded":"2024-09-16T07:51:37.483608+0000","last_fullsized":"2024-09-16T07:51:37.483608+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:53.001102+0000","last_change":"2024-09-16T07:51:38.169785+0000","last_active":"2024-09-16T07:51:53.001102+0000","last_peered":"2024-09-16T07:51:53.001102+0000","last_clean":"2024-09-16T07:51:53.001102+0000","last_became_active":"2024-09-16T07:51:38.149919+0000","last_became_peered":"2024-09-16T07:51:38.149919+0000","last_unstale":"2024-09-16T07:51:53.001102+0000","last_undegraded":"2024-09-16T07:51:53.001102+0000","last_fullsized":"2024-09-16T07:51:53.001102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"74'76","reported_seq":113,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:52:05.648607+0000","last_change":"2024-09-16T07:51:59.275820+0000","last_active":"2024-09-16T07:52:05.648607+0000","last_peered":"2024-09-16T07:52:05.648607+0000","last_clean":"2024-09-16T07:52:05.648607+0000","last_became_active":"2024-09-16T07:51:59.113807+0000","last_became_peered":"2024-09-16T07:51:59.113807+0000","last_unstale":"2024-09-16T07:52:05.648607+0000","last_undegraded":"2024-09-16T07:52:05.648607+0000","last_fullsized":"2024-09-16T07:52:05.648607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":231,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:51:59.020349+0000","last_change":"2024-09-16T07:51:27.283450+0000","last_active":"2024-09-16T07:51:59.020349+0000","last_peered":"2024-09-16T07:51:59.020349+0000","last_clean":"2024-09-16T07:51:59.020349+0000","last_became_active":"2024-09-16T07:51:27.275953+0000","last_became_peered":"2024-09-16T07:51:27.275953+0000","last_unstale":"2024-09-16T07:51:59.020349+0000","last_undegraded":"2024-09-16T07:51:59.020349+0000","last_fullsized":"2024-09-16T07:51:59.020349+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":168,"reported_epoch":64,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:28.062221+0000","last_change":"2024-09-16T07:51:28.078202+0000","last_active":"2024-09-16T07:51:28.062221+0000","last_peered":"2024-09-16T07:51:28.062221+0000","last_clean":"2024-09-16T07:51:28.062221+0000","last_became_active":"2024-09-16T07:51:27.458273+0000","last_became_peered":"2024-09-16T07:51:27.458273+0000","last_unstale":"2024-09-16T07:51:56.992133+0000","last_undegraded":"2024-09-16T07:51:28.062221+0000","last_fullsized":"2024-09-16T07:51:28.062221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:53.000096+0000","last_change":"2024-09-16T07:51:38.120872+0000","last_active":"2024-09-16T07:51:53.000096+0000","last_peered":"2024-09-16T07:51:53.000096+0000","last_clean":"2024-09-16T07:51:53.000096+0000","last_became_active":"2024-09-16T07:51:38.110191+0000","last_became_peered":"2024-09-16T07:51:38.110191+0000","last_unstale":"2024-09-16T07:51:53.000096+0000","last_undegraded":"2024-09-16T07:51:53.000096+0000","last_fullsized":"2024-09-16T07:51:53.000096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:53.002784+0000","last_change":"2024-09-16T07:51:28.108718+0000","last_active":"2024-09-16T07:51:53.002784+0000","last_peered":"2024-09-16T07:51:53.002784+0000","last_clean":"2024-09-16T07:51:53.002784+0000","last_became_active":"2024-09-16T07:51:27.518387+0000","last_became_peered":"2024-09-16T07:51:27.518387+0000","last_unstale":"2024-09-16T07:51:53.002784+0000","last_undegraded":"2024-09-16T07:51:53.002784+0000","last_fullsized":"2024-09-16T07:51:53.002784+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"74'79","reported_seq":109,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:52:05.618893+0000","last_change":"2024-09-16T07:51:38.209470+0000","last_active":"2024-09-16T07:52:05.618893+0000","last_peered":"2024-09-16T07:52:05.618893+0000","last_clean":"2024-09-16T07:52:05.618893+0000","last_became_active":"2024-09-16T07:51:38.200970+0000","last_became_peered":"2024-09-16T07:51:38.200970+0000","last_unstale":"2024-09-16T07:52:05.618893+0000","last_undegraded":"2024-09-16T07:52:05.618893+0000","last_fullsized":"2024-09-16T07:52:05.618893+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":64,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:28.045695+0000","last_change":"2024-09-16T07:51:17.051984+0000","last_active":"2024-09-16T07:51:28.045695+0000","last_peered":"2024-09-16T07:51:28.045695+0000","last_clean":"2024-09-16T07:51:28.045695+0000","last_became_active":"2024-09-16T07:51:07.567055+0000","last_became_peered":"2024-09-16T07:51:07.567055+0000","last_unstale":"2024-09-16T07:51:56.992135+0000","last_undegraded":"2024-09-16T07:51:28.045695+0000","last_fullsized":"2024-09-16T07:51:28.045695+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"74'75","reported_seq":106,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:52:05.684566+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:52:05.684566+0000","last_peered":"2024-09-16T07:52:05.684566+0000","last_clean":"2024-09-16T07:52:05.684566+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:52:05.684566+0000","last_undegraded":"2024-09-16T07:52:05.684566+0000","last_fullsized":"2024-09-16T07:52:05.684566+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:52.995846+0000","last_change":"2024-09-16T07:51:28.114509+0000","last_active":"2024-09-16T07:51:52.995846+0000","last_peered":"2024-09-16T07:51:52.995846+0000","last_clean":"2024-09-16T07:51:52.995846+0000","last_became_active":"2024-09-16T07:51:27.459621+0000","last_became_peered":"2024-09-16T07:51:27.459621+0000","last_unstale":"2024-09-16T07:51:52.995846+0000","last_undegraded":"2024-09-16T07:51:52.995846+0000","last_fullsized":"2024-09-16T07:51:52.995846+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"74'95","reported_seq":136,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:52:05.640434+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:52:05.640434+0000","last_peered":"2024-09-16T07:52:05.640434+0000","last_clean":"2024-09-16T07:52:05.640434+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:52:05.640434+0000","last_undegraded":"2024-09-16T07:52:05.640434+0000","last_fullsized":"2024-09-16T07:52:05.640434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:51:59.018143+0000","last_change":"2024-09-16T07:51:28.104908+0000","last_active":"2024-09-16T07:51:59.018143+0000","last_peered":"2024-09-16T07:51:59.018143+0000","last_clean":"2024-09-16T07:51:59.018143+0000","last_became_active":"2024-09-16T07:51:27.356315+0000","last_became_peered":"2024-09-16T07:51:27.356315+0000","last_unstale":"2024-09-16T07:51:59.018143+0000","last_undegraded":"2024-09-16T07:51:59.018143+0000","last_fullsized":"2024-09-16T07:51:59.018143+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"68'2","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:53.003297+0000","last_change":"2024-09-16T07:51:38.164960+0000","last_active":"2024-09-16T07:51:53.003297+0000","last_peered":"2024-09-16T07:51:53.003297+0000","last_clean":"2024-09-16T07:51:53.003297+0000","last_became_active":"2024-09-16T07:51:38.140920+0000","last_became_peered":"2024-09-16T07:51:38.140920+0000","last_unstale":"2024-09-16T07:51:53.003297+0000","last_undegraded":"2024-09-16T07:51:53.003297+0000","last_fullsized":"2024-09-16T07:51:53.003297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:51:59.019893+0000","last_change":"2024-09-16T07:51:28.056219+0000","last_active":"2024-09-16T07:51:59.019893+0000","last_peered":"2024-09-16T07:51:59.019893+0000","last_clean":"2024-09-16T07:51:59.019893+0000","last_became_active":"2024-09-16T07:51:27.271357+0000","last_became_peered":"2024-09-16T07:51:27.271357+0000","last_unstale":"2024-09-16T07:51:59.019893+0000","last_undegraded":"2024-09-16T07:51:59.019893+0000","last_fullsized":"2024-09-16T07:51:59.019893+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"74'70","reported_seq":100,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:52:04.111750+0000","last_change":"2024-09-16T07:51:38.137148+0000","last_active":"2024-09-16T07:52:04.111750+0000","last_peered":"2024-09-16T07:52:04.111750+0000","last_clean":"2024-09-16T07:52:04.111750+0000","last_became_active":"2024-09-16T07:51:38.130445+0000","last_became_peered":"2024-09-16T07:51:38.130445+0000","last_unstale":"2024-09-16T07:52:04.111750+0000","last_undegraded":"2024-09-16T07:52:04.111750+0000","last_fullsized":"2024-09-16T07:52:04.111750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":178,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:51:59.015152+0000","last_change":"2024-09-16T07:51:28.106544+0000","last_active":"2024-09-16T07:51:59.015152+0000","last_peered":"2024-09-16T07:51:59.015152+0000","last_clean":"2024-09-16T07:51:59.015152+0000","last_became_active":"2024-09-16T07:51:27.269597+0000","last_became_peered":"2024-09-16T07:51:27.269597+0000","last_unstale":"2024-09-16T07:51:59.015152+0000","last_undegraded":"2024-09-16T07:51:59.015152+0000","last_fullsized":"2024-09-16T07:51:59.015152+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:53.002351+0000","last_change":"2024-09-16T07:51:38.145559+0000","last_active":"2024-09-16T07:51:53.002351+0000","last_peered":"2024-09-16T07:51:53.002351+0000","last_clean":"2024-09-16T07:51:53.002351+0000","last_became_active":"2024-09-16T07:51:38.123189+0000","last_became_peered":"2024-09-16T07:51:38.123189+0000","last_unstale":"2024-09-16T07:51:53.002351+0000","last_undegraded":"2024-09-16T07:51:53.002351+0000","last_fullsized":"2024-09-16T07:51:53.002351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":167,"reported_epoch":64,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:28.104313+0000","last_change":"2024-09-16T07:51:28.120729+0000","last_active":"2024-09-16T07:51:28.104313+0000","last_peered":"2024-09-16T07:51:28.104313+0000","last_clean":"2024-09-16T07:51:28.104313+0000","last_became_active":"2024-09-16T07:51:27.456961+0000","last_became_peered":"2024-09-16T07:51:27.456961+0000","last_unstale":"2024-09-16T07:51:56.992137+0000","last_undegraded":"2024-09-16T07:51:28.104313+0000","last_fullsized":"2024-09-16T07:51:28.104313+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":44433408,"num_objects":678,"num_object_clones":0,"num_object_copies":2034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":43392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7979008,"data_stored":127664128,"data_compressed":6060365,"data_compressed_allocated":7979008,"data_compressed_original":127664128,"omap_allocated":0,"internal_metadata":0},"log_size":678,"ondisk_log_size":678,"up":45,"acting":45,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201369,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44512,"kb_used_data":3152,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94327328,"statfs":{"total":96636764160,"available":96591183872,"internally_reserved":0,"allocated":3227648,"data_stored":41596837,"data_compressed":1964999,"data_compressed_allocated":2588672,"data_compressed_original":41336832,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":38108,"kb_used_data":5260,"kb_used_omap":0,"kb_used_meta":32832,"kb_avail":94333732,"statfs":{"total":96636764160,"available":96597741568,"internally_reserved":0,"allocated":5386240,"data_stored":76068792,"data_compressed":3601635,"data_compressed_allocated":4743168,"data_compressed_original":75808768,"omap_allocated":0,"internal_metadata":33619968},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":57884,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94313956,"statfs":{"total":96636764160,"available":96577490944,"internally_reserved":0,"allocated":536576,"data_stored":208404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":62,"seq":266287972382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43684,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94328156,"statfs":{"total":96636764160,"available":96592031744,"internally_reserved":0,"allocated":741376,"data_stored":2133457,"data_compressed":92233,"data_compressed_allocated":122880,"data_compressed_original":1884160,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":1310720,"data_compressed":62192,"data_compressed_allocated":81920,"data_compressed_original":1310720,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4878336,"data_stored":78053376,"data_compressed":3705410,"data_compressed_allocated":4878336,"data_compressed_original":78053376,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3018752,"data_stored":48300032,"data_compressed":2292763,"data_compressed_allocated":3018752,"data_compressed_original":48300032,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:11.071 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 32 16 2429 2413 4.71242 12.75 0.0986379 0.211952 2024-09-16T07:52:12.072 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 33 16 2652 2636 4.99193 13.9375 0.0415223 0.200182 2024-09-16T07:52:12.203 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:12.366+0000 7f0f53d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:12.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:12.379+0000 7f0f53d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:13.072 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 34 16 2867 2851 5.24029 13.4375 0.0813961 0.190623 2024-09-16T07:52:14.072 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 35 16 3081 3065 5.47267 13.375 0.0707708 0.182527 2024-09-16T07:52:14.705 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:14.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:14.882+0000 7ff787a7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:14.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:14.892+0000 7ff787a7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:15.072 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 36 16 3287 3271 5.67826 12.875 0.0780312 0.175922 2024-09-16T07:52:15.764 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 2, 0, 1] 2024-09-16T07:52:15.764 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:52:15.764 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [3, 2, 0, 1] 2024-09-16T07:52:15.764 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T07:52:15.765 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:52:15.849 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T07:52:16.072 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 37 16 3416 3400 5.74267 8.0625 0.0793448 0.172635 2024-09-16T07:52:17.072 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 38 16 3416 3400 5.59154 0 - 0.172635 2024-09-16T07:52:17.214 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:17.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:17.338+0000 7fef6e311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:17.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:17.344+0000 7fef6e311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:18.072 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 39 16 3416 3400 5.44816 0 - 0.172635 2024-09-16T07:52:19.073 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:52:19.074713+0000 min lat: 0.0153521 max lat: 20.3424 avg lat: 0.172635 2024-09-16T07:52:19.073 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:52:19.073 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 40 16 3416 3400 5.31195 0 - 0.172635 2024-09-16T07:52:20.073 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 41 16 3416 3400 5.18238 0 - 0.172635 2024-09-16T07:52:20.850 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [3, 2, 1] 2024-09-16T07:52:20.850 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:52:20.850 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-16T07:52:20.851 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:52:20.851 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T07:52:20.854 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:52:20.855 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:52:20.981 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:52:20.984 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:20.985 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:52:21.073 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 42 16 3416 3400 5.05899 0 - 0.172635 2024-09-16T07:52:22.073 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 43 16 3416 3400 4.94134 0 - 0.172635 2024-09-16T07:52:23.073 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 44 16 3416 3400 4.82904 0 - 0.172635 2024-09-16T07:52:24.073 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 45 16 3416 3400 4.72173 0 - 0.172635 2024-09-16T07:52:25.073 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 46 16 3416 3400 4.61908 0 - 0.172635 2024-09-16T07:52:25.986 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:52:26.073 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 47 16 3416 3400 4.5208 0 - 0.172635 2024-09-16T07:52:26.095 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:52:26.098 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:26.098 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:52:27.073 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 48 16 3416 3400 4.42662 0 - 0.172635 2024-09-16T07:52:28.073 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 49 16 3416 3400 4.33628 0 - 0.172635 2024-09-16T07:52:29.004 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:52:29.073 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 50 16 3416 3400 4.24956 0 - 0.172635 2024-09-16T07:52:29.213 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:52:29.214 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:52:30.074 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 51 16 3416 3400 4.16623 0 - 0.172635 2024-09-16T07:52:31.074 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 52 16 3416 3400 4.08611 0 - 0.172635 2024-09-16T07:52:31.100 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:52:31.215 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:31.278 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T07:52:31.279 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [ 2024-09-16T07:52:31.279 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.279 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:31.279 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 171, 2024-09-16T07:52:31.279 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.279 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.279 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.279 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.239541+0000" 2024-09-16T07:52:31.279 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.279 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.279 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.280 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.239558+0000" 2024-09-16T07:52:31.280 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.280 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.280 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.280 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.280 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.280 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.280 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.280 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.240941+0000" 2024-09-16T07:52:31.280 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.280 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.280 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.281 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.281 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.281 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.281 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.281 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.281 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.281 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.281 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.281 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.281 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.281 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.281 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.281 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.242820+0000" 2024-09-16T07:52:31.281 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.282 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.282 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.282 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.282 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.282 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.282 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.282 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.243678+0000" 2024-09-16T07:52:31.282 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.282 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.282 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.282 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.282 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.282 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.283 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.283 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.283 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.283 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.283 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.283 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.283 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.283 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.283 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.283 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.283 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.283 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.283 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.244825+0000" 2024-09-16T07:52:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.285 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.285 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.285 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.285 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:31.285 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.246061+0000" 2024-09-16T07:52:31.285 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.285 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.285 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.285 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.285 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.285 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.285 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:31.285 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.286 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.286 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.286 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.286 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.286 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.286 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.286 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:31.286 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.286 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.286 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.286 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.286 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.286 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.287 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.287 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:31.287 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.287 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.287 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.287 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.287 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.287 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.287 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.287 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:31.288 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.247235+0000" 2024-09-16T07:52:31.288 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.288 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.288 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.288 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.288 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.288 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.288 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:31.288 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.288 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.288 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.288 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.288 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.289 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.289 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.289 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:31.289 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.289 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.289 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.289 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.289 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.289 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.289 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.289 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:31.289 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.251532+0000" 2024-09-16T07:52:31.289 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.289 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.290 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.290 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.290 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.290 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.290 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:31.290 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.290 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.290 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.290 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.290 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.290 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.290 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.290 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:31.291 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.291 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.291 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.291 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.291 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.291 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.291 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.291 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.291 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.291 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.291 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.291 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.291 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.292 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:52:31.292 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 174, 2024-09-16T07:52:31.292 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.292 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:52:31.292 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "1", 2024-09-16T07:52:31.292 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.7", 2024-09-16T07:52:31.292 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 77, 2024-09-16T07:52:31.292 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 77, 2024-09-16T07:52:31.292 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 77 epoch_requested: 77 MInfoRec from 1 info: 2.7( empty local-lis/les=76/77 n=0 ec=12/12 lis/c=76/76 les/c/f=77/77/0 sis=76) pg_lease(ru 62.092857361s ub 62.251850128s int 16.000000000s)", 2024-09-16T07:52:31.292 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:52:31.292 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.292 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.292 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.249113+0000" 2024-09-16T07:52:31.293 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.293 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.293 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.293 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.249119+0000" 2024-09-16T07:52:31.293 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.293 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.293 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.293 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.293 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.294 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.294 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.294 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.249845+0000" 2024-09-16T07:52:31.294 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.294 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.294 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.294 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.294 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.294 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.294 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.294 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.294 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.295 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.295 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.295 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.295 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.295 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.295 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.295 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.250301+0000" 2024-09-16T07:52:31.295 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.295 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.295 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.295 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.295 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.295 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.296 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.296 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.250589+0000" 2024-09-16T07:52:31.296 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.296 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.296 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.296 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.296 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.296 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.296 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.296 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.296 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.297 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.297 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.297 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.297 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.297 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.297 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:52:31.297 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.250866+0000" 2024-09-16T07:52:31.297 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.297 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.297 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.297 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.297 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.297 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.297 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.298 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.298 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.298 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.298 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.298 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.298 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.298 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.298 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:52:31.298 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.251606+0000" 2024-09-16T07:52:31.298 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.298 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.298 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.298 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.299 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.299 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.299 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.299 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.299 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.299 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:52:31.299 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.299 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.299 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.299 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.299 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:31.299 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 56, 2024-09-16T07:52:31.299 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.299 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.300 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.300 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.138209+0000" 2024-09-16T07:52:31.300 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.300 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.300 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.300 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.138227+0000" 2024-09-16T07:52:31.300 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.300 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.300 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.300 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.300 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.300 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.300 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.301 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.139427+0000" 2024-09-16T07:52:31.301 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.301 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.301 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.301 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.301 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.301 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.301 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.301 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.301 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.301 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.301 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.301 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.302 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.302 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.302 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.302 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.140555+0000" 2024-09-16T07:52:31.302 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.302 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.302 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.302 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.302 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.302 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.302 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.302 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.142380+0000" 2024-09-16T07:52:31.302 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.302 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.303 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.303 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.303 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.303 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.303 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.303 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.303 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.303 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.303 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.303 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.303 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.303 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.304 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.304 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.304 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.304 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.304 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:31.304 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.142819+0000" 2024-09-16T07:52:31.304 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.304 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.305 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.305 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.305 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.305 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.305 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.305 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.305 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.305 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.305 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.305 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.305 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.143046+0000" 2024-09-16T07:52:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.143164+0000", 2024-09-16T07:52:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PGActivationBlocker", 2024-09-16T07:52:31.306 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.307 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "5.0" 2024-09-16T07:52:31.307 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.307 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.307 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.307 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.307 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.307 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.307 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.307 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.307 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:31.307 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.307 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.307 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.308 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.308 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.308 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.308 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.308 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:31.308 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.308 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.308 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.308 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.308 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.308 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.308 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.308 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:31.309 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.309 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.309 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.309 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.309 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.309 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.309 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.309 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:31.310 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.310 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.310 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.310 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.310 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.310 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.310 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.310 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:31.310 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.310 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.311 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.311 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.311 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.311 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.311 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.311 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:31.311 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.311 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.311 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.311 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.311 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.311 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.311 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.311 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:31.312 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.312 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.312 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.312 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.312 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.312 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:31.312 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.313 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.313 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.313 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.313 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.313 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.314 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.314 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.314 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.314 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.314 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.314 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.315 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.315 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:31.315 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 61, 2024-09-16T07:52:31.315 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.315 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.315 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.315 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.151791+0000" 2024-09-16T07:52:31.315 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.315 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.315 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.315 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.151807+0000" 2024-09-16T07:52:31.315 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.315 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.316 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.316 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.316 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.316 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.153249+0000" 2024-09-16T07:52:31.316 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.316 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.316 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.316 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.317 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.317 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.317 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.317 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.317 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.317 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.317 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.317 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.317 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.318 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.318 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.153919+0000" 2024-09-16T07:52:31.318 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.318 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.318 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.318 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.318 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.318 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.319 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.160056+0000" 2024-09-16T07:52:31.319 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.319 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.319 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.319 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.319 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.319 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.319 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.319 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.320 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.320 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.320 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.320 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:31.320 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.160558+0000" 2024-09-16T07:52:31.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.320 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.321 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.321 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.321 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:31.322 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.160774+0000", 2024-09-16T07:52:31.322 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:31.322 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "CommonPGPipeline:::wait_for_active", 2024-09-16T07:52:31.322 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.322 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T07:52:31.322 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 56 2024-09-16T07:52:31.322 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.322 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.322 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.322 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.322 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:31.323 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.323 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.323 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.323 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:31.323 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.324 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.324 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:31.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.324 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.325 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.325 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:31.325 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.325 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.325 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.325 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.325 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.325 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.325 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.325 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:31.325 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.325 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.325 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.325 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.326 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:31.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.326 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.326 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:31.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.327 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.327 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.327 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:31.327 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.327 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.327 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.328 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:31.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.328 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.328 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.328 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.328 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.329 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.329 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:31.329 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 70, 2024-09-16T07:52:31.329 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.329 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.329 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.176381+0000" 2024-09-16T07:52:31.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.329 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.330 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.176405+0000" 2024-09-16T07:52:31.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.330 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.330 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.330 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.177138+0000" 2024-09-16T07:52:31.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.331 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.331 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.331 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.332 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.332 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.332 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.178432+0000" 2024-09-16T07:52:31.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.332 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.332 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.332 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.333 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.333 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.180250+0000" 2024-09-16T07:52:31.333 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.333 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.333 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.333 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.333 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.333 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.333 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.333 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.333 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.333 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.333 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.334 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.334 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.334 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.334 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.334 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.334 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:31.334 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.180686+0000" 2024-09-16T07:52:31.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.334 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.334 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.334 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.335 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.335 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.335 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.335 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.335 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:31.335 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.180884+0000" 2024-09-16T07:52:31.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.335 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.336 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.336 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:31.336 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.180993+0000", 2024-09-16T07:52:31.336 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:31.336 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PGActivationBlocker", 2024-09-16T07:52:31.336 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.336 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "5.e" 2024-09-16T07:52:31.336 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.336 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.337 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.337 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.337 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:31.337 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.337 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.337 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.337 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:31.338 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.338 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.338 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.338 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:31.338 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.338 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.339 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.339 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.339 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:31.339 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.339 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.339 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.339 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.340 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:31.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.340 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.340 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:31.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.340 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.341 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.341 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:31.341 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.341 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.341 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.341 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:31.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.342 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.342 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.342 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.342 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.342 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.342 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:31.343 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 75, 2024-09-16T07:52:31.343 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.343 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.343 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.343 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.183898+0000" 2024-09-16T07:52:31.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.343 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.343 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.343 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.183926+0000" 2024-09-16T07:52:31.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.343 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.343 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.343 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.344 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.344 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.184392+0000" 2024-09-16T07:52:31.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.344 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.344 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.344 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.344 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.344 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.345 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.345 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.345 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.185182+0000" 2024-09-16T07:52:31.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.345 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.345 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.345 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.186762+0000" 2024-09-16T07:52:31.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.346 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.346 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.346 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.347 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.347 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.347 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.347 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:31.347 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.187199+0000" 2024-09-16T07:52:31.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.348 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.348 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.348 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.348 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.348 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.348 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.348 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.348 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.348 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.349 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:31.349 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.187415+0000", 2024-09-16T07:52:31.349 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:31.349 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "CommonPGPipeline:::wait_for_active", 2024-09-16T07:52:31.349 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.349 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T07:52:31.349 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 70 2024-09-16T07:52:31.349 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.349 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.349 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.350 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:31.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.350 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.350 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:31.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.351 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.351 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.351 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:31.351 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.351 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.351 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.351 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:31.352 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.352 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.352 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.352 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:31.352 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.352 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.353 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:31.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.353 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.353 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:31.354 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.354 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.354 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.354 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:31.354 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.354 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.354 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.355 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:31.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.355 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.355 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.355 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.355 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.356 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.356 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:31.356 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 83, 2024-09-16T07:52:31.356 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.356 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.356 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.205288+0000" 2024-09-16T07:52:31.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.356 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.205302+0000" 2024-09-16T07:52:31.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.357 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.357 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.205822+0000" 2024-09-16T07:52:31.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.357 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.358 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.358 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.358 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.358 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.358 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.358 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.206733+0000" 2024-09-16T07:52:31.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.359 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.359 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.209069+0000" 2024-09-16T07:52:31.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.359 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.360 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.360 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.360 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.360 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.360 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.360 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.361 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:31.361 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.209508+0000" 2024-09-16T07:52:31.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.361 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.361 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.361 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.361 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.361 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.362 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:31.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.209712+0000" 2024-09-16T07:52:31.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.362 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.362 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:31.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.209854+0000" 2024-09-16T07:52:31.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.363 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.363 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:31.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.363 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.364 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.364 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:31.364 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.364 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.365 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:31.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.177138+0000" 2024-09-16T07:52:31.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.365 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.365 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.367 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:31.367 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.181339+0000" 2024-09-16T07:52:31.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.367 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.367 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.367 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:31.367 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.368 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.369 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.369 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.369 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.369 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:31.369 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 85, 2024-09-16T07:52:31.369 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.369 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.369 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.213094+0000" 2024-09-16T07:52:31.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.369 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.213116+0000" 2024-09-16T07:52:31.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.370 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.370 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.213796+0000" 2024-09-16T07:52:31.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.370 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.371 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.371 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.371 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.371 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.371 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.371 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.214275+0000" 2024-09-16T07:52:31.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.372 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.372 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.372 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.372 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.215395+0000" 2024-09-16T07:52:31.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.372 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.372 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.372 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.373 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.373 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.373 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.373 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.373 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.373 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:31.374 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.215804+0000" 2024-09-16T07:52:31.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.374 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.374 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.374 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.374 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.374 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.375 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.375 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:31.375 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.216009+0000" 2024-09-16T07:52:31.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.375 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.375 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.375 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:31.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.216151+0000" 2024-09-16T07:52:31.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.376 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.376 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:31.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.376 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.377 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:31.377 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.377 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.377 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.377 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:31.377 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.192033+0000" 2024-09-16T07:52:31.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.378 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.378 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:31.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.378 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.379 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:31.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.379 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.379 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:31.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.199596+0000" 2024-09-16T07:52:31.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.379 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.380 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.380 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:31.380 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.380 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.380 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.380 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:31.381 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.381 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.381 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.381 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.381 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.381 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.381 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.381 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.382 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:31.382 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 88, 2024-09-16T07:52:31.382 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.382 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.382 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.382 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.216067+0000" 2024-09-16T07:52:31.382 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.382 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.382 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.382 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.216076+0000" 2024-09-16T07:52:31.382 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.383 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.383 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.383 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.383 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.216223+0000" 2024-09-16T07:52:31.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.383 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.383 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.383 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.384 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.384 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.384 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.384 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.384 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.216541+0000" 2024-09-16T07:52:31.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.384 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.385 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.385 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.385 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.385 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.385 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.217981+0000" 2024-09-16T07:52:31.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.385 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.385 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.385 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.385 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.385 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.385 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.386 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.386 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.386 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.386 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.386 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:31.386 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.218405+0000" 2024-09-16T07:52:31.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.387 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.387 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.387 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.387 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.387 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.387 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.387 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:31.388 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.218601+0000" 2024-09-16T07:52:31.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.388 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.388 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.388 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:31.388 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.388 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.389 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.389 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.389 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:31.389 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.389 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.389 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.389 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.389 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.389 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:31.389 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.390 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.390 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.390 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.390 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.390 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:31.390 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.177565+0000" 2024-09-16T07:52:31.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.390 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.390 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.390 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.391 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:31.391 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.391 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.391 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.391 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:31.392 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.392 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.392 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.181917+0000" 2024-09-16T07:52:31.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.392 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:31.392 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.182417+0000" 2024-09-16T07:52:31.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.392 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.392 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.393 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:31.393 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.393 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.393 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.394 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.394 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:31.394 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.394 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.394 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.394 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.394 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.394 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.394 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.394 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.395 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.395 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.395 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:31.395 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 91, 2024-09-16T07:52:31.395 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.395 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.395 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.220037+0000" 2024-09-16T07:52:31.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.395 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.395 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.220050+0000" 2024-09-16T07:52:31.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.396 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.396 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.396 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.396 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.220194+0000" 2024-09-16T07:52:31.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.396 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.396 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.396 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.397 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.397 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.397 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.397 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.397 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.397 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.397 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.220389+0000" 2024-09-16T07:52:31.397 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.397 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.398 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.398 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.398 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.398 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.221783+0000" 2024-09-16T07:52:31.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.398 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.398 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.398 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.398 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.398 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.398 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.399 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.399 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.399 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.399 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.399 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:31.399 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.222313+0000", 2024-09-16T07:52:31.399 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:31.399 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "ClientRequest::PGPipeline::await_map", 2024-09-16T07:52:31.399 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.400 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T07:52:31.400 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 75 2024-09-16T07:52:31.400 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.400 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.400 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.400 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.400 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.400 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.400 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.400 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.400 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.401 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.401 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:31.401 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.401 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.401 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.401 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.402 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:31.403 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.403 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.403 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.403 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:31.403 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.403 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.404 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.404 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.404 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:31.404 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.404 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.404 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.404 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.404 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.404 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:31.404 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.405 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.405 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.405 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.405 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:31.405 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.405 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.405 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.405 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.405 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.406 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:31.406 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.406 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.406 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.406 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:31.406 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.406 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.407 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.407 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.407 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.407 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.407 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.407 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.407 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.407 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T07:52:31.407 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 175, 2024-09-16T07:52:31.407 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.407 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T07:52:31.408 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "3", 2024-09-16T07:52:31.408 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.5", 2024-09-16T07:52:31.408 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 77, 2024-09-16T07:52:31.408 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 77, 2024-09-16T07:52:31.408 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 77 epoch_requested: 77 MInfoRec from 3 info: 2.5( empty local-lis/les=76/77 n=0 ec=12/12 lis/c=76/62 les/c/f=77/63/0 sis=76) pg_lease(ru 146.615798950s ub 146.780105591s int 16.000000000s)", 2024-09-16T07:52:31.408 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T07:52:31.408 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.408 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.408 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.253594+0000" 2024-09-16T07:52:31.408 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.408 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.408 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.408 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.253603+0000" 2024-09-16T07:52:31.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.409 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.409 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.409 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.409 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.409 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.409 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.254677+0000" 2024-09-16T07:52:31.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.409 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.409 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.409 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.410 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.410 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.410 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.410 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.410 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.410 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.258592+0000" 2024-09-16T07:52:31.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.410 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.411 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.411 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.411 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.259585+0000" 2024-09-16T07:52:31.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.411 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.411 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.411 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.412 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.412 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.412 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.412 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.412 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.412 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T07:52:31.412 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.259839+0000" 2024-09-16T07:52:31.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.413 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.413 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.413 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.413 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.413 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.413 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.414 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.414 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T07:52:31.414 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.259924+0000" 2024-09-16T07:52:31.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.414 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.414 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.414 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.414 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.414 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.414 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.414 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.414 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:52:31.415 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.415 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.415 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.415 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.415 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:31.415 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 46, 2024-09-16T07:52:31.415 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.415 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.415 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.415 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.115019+0000" 2024-09-16T07:52:31.415 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.415 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.416 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.416 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.115051+0000" 2024-09-16T07:52:31.416 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.416 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.416 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.416 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.416 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.416 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.416 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.416 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.116010+0000" 2024-09-16T07:52:31.416 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.416 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.416 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.417 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.417 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.417 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.417 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.417 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.417 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.417 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.117772+0000" 2024-09-16T07:52:31.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.418 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.418 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.418 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.418 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.119543+0000" 2024-09-16T07:52:31.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.418 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.418 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.419 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.419 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.419 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.419 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.419 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.419 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.419 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:31.420 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.120169+0000" 2024-09-16T07:52:31.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.420 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.420 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.420 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.420 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.420 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.421 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.421 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:31.421 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.121519+0000" 2024-09-16T07:52:31.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.421 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.421 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.421 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:31.421 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.121652+0000", 2024-09-16T07:52:31.422 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:31.422 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PGActivationBlocker", 2024-09-16T07:52:31.422 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.422 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "5.d" 2024-09-16T07:52:31.422 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.422 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.422 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.422 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.422 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.422 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.422 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:31.423 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.423 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.423 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.423 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:31.423 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.423 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.423 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.424 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.424 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:31.424 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.424 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.424 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.424 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.424 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.424 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.424 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.424 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:31.424 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.425 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.425 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.425 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.425 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.425 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.425 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.425 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:31.425 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.425 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.425 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.425 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.425 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.425 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.426 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:31.426 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.426 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.426 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.426 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:31.426 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.426 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.427 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.427 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.427 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.427 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.427 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:31.427 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.427 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.427 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.427 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.427 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.427 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.427 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.427 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.427 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.428 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.428 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.428 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.428 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.428 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:31.428 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 80, 2024-09-16T07:52:31.428 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.428 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.428 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.428 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.197858+0000" 2024-09-16T07:52:31.428 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.428 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.428 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.429 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.197876+0000" 2024-09-16T07:52:31.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.429 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.429 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.429 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.429 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.198893+0000" 2024-09-16T07:52:31.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.429 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.429 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.430 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.430 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.430 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.430 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.430 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.430 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.199388+0000" 2024-09-16T07:52:31.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.431 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.431 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.431 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.431 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.201343+0000" 2024-09-16T07:52:31.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.431 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.431 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.431 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.432 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.432 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.432 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.432 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.432 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.432 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:31.432 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.201791+0000" 2024-09-16T07:52:31.433 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.433 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.433 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.433 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.433 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.433 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.433 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.433 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.433 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.433 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.434 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.434 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:31.434 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.202011+0000", 2024-09-16T07:52:31.434 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:31.434 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "CommonPGPipeline:::wait_for_active", 2024-09-16T07:52:31.434 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.434 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T07:52:31.434 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 46 2024-09-16T07:52:31.434 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.434 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.434 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.434 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.435 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.435 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:31.435 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.435 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.435 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.435 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:31.436 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.436 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.436 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.436 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.436 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.436 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:31.436 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.436 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.436 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.436 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.437 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.437 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:31.437 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.437 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.437 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.437 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.437 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.437 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:31.437 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.438 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.438 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.438 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.438 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:31.438 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.438 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.438 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.438 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.438 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.438 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:31.439 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.439 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.439 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.439 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:31.439 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.439 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.439 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.440 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.440 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:31.440 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.440 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.440 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.440 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.440 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.440 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.440 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.440 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.440 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.441 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.441 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:31.441 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 50, 2024-09-16T07:52:31.441 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.441 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.441 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.441 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.128626+0000" 2024-09-16T07:52:31.441 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.441 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.441 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.441 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.128646+0000" 2024-09-16T07:52:31.441 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.441 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.129320+0000" 2024-09-16T07:52:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.131024+0000" 2024-09-16T07:52:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.133046+0000" 2024-09-16T07:52:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.253478+0000" 2024-09-16T07:52:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.133580+0000" 2024-09-16T07:52:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.446 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.446 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.446 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.446 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.446 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.446 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.446 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.446 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.446 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.446 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.446 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:31.446 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.133898+0000" 2024-09-16T07:52:31.446 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.447 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.447 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.447 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:31.447 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.134027+0000" 2024-09-16T07:52:31.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.447 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.447 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.447 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:31.448 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.448 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.448 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.448 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:31.448 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.448 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.449 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.449 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:31.449 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.252031+0000" 2024-09-16T07:52:31.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.449 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.449 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.449 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:31.450 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.450 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.450 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.450 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.450 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.450 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:31.450 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.450 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.450 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.450 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.450 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.451 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:31.451 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.451 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.451 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.451 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.451 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.451 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:31.451 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.451 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.451 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.452 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.452 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.452 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.452 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:31.452 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.452 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.452 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.452 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.452 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.452 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.452 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.453 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.453 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.453 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.453 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:31.453 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:31.453 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 65, 2024-09-16T07:52:31.453 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:31.453 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.453 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:31.453 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.164195+0000" 2024-09-16T07:52:31.453 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.453 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.453 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:31.453 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.164210+0000" 2024-09-16T07:52:31.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.454 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.454 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.454 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:31.454 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.165248+0000" 2024-09-16T07:52:31.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.454 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.454 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.454 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:31.455 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.455 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.455 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.455 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:31.455 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.167583+0000" 2024-09-16T07:52:31.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.455 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.455 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.456 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.456 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:31.456 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.169815+0000" 2024-09-16T07:52:31.456 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.456 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.456 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.456 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.456 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:31.456 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.456 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.456 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.457 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.457 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.457 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.457 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.457 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.254265+0000" 2024-09-16T07:52:31.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.457 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.457 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:31.457 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.170258+0000" 2024-09-16T07:52:31.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.457 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.458 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.458 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.458 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:31.458 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.458 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.458 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.458 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.458 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.458 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:31.458 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:30.170480+0000" 2024-09-16T07:52:31.459 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.459 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.459 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.459 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.459 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.459 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.459 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:31.459 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.459 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.459 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.459 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.459 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.459 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.459 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.460 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:31.460 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.460 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.460 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.460 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.460 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.460 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.460 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.460 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:31.460 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.460 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.460 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.460 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.460 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.461 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.461 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.461 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:31.461 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:31.252773+0000" 2024-09-16T07:52:31.461 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.461 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.461 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.461 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.461 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.461 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.461 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:31.461 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.462 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:31.463 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.463 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.463 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.463 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.463 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.463 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.463 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.463 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:31.463 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.463 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.463 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.463 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.463 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.464 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.464 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:31.464 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:31.464 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.464 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.464 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.464 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:31.464 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.464 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:31.464 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:31.464 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:31.464 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:31.465 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.465 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.465 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:31.465 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:52:31.465 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T07:52:31.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:31.380+0000 7f9c1e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:31.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:31.390+0000 7f9c1e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:32.074 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 53 16 3556 3540 4.1741 0.546875 0.1134 0.239409 2024-09-16T07:52:33.074 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 54 16 3760 3744 4.33289 12.75 0.100217 0.230596 2024-09-16T07:52:33.761 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:33.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:33.929+0000 7f4a5a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:33.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:33.942+0000 7f4a5a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:34.074 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 55 16 3965 3949 4.48704 12.8125 0.0522886 0.222674 2024-09-16T07:52:35.074 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 56 16 4172 4156 4.63792 12.9375 0.0724297 0.215428 2024-09-16T07:52:36.074 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 57 16 4387 4371 4.79227 13.4375 0.0920652 0.208481 2024-09-16T07:52:36.348 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:36.467 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 2, 1, 0] 2024-09-16T07:52:36.467 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:52:36.468 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [3, 2, 1, 0] 2024-09-16T07:52:36.468 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T07:52:36.468 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:52:36.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:36.498+0000 7f6848791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:36.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:36.505+0000 7f6848791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:36.556 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T07:52:37.074 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 58 16 4479 4463 4.80877 5.75 0.0168816 0.205649 2024-09-16T07:52:38.075 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 59 16 4479 4463 4.72726 0 - 0.205649 2024-09-16T07:52:39.075 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:52:39.076847+0000 min lat: 0.0153521 max lat: 20.3424 avg lat: 0.205649 2024-09-16T07:52:39.075 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:52:39.075 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 60 16 4479 4463 4.64847 0 - 0.205649 2024-09-16T07:52:40.075 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 61 16 4479 4463 4.57226 0 - 0.205649 2024-09-16T07:52:41.075 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 62 16 4479 4463 4.49851 0 - 0.205649 2024-09-16T07:52:41.556 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [3, 2, 1] 2024-09-16T07:52:41.557 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:52:41.557 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-16T07:52:41.557 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:52:41.557 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T07:52:41.560 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:52:41.560 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:52:41.675 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:52:41.679 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:41.679 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:52:42.075 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 63 16 4479 4463 4.42711 0 - 0.205649 2024-09-16T07:52:43.075 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 64 16 4479 4463 4.35793 0 - 0.205649 2024-09-16T07:52:44.075 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 65 16 4479 4463 4.29089 0 - 0.205649 2024-09-16T07:52:45.075 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 66 16 4479 4463 4.22588 0 - 0.205649 2024-09-16T07:52:46.075 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 67 16 4479 4463 4.1628 0 - 0.205649 2024-09-16T07:52:46.681 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:52:46.784 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:52:46.788 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:46.788 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:52:47.075 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 68 16 4479 4463 4.10159 0 - 0.205649 2024-09-16T07:52:48.076 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 69 16 4479 4463 4.04215 0 - 0.205649 2024-09-16T07:52:49.076 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 70 16 4479 4463 3.9844 0 - 0.205649 2024-09-16T07:52:50.012 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:52:50.076 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 71 16 4479 4463 3.92828 0 - 0.205649 2024-09-16T07:52:50.208 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:52:50.209 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:52:51.076 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 72 16 4479 4463 3.87372 0 - 0.205649 2024-09-16T07:52:51.789 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:52:51.912 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T07:52:51.912 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [ 2024-09-16T07:52:51.912 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:51.913 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:51.913 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 65, 2024-09-16T07:52:51.913 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:51.913 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.913 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:51.913 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.182619+0000" 2024-09-16T07:52:51.913 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.913 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.913 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:51.913 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.182644+0000" 2024-09-16T07:52:51.913 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.913 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.913 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.913 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.183179+0000" 2024-09-16T07:52:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.914 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.184088+0000" 2024-09-16T07:52:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:51.916 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.189596+0000" 2024-09-16T07:52:51.916 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.916 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.916 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.916 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.916 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.916 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.916 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:51.916 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.916 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.916 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.916 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.916 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.917 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.917 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.917 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:51.917 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.917 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.917 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.917 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:51.917 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.190082+0000" 2024-09-16T07:52:51.917 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.917 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.917 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.917 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.917 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.917 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:51.918 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.918 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.918 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.918 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.918 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.918 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:51.918 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.190494+0000" 2024-09-16T07:52:51.918 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.918 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.918 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.919 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.919 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.919 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:51.919 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.191373+0000", 2024-09-16T07:52:51.919 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:51.919 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PGActivationBlocker", 2024-09-16T07:52:51.919 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:51.919 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "5.b" 2024-09-16T07:52:51.919 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.919 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.919 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.920 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.920 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.920 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.920 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.920 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.920 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:51.920 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.920 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.920 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.920 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.920 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.920 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.921 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.921 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:51.921 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.921 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.921 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.921 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.921 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.921 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.921 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.921 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:51.921 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.921 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.921 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.922 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.922 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.922 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.922 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.922 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:51.922 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.922 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.922 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.922 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.922 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.922 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.922 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.922 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:51.922 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.923 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.923 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.923 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.923 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.923 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.923 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.923 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:51.923 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.923 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.923 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.923 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.923 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.924 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.924 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.924 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:51.924 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.924 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.924 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.924 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.924 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.924 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.925 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.925 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:51.925 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.925 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.925 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.925 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.925 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.925 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.925 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.925 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:51.925 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.925 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.926 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.926 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.926 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:51.926 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:51.926 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 67, 2024-09-16T07:52:51.926 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:51.926 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.926 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:51.926 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.189245+0000" 2024-09-16T07:52:51.926 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.926 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.926 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:51.926 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.189260+0000" 2024-09-16T07:52:51.926 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.927 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.927 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.927 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.927 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:51.927 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.190967+0000" 2024-09-16T07:52:51.927 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.927 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.927 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.927 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.927 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:51.928 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.928 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.928 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.928 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.928 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.928 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.928 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.928 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:51.928 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.191532+0000" 2024-09-16T07:52:51.928 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.928 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.928 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.928 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.929 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.929 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.929 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:51.929 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.193324+0000" 2024-09-16T07:52:51.929 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.929 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.929 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.929 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.929 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.929 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.929 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:51.929 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.929 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.930 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.930 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.930 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.930 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.930 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.930 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:51.930 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.930 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.930 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.930 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:51.930 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.193851+0000" 2024-09-16T07:52:51.930 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.930 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.931 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.931 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.931 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.931 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.931 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:51.931 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.931 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.931 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.931 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.931 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.931 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.931 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.931 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:51.931 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.194094+0000" 2024-09-16T07:52:51.932 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.932 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.932 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.932 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.932 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.932 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.932 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:51.932 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.194202+0000", 2024-09-16T07:52:51.932 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:51.932 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PGActivationBlocker", 2024-09-16T07:52:51.932 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:51.932 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "5.e" 2024-09-16T07:52:51.932 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.932 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.933 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.933 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.933 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.933 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.933 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.933 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.933 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:51.933 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.933 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.933 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.933 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.933 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.933 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.934 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.934 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:51.934 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.934 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.934 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.934 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.934 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.934 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.934 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.934 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:51.934 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.934 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.934 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.934 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.935 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.935 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.935 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.935 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:51.935 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.935 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.935 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.935 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.935 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.935 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.935 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.935 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:51.935 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.935 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.936 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.936 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.936 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.936 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.936 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.936 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:51.936 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.936 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.936 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.936 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.936 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.937 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.937 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.937 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:51.937 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.937 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.937 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.937 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.937 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.937 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.937 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.937 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:51.937 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.937 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.938 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.938 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.938 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.938 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.938 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.938 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:51.938 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.938 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.938 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.938 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.938 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:51.938 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:51.938 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 72, 2024-09-16T07:52:51.939 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:51.939 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.939 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:51.939 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.200498+0000" 2024-09-16T07:52:51.939 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.939 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.939 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:51.939 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.200526+0000" 2024-09-16T07:52:51.939 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.939 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.939 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.939 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.939 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.939 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.201278+0000" 2024-09-16T07:52:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.940 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.941 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.941 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.941 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:51.941 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.202660+0000" 2024-09-16T07:52:51.941 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.941 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.941 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.941 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.941 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.941 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.941 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:51.941 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.207961+0000" 2024-09-16T07:52:51.941 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.942 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.942 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.942 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.942 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.942 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.942 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:51.942 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.942 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.942 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.942 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.943 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.943 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.943 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.943 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:51.943 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.943 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.943 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.943 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:51.943 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.208406+0000" 2024-09-16T07:52:51.943 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.943 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.943 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.943 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.943 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.944 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.944 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:51.944 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.944 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.944 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.944 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.944 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.944 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.944 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.944 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:51.944 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.208614+0000", 2024-09-16T07:52:51.944 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:51.944 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "CommonPGPipeline:::wait_for_active", 2024-09-16T07:52:51.945 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:51.945 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T07:52:51.945 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 65 2024-09-16T07:52:51.945 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.945 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.945 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.945 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.945 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.945 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.945 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.945 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.946 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:51.946 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.946 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.946 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.946 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.946 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.946 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.946 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.946 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:51.946 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.946 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.946 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.946 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.946 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.947 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.947 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.947 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:51.947 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.947 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.947 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.947 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.947 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.947 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.947 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.947 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:51.947 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.947 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.948 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.948 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.948 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.948 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.948 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.948 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:51.948 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.948 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.948 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.948 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.948 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.948 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.948 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.949 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:51.949 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.949 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.949 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.949 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.949 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.949 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.949 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.949 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:51.949 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.949 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.949 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.949 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.949 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.950 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.950 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.950 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:51.950 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.950 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.950 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.950 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.950 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.950 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.950 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.951 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:51.951 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.951 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.951 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.951 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.951 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.951 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.951 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.951 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:51.951 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.951 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.951 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.951 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.951 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:51.952 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:51.952 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 75, 2024-09-16T07:52:51.952 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:51.952 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.952 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:51.952 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.209869+0000" 2024-09-16T07:52:51.952 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.952 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.952 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:51.952 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.209881+0000" 2024-09-16T07:52:51.952 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.952 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.953 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.953 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.953 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.953 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.953 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:51.953 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.210855+0000" 2024-09-16T07:52:51.953 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.953 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.953 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.953 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.953 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.953 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.953 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:51.953 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.954 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.954 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.954 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.954 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.954 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.954 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.954 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:51.954 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.212329+0000" 2024-09-16T07:52:51.955 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.955 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.955 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.955 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.955 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.955 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.955 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:51.955 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.213765+0000" 2024-09-16T07:52:51.955 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.955 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.955 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.955 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.956 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.956 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.956 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:51.956 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.956 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.956 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.956 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.956 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.956 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.956 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.956 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:51.956 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.956 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.957 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.957 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:51.957 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.214896+0000", 2024-09-16T07:52:51.957 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:51.957 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "ClientRequest::PGPipeline::await_map", 2024-09-16T07:52:51.957 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:51.957 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T07:52:51.957 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 72 2024-09-16T07:52:51.957 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.957 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.957 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.958 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.958 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.958 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.958 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.958 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.958 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:51.958 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.958 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.958 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.958 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.958 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.958 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.958 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.959 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:51.959 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.959 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.959 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.959 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.959 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.959 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:51.959 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.959 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.959 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.960 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.960 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.960 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.960 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:51.960 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.960 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.960 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.960 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.960 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.960 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.960 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.960 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:51.960 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.961 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.961 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.961 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.961 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.961 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.961 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.961 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:51.961 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.961 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.961 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.961 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.962 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.962 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.962 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.962 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:51.962 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.962 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.962 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.962 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.962 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.963 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.963 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.963 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:51.963 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.963 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.963 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.963 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.963 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.963 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.963 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.963 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:51.964 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.964 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.964 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.964 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.964 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.964 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.964 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.964 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:51.964 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.965 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.965 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.965 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.965 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.965 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.965 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.965 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:51.965 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.965 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.965 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.966 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.966 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.966 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.966 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.966 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:51.966 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.966 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.966 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.966 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.966 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:51.966 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:51.967 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 83, 2024-09-16T07:52:51.967 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:51.967 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.967 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:51.967 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.219981+0000" 2024-09-16T07:52:51.967 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.967 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.967 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:51.967 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.219992+0000" 2024-09-16T07:52:51.967 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.968 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.968 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.968 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.968 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.968 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.968 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:51.968 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.220556+0000" 2024-09-16T07:52:51.968 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.968 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.969 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.969 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.969 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.969 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.969 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:51.969 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.969 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.969 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.969 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.969 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.970 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.970 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.970 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:51.970 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.220823+0000" 2024-09-16T07:52:51.970 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.970 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.970 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.970 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.970 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.971 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.971 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:51.971 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.224475+0000", 2024-09-16T07:52:51.971 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:51.971 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PerShardPipeline::create_or_wait_pg", 2024-09-16T07:52:51.971 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:51.971 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 6, 2024-09-16T07:52:51.971 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 75 2024-09-16T07:52:51.971 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.971 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.972 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.972 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.972 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.972 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.972 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.972 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.972 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:51.972 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.972 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.973 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.973 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.973 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.973 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.973 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.973 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:51.973 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.973 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.973 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.973 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:51.973 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.973 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.973 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.974 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.974 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.974 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.974 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.974 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:51.974 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.974 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.974 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.974 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.974 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.974 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.974 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.974 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:51.975 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.975 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.975 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.975 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.975 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.975 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.975 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.975 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:51.975 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.975 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.975 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.975 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.975 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.975 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.976 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.976 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:51.976 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.976 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.976 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.976 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.976 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.976 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.976 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.976 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:51.976 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.976 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.976 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.977 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.977 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.977 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.977 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.977 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:51.977 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.977 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.977 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.977 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.977 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.977 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.977 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.978 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:51.978 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.978 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.978 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.978 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.978 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.978 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.978 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.978 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:51.978 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.978 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.978 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.978 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.979 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.979 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.979 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.979 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:51.979 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.979 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.979 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.979 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.979 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.979 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.979 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.979 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:51.979 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.980 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.980 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.980 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.980 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.980 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.980 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.980 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:51.980 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.980 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.980 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.980 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.980 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.980 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.981 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.981 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:51.981 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.981 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.981 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.981 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.981 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:51.981 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:51.981 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 85, 2024-09-16T07:52:51.981 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:51.981 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.981 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:51.981 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.225163+0000" 2024-09-16T07:52:51.982 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.982 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.982 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:51.982 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.225173+0000" 2024-09-16T07:52:51.982 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.982 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.982 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.982 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.982 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.982 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.982 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:51.982 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.225655+0000" 2024-09-16T07:52:51.982 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.983 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.983 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.983 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.983 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.983 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.983 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:51.983 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.983 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.983 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.983 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.983 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.983 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.984 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.984 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:51.984 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.225787+0000" 2024-09-16T07:52:51.984 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.984 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.984 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.984 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.984 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.984 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.984 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:51.984 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.226909+0000", 2024-09-16T07:52:51.984 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:51.985 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PerShardPipeline::create_or_wait_pg", 2024-09-16T07:52:51.985 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:51.985 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 6, 2024-09-16T07:52:51.985 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 75 2024-09-16T07:52:51.985 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.985 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.985 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.985 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.985 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.985 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.985 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.985 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.985 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:51.986 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.986 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.986 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.986 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.986 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.986 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.986 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.986 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:51.986 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.986 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.986 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.986 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:51.986 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.987 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.987 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.987 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.987 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.987 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.987 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.987 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:51.987 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.987 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.987 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.987 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.987 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.987 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.988 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.988 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:51.988 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.988 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.988 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.988 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.988 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.988 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.988 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.988 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:51.988 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.988 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.988 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.989 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.989 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.989 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.989 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.989 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:51.989 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.989 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.989 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.989 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.989 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.989 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.989 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.989 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:51.989 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.990 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.990 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.990 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.990 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.990 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.990 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.990 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:51.990 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.990 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.990 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.990 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.990 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.991 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.991 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.991 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:51.991 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.991 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.991 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.991 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.991 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.991 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.991 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.991 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:51.991 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.992 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.992 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.992 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.992 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.992 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.992 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.992 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:51.992 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.992 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.993 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.993 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.993 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.993 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.993 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.993 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:51.993 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.993 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.993 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.993 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.993 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.994 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.994 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.994 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:51.994 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.994 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.994 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.994 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.994 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.994 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.994 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.995 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:51.995 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.995 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.995 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.995 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.995 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:51.995 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:51.995 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 90, 2024-09-16T07:52:51.995 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:51.995 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.995 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:51.995 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.229986+0000" 2024-09-16T07:52:51.996 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.996 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.996 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:51.996 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.229994+0000" 2024-09-16T07:52:51.996 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.996 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.996 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.996 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.996 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.996 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.997 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:51.997 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.230508+0000" 2024-09-16T07:52:51.997 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.997 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.997 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.997 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.997 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.997 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.997 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:51.998 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.998 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.998 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.998 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.998 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.998 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.998 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.998 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:51.998 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.230673+0000" 2024-09-16T07:52:51.998 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.998 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:51.998 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:51.998 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:51.999 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.999 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:51.999 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:51.999 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.234993+0000", 2024-09-16T07:52:51.999 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:51.999 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PerShardPipeline::create_or_wait_pg", 2024-09-16T07:52:51.999 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:51.999 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 6, 2024-09-16T07:52:51.999 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 75 2024-09-16T07:52:51.999 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.999 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:51.999 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:51.999 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.000 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.000 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.000 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.000 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.000 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:52.000 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.000 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.000 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.000 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.000 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.000 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.001 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.001 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:52.001 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.001 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.001 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.001 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:52.001 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.001 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.001 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.001 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.001 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.001 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.002 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.003 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.005 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.005 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.005 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.005 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:52.005 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.005 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.005 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.005 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.006 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.007 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.008 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.008 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.008 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.008 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:52.008 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.008 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.008 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.009 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.009 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.009 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.009 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.009 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:52.009 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.009 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.009 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.009 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.009 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.010 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.010 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.010 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:52.010 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.010 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.010 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.010 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.010 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:52.010 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:52.010 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 88, 2024-09-16T07:52:52.010 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:52.010 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.010 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:52.011 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.227969+0000" 2024-09-16T07:52:52.011 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.011 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.011 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:52.011 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.227980+0000" 2024-09-16T07:52:52.011 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.011 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.011 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.011 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.011 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.011 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.011 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:52.012 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.228152+0000" 2024-09-16T07:52:52.012 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.012 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.012 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.012 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.012 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.012 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.012 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:52.012 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.012 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.012 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.012 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.012 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.013 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.013 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.013 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:52.013 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.228488+0000" 2024-09-16T07:52:52.013 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.013 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.013 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.013 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.013 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.013 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.013 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:52.013 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.234784+0000", 2024-09-16T07:52:52.013 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:52.014 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PerShardPipeline::create_or_wait_pg", 2024-09-16T07:52:52.014 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:52.014 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 6, 2024-09-16T07:52:52.014 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 75 2024-09-16T07:52:52.014 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.014 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.014 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.014 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.014 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.014 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.014 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.014 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.014 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:52.014 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.015 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.015 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.015 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.015 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.015 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.015 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.015 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:52.015 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.015 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.015 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.015 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:52.015 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.015 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.016 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.016 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.016 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.016 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.016 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.016 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:52.016 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.016 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.016 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.016 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.016 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.016 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.016 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.017 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:52.017 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.017 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.017 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.017 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.017 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.017 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.017 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.017 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:52.017 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.017 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.017 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.017 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.018 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.018 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.018 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.018 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:52.018 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.018 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.018 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.018 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.018 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.018 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.018 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.018 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:52.018 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.019 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.019 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.019 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.019 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.019 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.019 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.019 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:52.019 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.019 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.019 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.019 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.020 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.020 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.020 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.020 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:52.020 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.020 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.020 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.020 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.020 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.020 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.020 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.021 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:52.021 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.021 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.021 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.021 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.021 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.021 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.021 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.021 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:52.021 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.021 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.021 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.021 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.022 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.022 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.022 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.022 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:52.022 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.022 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.022 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.022 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.022 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.022 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.022 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.022 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:52.022 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.023 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.023 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.023 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.023 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.023 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:52.023 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.023 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.023 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.023 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:52.023 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:52.024 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 93, 2024-09-16T07:52:52.024 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:52.024 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.024 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:52.024 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.233465+0000" 2024-09-16T07:52:52.024 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.024 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.024 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:52.024 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.233479+0000" 2024-09-16T07:52:52.024 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.024 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.024 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.024 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.025 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.025 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.025 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:52.025 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.233774+0000" 2024-09-16T07:52:52.025 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.025 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.025 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.025 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.025 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.025 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.025 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:52.025 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.025 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.026 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.026 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.026 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.026 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.026 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:52.026 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.234354+0000" 2024-09-16T07:52:52.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.026 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.026 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.026 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.026 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.027 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:52.027 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.236460+0000", 2024-09-16T07:52:52.027 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:52.027 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PerShardPipeline::create_or_wait_pg", 2024-09-16T07:52:52.027 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:52.027 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 6, 2024-09-16T07:52:52.027 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 75 2024-09-16T07:52:52.027 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.027 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.027 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.027 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.027 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.027 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.028 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.028 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:52.028 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.028 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.028 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.028 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.028 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.028 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:52.028 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.029 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.029 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:52.029 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.029 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.029 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.029 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.029 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.029 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.029 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.029 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:52.029 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.030 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.030 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.030 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.030 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.030 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:52.030 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.030 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.030 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.030 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.030 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.031 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.032 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.032 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.032 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:52.032 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.032 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.032 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.032 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.032 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.032 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.032 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.032 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:52.032 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.033 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.033 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.033 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.033 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.033 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.033 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.033 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:52.033 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.033 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.033 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.033 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.033 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.033 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.033 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.034 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:52.034 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.034 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.034 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.034 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.034 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.034 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.034 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.034 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:52.034 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.034 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.034 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.034 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.034 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.035 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.035 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.035 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:52.035 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.035 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.035 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.035 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.035 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.035 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.035 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.035 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:52.035 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.035 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.036 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.036 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.036 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.036 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.036 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.036 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:52.036 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.036 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.036 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.036 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.036 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:52.036 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:52.037 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 96, 2024-09-16T07:52:52.037 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:52.037 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.037 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:52.037 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.236844+0000" 2024-09-16T07:52:52.037 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.037 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.037 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:52.037 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.236854+0000" 2024-09-16T07:52:52.037 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.037 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.037 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.037 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.038 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.038 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.038 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:52.038 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.237205+0000" 2024-09-16T07:52:52.038 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.038 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.038 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.038 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.038 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.038 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.038 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:52.038 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.038 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.038 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.039 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.039 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.039 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.039 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:52.039 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.237720+0000" 2024-09-16T07:52:52.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.039 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.039 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.039 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.039 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.039 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:52.039 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.239444+0000", 2024-09-16T07:52:52.040 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:52.040 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PerShardPipeline::create_or_wait_pg", 2024-09-16T07:52:52.040 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:52.040 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 6, 2024-09-16T07:52:52.040 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 75 2024-09-16T07:52:52.040 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.040 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.040 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.040 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.040 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.040 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.040 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.041 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.041 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:52.041 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.041 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.041 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.041 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.041 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.041 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.041 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.041 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:52.041 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.041 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.041 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.041 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:52.042 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.042 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.042 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.042 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.042 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.042 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:52.042 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.042 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.042 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.042 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.043 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.043 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:52.043 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.043 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.043 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.043 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.043 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.043 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:52.043 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.043 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.044 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.044 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.044 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.044 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.044 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:52.044 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.044 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.044 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.044 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.044 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.044 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.044 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.044 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:52.045 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.045 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.045 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.045 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.045 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.045 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.045 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.045 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:52.045 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.045 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.045 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.046 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.046 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.046 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.046 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.046 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:52.046 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.046 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.046 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.046 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.047 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.047 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.047 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.047 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:52.047 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.047 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.047 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.047 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.048 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.048 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.048 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:52.048 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.048 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.048 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.048 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.048 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.049 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:52.049 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.049 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.049 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.049 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.049 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.049 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:52.049 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.049 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.049 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.050 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.050 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.050 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.050 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:52.050 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.050 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.050 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.050 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.050 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:52:52.050 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:52:52.050 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 80, 2024-09-16T07:52:52.050 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:52.050 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.051 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:52:52.051 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.215756+0000" 2024-09-16T07:52:52.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.051 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.051 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:52:52.051 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.215767+0000" 2024-09-16T07:52:52.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.051 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.051 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.051 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.051 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.051 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:52:52.052 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.216153+0000" 2024-09-16T07:52:52.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.052 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.052 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.052 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.052 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.052 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:52:52.052 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.052 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.052 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.052 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.053 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.053 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.053 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:52:52.053 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.216358+0000" 2024-09-16T07:52:52.053 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.053 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.053 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.053 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.053 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.053 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.053 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:52:52.053 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.217681+0000" 2024-09-16T07:52:52.053 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.054 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.054 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.054 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.054 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.054 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.054 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:52:52.054 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.054 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.054 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.054 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.054 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.054 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.054 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.055 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:52.055 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.055 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.055 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.055 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:52:52.055 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.218111+0000" 2024-09-16T07:52:52.055 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.055 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.055 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.055 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.055 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.055 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.055 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:52:52.055 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.056 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.056 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.056 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.056 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.056 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.056 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.056 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:52:52.056 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.218414+0000" 2024-09-16T07:52:52.056 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.056 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.056 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.056 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.056 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.057 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.057 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:52:52.057 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:52:51.218681+0000", 2024-09-16T07:52:52.057 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T07:52:52.057 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PGActivationBlocker", 2024-09-16T07:52:52.057 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:52:52.057 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "5.7" 2024-09-16T07:52:52.057 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.057 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.057 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.057 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.057 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.057 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.057 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.058 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.058 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:52:52.058 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.058 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.058 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.058 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.058 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.058 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.058 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.058 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:52:52.058 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.059 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.059 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.059 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.059 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.059 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:52:52.059 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.059 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.059 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.059 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.060 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.060 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:52:52.060 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.060 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.060 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.060 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.060 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.060 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.060 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.060 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:52:52.060 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.060 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.060 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.061 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.061 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.061 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.061 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:52:52.061 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.061 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.061 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.061 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.061 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.062 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:52:52.062 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.062 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.062 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.062 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.062 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.062 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.062 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:52:52.062 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:52:52.062 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.062 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.062 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.062 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:52:52.062 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.063 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:52:52.063 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:52:52.063 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:52:52.063 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:52:52.063 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.063 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.063 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:52:52.063 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:52:52.063 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T07:52:52.076 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 73 16 4479 4463 3.82066 0 - 0.205649 2024-09-16T07:52:52.210 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:52.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:52.369+0000 7f1e74d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:52.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:52.378+0000 7f1e74d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:53.076 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 74 16 4617 4601 3.88557 0.539062 0.118625 0.257148 2024-09-16T07:52:54.076 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 75 16 4832 4816 4.01291 13.4375 0.0297154 0.249066 2024-09-16T07:52:54.677 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:54.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:54.825+0000 7fb98b511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:54.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:54.836+0000 7fb98b511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:55.076 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 76 16 5036 5020 4.12786 12.75 0.0975596 0.242135 2024-09-16T07:52:56.076 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 77 16 5242 5226 4.24144 12.875 0.0735688 0.23562 2024-09-16T07:52:57.065 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 2, 1, 0] 2024-09-16T07:52:57.066 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:52:57.066 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:57.076 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 78 16 5462 5446 4.36333 13.75 0.0755143 0.229084 2024-09-16T07:52:57.221 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:57.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:57.232+0000 7faa7a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:57.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:57.246+0000 7faa7a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:57.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:57.373+0000 7fe589d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:57.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:57.388+0000 7fe588b2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:57.545 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:52:57.546 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:52:57.560 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-16T07:52:56.390501+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":152633896,"num_objects":2324,"num_object_clones":0,"num_object_copies":6972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2400,"num_write_kb":149587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":655360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2375,"ondisk_log_size":2375,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":186072,"kb_used_data":36820,"kb_used_omap":0,"kb_used_meta":149184,"kb_avail":377301288,"statfs":{"total":386547056640,"available":386356518912,"internally_reserved":0,"allocated":37703680,"data_stored":562635278,"data_compressed":26673443,"data_compressed_allocated":35115008,"data_compressed_original":561594368,"omap_allocated":0,"internal_metadata":152764416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001092"},"pg_stats":[{"pgid":"5.f","version":"78'266","reported_seq":314,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-16T07:52:35.297311+0000","last_change":"2024-09-16T07:52:31.483172+0000","last_active":"2024-09-16T07:52:35.297311+0000","last_peered":"2024-09-16T07:52:35.297311+0000","last_clean":"2024-09-16T07:52:35.297311+0000","last_became_active":"2024-09-16T07:52:31.238947+0000","last_became_peered":"2024-09-16T07:52:31.238947+0000","last_unstale":"2024-09-16T07:52:35.297311+0000","last_undegraded":"2024-09-16T07:52:35.297311+0000","last_fullsized":"2024-09-16T07:52:35.297311+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003910+0000","last_change":"2024-09-16T07:51:38.176497+0000","last_active":"2024-09-16T07:51:53.003910+0000","last_peered":"2024-09-16T07:51:53.003910+0000","last_clean":"2024-09-16T07:51:53.003910+0000","last_became_active":"2024-09-16T07:51:38.159939+0000","last_became_peered":"2024-09-16T07:51:38.159939+0000","last_unstale":"2024-09-16T07:52:29.000746+0000","last_undegraded":"2024-09-16T07:51:53.003910+0000","last_fullsized":"2024-09-16T07:51:53.003910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001960+0000","last_change":"2024-09-16T07:51:38.115751+0000","last_active":"2024-09-16T07:51:53.001960+0000","last_peered":"2024-09-16T07:51:53.001960+0000","last_clean":"2024-09-16T07:51:53.001960+0000","last_became_active":"2024-09-16T07:51:38.099152+0000","last_became_peered":"2024-09-16T07:51:38.099152+0000","last_unstale":"2024-09-16T07:52:29.000748+0000","last_undegraded":"2024-09-16T07:51:53.001960+0000","last_fullsized":"2024-09-16T07:51:53.001960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"78'287","reported_seq":336,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-16T07:52:34.106776+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:52:34.106776+0000","last_peered":"2024-09-16T07:52:34.106776+0000","last_clean":"2024-09-16T07:52:34.106776+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:52:34.106776+0000","last_undegraded":"2024-09-16T07:52:34.106776+0000","last_fullsized":"2024-09-16T07:52:34.106776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.004830+0000","last_change":"2024-09-16T07:51:38.154961+0000","last_active":"2024-09-16T07:51:53.004830+0000","last_peered":"2024-09-16T07:51:53.004830+0000","last_clean":"2024-09-16T07:51:53.004830+0000","last_became_active":"2024-09-16T07:51:38.134473+0000","last_became_peered":"2024-09-16T07:51:38.134473+0000","last_unstale":"2024-09-16T07:52:29.000749+0000","last_undegraded":"2024-09-16T07:51:53.004830+0000","last_fullsized":"2024-09-16T07:51:53.004830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"78'253","reported_seq":296,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-16T07:52:35.602105+0000","last_change":"2024-09-16T07:52:31.240354+0000","last_active":"2024-09-16T07:52:35.602105+0000","last_peered":"2024-09-16T07:52:35.602105+0000","last_clean":"2024-09-16T07:52:35.602105+0000","last_became_active":"2024-09-16T07:52:31.214842+0000","last_became_peered":"2024-09-16T07:52:31.214842+0000","last_unstale":"2024-09-16T07:52:35.602105+0000","last_undegraded":"2024-09-16T07:52:35.602105+0000","last_fullsized":"2024-09-16T07:52:35.602105+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16580608,"num_objects":253,"num_object_clones":0,"num_object_copies":759,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":16192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"74'208","reported_seq":226,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:52:15.686316+0000","last_change":"2024-09-16T07:51:59.194741+0000","last_active":"2024-09-16T07:52:15.686316+0000","last_peered":"2024-09-16T07:52:15.686316+0000","last_clean":"2024-09-16T07:52:15.686316+0000","last_became_active":"2024-09-16T07:51:59.185751+0000","last_became_peered":"2024-09-16T07:51:59.185751+0000","last_unstale":"2024-09-16T07:52:15.686316+0000","last_undegraded":"2024-09-16T07:52:15.686316+0000","last_fullsized":"2024-09-16T07:52:15.686316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001102+0000","last_change":"2024-09-16T07:51:38.169785+0000","last_active":"2024-09-16T07:51:53.001102+0000","last_peered":"2024-09-16T07:51:53.001102+0000","last_clean":"2024-09-16T07:51:53.001102+0000","last_became_active":"2024-09-16T07:51:38.149919+0000","last_became_peered":"2024-09-16T07:51:38.149919+0000","last_unstale":"2024-09-16T07:52:29.000752+0000","last_undegraded":"2024-09-16T07:51:53.001102+0000","last_fullsized":"2024-09-16T07:51:53.001102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"78'268","reported_seq":318,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-16T07:52:35.797372+0000","last_change":"2024-09-16T07:52:31.201289+0000","last_active":"2024-09-16T07:52:35.797372+0000","last_peered":"2024-09-16T07:52:35.797372+0000","last_clean":"2024-09-16T07:52:35.797372+0000","last_became_active":"2024-09-16T07:52:31.189040+0000","last_became_peered":"2024-09-16T07:52:31.189040+0000","last_unstale":"2024-09-16T07:52:35.797372+0000","last_undegraded":"2024-09-16T07:52:35.797372+0000","last_fullsized":"2024-09-16T07:52:35.797372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":17152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":244,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-16T07:52:33.034178+0000","last_change":"2024-09-16T07:52:31.268674+0000","last_active":"2024-09-16T07:52:33.034178+0000","last_peered":"2024-09-16T07:52:33.034178+0000","last_clean":"2024-09-16T07:52:33.034178+0000","last_became_active":"2024-09-16T07:52:31.258703+0000","last_became_peered":"2024-09-16T07:52:31.258703+0000","last_unstale":"2024-09-16T07:52:33.034178+0000","last_undegraded":"2024-09-16T07:52:33.034178+0000","last_fullsized":"2024-09-16T07:52:33.034178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":173,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:51:59.220098+0000","last_change":"2024-09-16T07:51:59.222174+0000","last_active":"2024-09-16T07:51:59.220098+0000","last_peered":"2024-09-16T07:51:59.220098+0000","last_clean":"2024-09-16T07:51:27.480140+0000","last_became_active":"2024-09-16T07:51:59.210437+0000","last_became_peered":"2024-09-16T07:51:59.210437+0000","last_unstale":"2024-09-16T07:51:59.220098+0000","last_undegraded":"2024-09-16T07:51:59.220098+0000","last_fullsized":"2024-09-16T07:51:59.220098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.000096+0000","last_change":"2024-09-16T07:51:38.120872+0000","last_active":"2024-09-16T07:51:53.000096+0000","last_peered":"2024-09-16T07:51:53.000096+0000","last_clean":"2024-09-16T07:51:53.000096+0000","last_became_active":"2024-09-16T07:51:38.110191+0000","last_became_peered":"2024-09-16T07:51:38.110191+0000","last_unstale":"2024-09-16T07:52:29.000762+0000","last_undegraded":"2024-09-16T07:51:53.000096+0000","last_fullsized":"2024-09-16T07:51:53.000096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002784+0000","last_change":"2024-09-16T07:51:28.108718+0000","last_active":"2024-09-16T07:51:53.002784+0000","last_peered":"2024-09-16T07:51:53.002784+0000","last_clean":"2024-09-16T07:51:53.002784+0000","last_became_active":"2024-09-16T07:51:27.518387+0000","last_became_peered":"2024-09-16T07:51:27.518387+0000","last_unstale":"2024-09-16T07:52:29.000764+0000","last_undegraded":"2024-09-16T07:51:53.002784+0000","last_fullsized":"2024-09-16T07:51:53.002784+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"78'239","reported_seq":287,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-16T07:52:35.680326+0000","last_change":"2024-09-16T07:52:31.450902+0000","last_active":"2024-09-16T07:52:35.680326+0000","last_peered":"2024-09-16T07:52:35.680326+0000","last_clean":"2024-09-16T07:52:35.680326+0000","last_became_active":"2024-09-16T07:52:31.224086+0000","last_became_peered":"2024-09-16T07:52:31.224086+0000","last_unstale":"2024-09-16T07:52:35.680326+0000","last_undegraded":"2024-09-16T07:52:35.680326+0000","last_fullsized":"2024-09-16T07:52:35.680326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":15296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:51:59.145534+0000","last_change":"2024-09-16T07:51:59.146674+0000","last_active":"2024-09-16T07:51:59.145534+0000","last_peered":"2024-09-16T07:51:59.145534+0000","last_clean":"2024-09-16T07:51:07.574851+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:51:59.145534+0000","last_undegraded":"2024-09-16T07:51:59.145534+0000","last_fullsized":"2024-09-16T07:51:59.145534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"78'250","reported_seq":293,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-16T07:52:35.733514+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:52:35.733514+0000","last_peered":"2024-09-16T07:52:35.733514+0000","last_clean":"2024-09-16T07:52:35.733514+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:52:35.733514+0000","last_undegraded":"2024-09-16T07:52:35.733514+0000","last_fullsized":"2024-09-16T07:52:35.733514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384000,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":250,"num_write_kb":16000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:52.995846+0000","last_change":"2024-09-16T07:51:28.114509+0000","last_active":"2024-09-16T07:51:52.995846+0000","last_peered":"2024-09-16T07:51:52.995846+0000","last_clean":"2024-09-16T07:51:52.995846+0000","last_became_active":"2024-09-16T07:51:27.459621+0000","last_became_peered":"2024-09-16T07:51:27.459621+0000","last_unstale":"2024-09-16T07:52:29.000766+0000","last_undegraded":"2024-09-16T07:51:52.995846+0000","last_fullsized":"2024-09-16T07:51:52.995846+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"78'264","reported_seq":317,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-16T07:52:35.641694+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:52:35.641694+0000","last_peered":"2024-09-16T07:52:35.641694+0000","last_clean":"2024-09-16T07:52:35.641694+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:52:35.641694+0000","last_undegraded":"2024-09-16T07:52:35.641694+0000","last_fullsized":"2024-09-16T07:52:35.641694+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17301504,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":16896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":192,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-16T07:52:33.057763+0000","last_change":"2024-09-16T07:52:33.061550+0000","last_active":"2024-09-16T07:52:33.057763+0000","last_peered":"2024-09-16T07:52:33.057763+0000","last_clean":"2024-09-16T07:52:33.057763+0000","last_became_active":"2024-09-16T07:52:31.230664+0000","last_became_peered":"2024-09-16T07:52:31.230664+0000","last_unstale":"2024-09-16T07:52:33.057763+0000","last_undegraded":"2024-09-16T07:52:33.057763+0000","last_fullsized":"2024-09-16T07:52:33.057763+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"68'2","reported_seq":23,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003297+0000","last_change":"2024-09-16T07:51:38.164960+0000","last_active":"2024-09-16T07:51:53.003297+0000","last_peered":"2024-09-16T07:51:53.003297+0000","last_clean":"2024-09-16T07:51:53.003297+0000","last_became_active":"2024-09-16T07:51:38.140920+0000","last_became_peered":"2024-09-16T07:51:38.140920+0000","last_unstale":"2024-09-16T07:52:29.000774+0000","last_undegraded":"2024-09-16T07:51:53.003297+0000","last_fullsized":"2024-09-16T07:51:53.003297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":176,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-16T07:52:33.035071+0000","last_change":"2024-09-16T07:52:33.043351+0000","last_active":"2024-09-16T07:52:33.035071+0000","last_peered":"2024-09-16T07:52:33.035071+0000","last_clean":"2024-09-16T07:52:33.035071+0000","last_became_active":"2024-09-16T07:52:31.199412+0000","last_became_peered":"2024-09-16T07:52:31.199412+0000","last_unstale":"2024-09-16T07:52:33.035071+0000","last_undegraded":"2024-09-16T07:52:33.035071+0000","last_fullsized":"2024-09-16T07:52:33.035071+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"78'274","reported_seq":317,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-16T07:52:33.858354+0000","last_change":"2024-09-16T07:52:31.206205+0000","last_active":"2024-09-16T07:52:33.858354+0000","last_peered":"2024-09-16T07:52:33.858354+0000","last_clean":"2024-09-16T07:52:33.858354+0000","last_became_active":"2024-09-16T07:52:31.198740+0000","last_became_peered":"2024-09-16T07:52:31.198740+0000","last_unstale":"2024-09-16T07:52:33.858354+0000","last_undegraded":"2024-09-16T07:52:33.858354+0000","last_fullsized":"2024-09-16T07:52:33.858354+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17956864,"num_objects":274,"num_object_clones":0,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":274,"num_write_kb":17536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":192,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-16T07:52:33.047997+0000","last_change":"2024-09-16T07:52:33.057688+0000","last_active":"2024-09-16T07:52:33.047997+0000","last_peered":"2024-09-16T07:52:33.047997+0000","last_clean":"2024-09-16T07:52:33.047997+0000","last_became_active":"2024-09-16T07:52:31.223242+0000","last_became_peered":"2024-09-16T07:52:31.223242+0000","last_unstale":"2024-09-16T07:52:33.047997+0000","last_undegraded":"2024-09-16T07:52:33.047997+0000","last_fullsized":"2024-09-16T07:52:33.047997+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002351+0000","last_change":"2024-09-16T07:51:38.145559+0000","last_active":"2024-09-16T07:51:53.002351+0000","last_peered":"2024-09-16T07:51:53.002351+0000","last_clean":"2024-09-16T07:51:53.002351+0000","last_became_active":"2024-09-16T07:51:38.123189+0000","last_became_peered":"2024-09-16T07:51:38.123189+0000","last_unstale":"2024-09-16T07:52:29.000775+0000","last_undegraded":"2024-09-16T07:51:53.002351+0000","last_fullsized":"2024-09-16T07:51:53.002351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":172,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-16T07:51:59.199474+0000","last_change":"2024-09-16T07:51:59.200715+0000","last_active":"2024-09-16T07:51:59.199474+0000","last_peered":"2024-09-16T07:51:59.199474+0000","last_clean":"2024-09-16T07:51:27.464440+0000","last_became_active":"2024-09-16T07:51:59.189481+0000","last_became_peered":"2024-09-16T07:51:59.189481+0000","last_unstale":"2024-09-16T07:51:59.199474+0000","last_undegraded":"2024-09-16T07:51:59.199474+0000","last_fullsized":"2024-09-16T07:51:59.199474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":152043520,"num_objects":2320,"num_object_clones":0,"num_object_copies":6960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2320,"num_write_kb":148480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":655360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":35602432,"data_stored":569638912,"data_compressed":27047008,"data_compressed_allocated":35602432,"data_compressed_original":569638912,"omap_allocated":0,"internal_metadata":0},"log_size":2320,"ondisk_log_size":2320,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201399,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44412,"kb_used_data":11372,"kb_used_omap":0,"kb_used_meta":33024,"kb_avail":94327428,"statfs":{"total":96636764160,"available":96591286272,"internally_reserved":0,"allocated":11644928,"data_stored":175763273,"data_compressed":8335188,"data_compressed_allocated":10973184,"data_compressed_original":175489024,"omap_allocated":0,"internal_metadata":33816576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56768,"kb_used_data":15596,"kb_used_omap":0,"kb_used_meta":41152,"kb_avail":94315072,"statfs":{"total":96636764160,"available":96578633728,"internally_reserved":0,"allocated":15970304,"data_stored":244903772,"data_compressed":11618147,"data_compressed_allocated":15294464,"data_compressed_original":244629504,"omap_allocated":0,"internal_metadata":42139648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41208,"kb_used_data":9128,"kb_used_omap":0,"kb_used_meta":32064,"kb_avail":94330632,"statfs":{"total":96636764160,"available":96594567168,"internally_reserved":0,"allocated":9347072,"data_stored":139834776,"data_compressed":6627875,"data_compressed_allocated":8724480,"data_compressed_original":139591680,"omap_allocated":0,"internal_metadata":32833536},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":62,"seq":266287972382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43684,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94328156,"statfs":{"total":96636764160,"available":96592031744,"internally_reserved":0,"allocated":741376,"data_stored":2133457,"data_compressed":92233,"data_compressed_allocated":122880,"data_compressed_original":1884160,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":1310720,"data_compressed":62192,"data_compressed_allocated":81920,"data_compressed_original":1310720,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8724480,"data_stored":139591680,"data_compressed":6627875,"data_compressed_allocated":8724480,"data_compressed_original":139591680,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15400960,"data_stored":246415360,"data_compressed":11700138,"data_compressed_allocated":15400960,"data_compressed_original":246415360,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11395072,"data_stored":182321152,"data_compressed":8656803,"data_compressed_allocated":11395072,"data_compressed_original":182321152,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:58.076 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 79 16 5661 5645 4.46551 12.4375 0.0528208 0.22381 2024-09-16T07:52:59.077 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:52:59.078912+0000 min lat: 0.0153521 max lat: 20.3424 avg lat: 0.218036 2024-09-16T07:52:59.077 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:52:59.077 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 80 16 5884 5868 4.5839 13.9375 0.0588663 0.218036 2024-09-16T07:52:59.793 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:59.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:59.953+0000 7f7e0c951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:59.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:52:59.964+0000 7f7e0c951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:00.077 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 81 16 6094 6078 4.68932 13.125 0.0340649 0.213122 2024-09-16T07:53:01.077 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 82 16 6295 6279 4.78532 12.5625 0.0723972 0.208878 2024-09-16T07:53:02.077 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 83 16 6500 6484 4.88202 12.8125 0.0927148 0.204724 2024-09-16T07:53:02.377 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:02.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:02.539+0000 7f28b4b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:02.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:02.550+0000 7f28b4b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:02.566 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 2, 1, 0] 2024-09-16T07:53:02.566 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:53:02.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:02.719+0000 7fd94a948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:02.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:02.738+0000 7fd94a948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:03.077 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 84 16 6695 6679 4.96898 12.1875 0.0662015 0.201158 2024-09-16T07:53:04.009 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:53:04.030 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:53:04.077 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 85 16 6889 6873 5.05315 12.125 0.0608684 0.197782 2024-09-16T07:53:04.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:04.201+0000 7f31a6791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:04.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:04.218+0000 7f31a6791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:04.990 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:05.018 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:53:05.046 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:53:05.077 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 86 16 7096 7080 5.14481 12.9375 0.108988 0.194272 2024-09-16T07:53:05.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:05.152+0000 7ff80df51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:05.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:05.163+0000 7ff80df51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:05.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:05.254+0000 7f7b41a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:05.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:05.270+0000 7f7b41a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:06.024 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:53:06.045 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:53:06.077 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 87 16 7287 7271 5.22288 11.9375 0.0513247 0.191345 2024-09-16T07:53:06.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:06.197+0000 7f6d08b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:06.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:06.213+0000 7f6d08b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:07.035 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:53:07.059 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:53:07.059 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:07.077 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 88 16 7476 7460 5.29775 11.8125 0.043706 0.18863 2024-09-16T07:53:07.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:07.239+0000 7fc3ae391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:07.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:07.255+0000 7fc3ae391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:07.455 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:07.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:07.519 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:53:07.540 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-09-16T07:53:07.037956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":255197736,"num_objects":3889,"num_object_clones":0,"num_object_copies":11667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3965,"num_write_kb":249747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3940,"ondisk_log_size":3940,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":217800,"kb_used_data":60232,"kb_used_omap":0,"kb_used_meta":157504,"kb_avail":377269560,"statfs":{"total":386547056640,"available":386324029440,"internally_reserved":0,"allocated":61677568,"data_stored":943921712,"data_compressed":44775947,"data_compressed_allocated":58941440,"data_compressed_original":942817280,"omap_allocated":0,"internal_metadata":161284096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":93847552,"num_objects":1432,"num_object_clones":0,"num_object_copies":4296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1432,"num_write_kb":91648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.646155"},"pg_stats":[{"pgid":"5.f","version":"84'451","reported_seq":518,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.443382+0000","last_change":"2024-09-16T07:52:52.214675+0000","last_active":"2024-09-16T07:53:05.443382+0000","last_peered":"2024-09-16T07:53:05.443382+0000","last_clean":"2024-09-16T07:53:05.443382+0000","last_became_active":"2024-09-16T07:52:52.199189+0000","last_became_peered":"2024-09-16T07:52:52.199189+0000","last_unstale":"2024-09-16T07:53:05.443382+0000","last_undegraded":"2024-09-16T07:53:05.443382+0000","last_fullsized":"2024-09-16T07:53:05.443382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003910+0000","last_change":"2024-09-16T07:51:38.176497+0000","last_active":"2024-09-16T07:51:53.003910+0000","last_peered":"2024-09-16T07:51:53.003910+0000","last_clean":"2024-09-16T07:51:53.003910+0000","last_became_active":"2024-09-16T07:51:38.159939+0000","last_became_peered":"2024-09-16T07:51:38.159939+0000","last_unstale":"2024-09-16T07:52:29.000746+0000","last_undegraded":"2024-09-16T07:51:53.003910+0000","last_fullsized":"2024-09-16T07:51:53.003910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001960+0000","last_change":"2024-09-16T07:51:38.115751+0000","last_active":"2024-09-16T07:51:53.001960+0000","last_peered":"2024-09-16T07:51:53.001960+0000","last_clean":"2024-09-16T07:51:53.001960+0000","last_became_active":"2024-09-16T07:51:38.099152+0000","last_became_peered":"2024-09-16T07:51:38.099152+0000","last_unstale":"2024-09-16T07:52:29.000748+0000","last_undegraded":"2024-09-16T07:51:53.001960+0000","last_fullsized":"2024-09-16T07:51:53.001960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"83'461","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.278875+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:04.278875+0000","last_peered":"2024-09-16T07:53:04.278875+0000","last_clean":"2024-09-16T07:53:04.278875+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:53:04.278875+0000","last_undegraded":"2024-09-16T07:53:04.278875+0000","last_fullsized":"2024-09-16T07:53:04.278875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.004830+0000","last_change":"2024-09-16T07:51:38.154961+0000","last_active":"2024-09-16T07:51:53.004830+0000","last_peered":"2024-09-16T07:51:53.004830+0000","last_clean":"2024-09-16T07:51:53.004830+0000","last_became_active":"2024-09-16T07:51:38.134473+0000","last_became_peered":"2024-09-16T07:51:38.134473+0000","last_unstale":"2024-09-16T07:52:29.000749+0000","last_undegraded":"2024-09-16T07:51:53.004830+0000","last_fullsized":"2024-09-16T07:51:53.004830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"84'454","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.775210+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:05.775210+0000","last_peered":"2024-09-16T07:53:05.775210+0000","last_clean":"2024-09-16T07:53:05.775210+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:05.775210+0000","last_undegraded":"2024-09-16T07:53:05.775210+0000","last_fullsized":"2024-09-16T07:53:05.775210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":29056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"82'341","reported_seq":395,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:56.948374+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:52:56.948374+0000","last_peered":"2024-09-16T07:52:56.948374+0000","last_clean":"2024-09-16T07:52:56.948374+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:52:56.948374+0000","last_undegraded":"2024-09-16T07:52:56.948374+0000","last_fullsized":"2024-09-16T07:52:56.948374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001102+0000","last_change":"2024-09-16T07:51:38.169785+0000","last_active":"2024-09-16T07:51:53.001102+0000","last_peered":"2024-09-16T07:51:53.001102+0000","last_clean":"2024-09-16T07:51:53.001102+0000","last_became_active":"2024-09-16T07:51:38.149919+0000","last_became_peered":"2024-09-16T07:51:38.149919+0000","last_unstale":"2024-09-16T07:52:29.000752+0000","last_undegraded":"2024-09-16T07:51:53.001102+0000","last_fullsized":"2024-09-16T07:51:53.001102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"84'472","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.769668+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:53:05.769668+0000","last_peered":"2024-09-16T07:53:05.769668+0000","last_clean":"2024-09-16T07:53:05.769668+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:53:05.769668+0000","last_undegraded":"2024-09-16T07:53:05.769668+0000","last_fullsized":"2024-09-16T07:53:05.769668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.031381+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:04.031381+0000","last_peered":"2024-09-16T07:53:04.031381+0000","last_clean":"2024-09-16T07:53:04.031381+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:53:04.031381+0000","last_undegraded":"2024-09-16T07:53:04.031381+0000","last_fullsized":"2024-09-16T07:53:04.031381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":201,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.026027+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:52:53.026027+0000","last_peered":"2024-09-16T07:52:53.026027+0000","last_clean":"2024-09-16T07:52:53.026027+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:52:53.026027+0000","last_undegraded":"2024-09-16T07:52:53.026027+0000","last_fullsized":"2024-09-16T07:52:53.026027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.000096+0000","last_change":"2024-09-16T07:51:38.120872+0000","last_active":"2024-09-16T07:51:53.000096+0000","last_peered":"2024-09-16T07:51:53.000096+0000","last_clean":"2024-09-16T07:51:53.000096+0000","last_became_active":"2024-09-16T07:51:38.110191+0000","last_became_peered":"2024-09-16T07:51:38.110191+0000","last_unstale":"2024-09-16T07:52:29.000762+0000","last_undegraded":"2024-09-16T07:51:53.000096+0000","last_fullsized":"2024-09-16T07:51:53.000096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002784+0000","last_change":"2024-09-16T07:51:28.108718+0000","last_active":"2024-09-16T07:51:53.002784+0000","last_peered":"2024-09-16T07:51:53.002784+0000","last_clean":"2024-09-16T07:51:53.002784+0000","last_became_active":"2024-09-16T07:51:27.518387+0000","last_became_peered":"2024-09-16T07:51:27.518387+0000","last_unstale":"2024-09-16T07:52:29.000764+0000","last_undegraded":"2024-09-16T07:51:53.002784+0000","last_fullsized":"2024-09-16T07:51:53.002784+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"84'412","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.580277+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:05.580277+0000","last_peered":"2024-09-16T07:53:05.580277+0000","last_clean":"2024-09-16T07:53:05.580277+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:05.580277+0000","last_undegraded":"2024-09-16T07:53:05.580277+0000","last_fullsized":"2024-09-16T07:53:05.580277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":188,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.022681+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:52:53.022681+0000","last_peered":"2024-09-16T07:52:53.022681+0000","last_clean":"2024-09-16T07:52:53.022681+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:52:53.022681+0000","last_undegraded":"2024-09-16T07:52:53.022681+0000","last_fullsized":"2024-09-16T07:52:53.022681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"84'421","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.684454+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:53:05.684454+0000","last_peered":"2024-09-16T07:53:05.684454+0000","last_clean":"2024-09-16T07:53:05.684454+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:53:05.684454+0000","last_undegraded":"2024-09-16T07:53:05.684454+0000","last_fullsized":"2024-09-16T07:53:05.684454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:52.995846+0000","last_change":"2024-09-16T07:51:28.114509+0000","last_active":"2024-09-16T07:51:52.995846+0000","last_peered":"2024-09-16T07:51:52.995846+0000","last_clean":"2024-09-16T07:51:52.995846+0000","last_became_active":"2024-09-16T07:51:27.459621+0000","last_became_peered":"2024-09-16T07:51:27.459621+0000","last_unstale":"2024-09-16T07:52:29.000766+0000","last_undegraded":"2024-09-16T07:51:52.995846+0000","last_fullsized":"2024-09-16T07:51:52.995846+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"84'427","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.730196+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:53:05.730196+0000","last_peered":"2024-09-16T07:53:05.730196+0000","last_clean":"2024-09-16T07:53:05.730196+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:53:05.730196+0000","last_undegraded":"2024-09-16T07:53:05.730196+0000","last_fullsized":"2024-09-16T07:53:05.730196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.066207+0000","last_change":"2024-09-16T07:52:53.041802+0000","last_active":"2024-09-16T07:53:05.066207+0000","last_peered":"2024-09-16T07:53:05.066207+0000","last_clean":"2024-09-16T07:53:05.066207+0000","last_became_active":"2024-09-16T07:52:52.207206+0000","last_became_peered":"2024-09-16T07:52:52.207206+0000","last_unstale":"2024-09-16T07:53:05.066207+0000","last_undegraded":"2024-09-16T07:53:05.066207+0000","last_fullsized":"2024-09-16T07:53:05.066207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"68'2","reported_seq":23,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003297+0000","last_change":"2024-09-16T07:51:38.164960+0000","last_active":"2024-09-16T07:51:53.003297+0000","last_peered":"2024-09-16T07:51:53.003297+0000","last_clean":"2024-09-16T07:51:53.003297+0000","last_became_active":"2024-09-16T07:51:38.140920+0000","last_became_peered":"2024-09-16T07:51:38.140920+0000","last_unstale":"2024-09-16T07:52:29.000774+0000","last_undegraded":"2024-09-16T07:51:53.003297+0000","last_fullsized":"2024-09-16T07:51:53.003297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.032992+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:04.032992+0000","last_peered":"2024-09-16T07:53:04.032992+0000","last_clean":"2024-09-16T07:53:04.032992+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:53:04.032992+0000","last_undegraded":"2024-09-16T07:53:04.032992+0000","last_fullsized":"2024-09-16T07:53:04.032992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"83'435","reported_seq":494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.197911+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:04.197911+0000","last_peered":"2024-09-16T07:53:04.197911+0000","last_clean":"2024-09-16T07:53:04.197911+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:53:04.197911+0000","last_undegraded":"2024-09-16T07:53:04.197911+0000","last_fullsized":"2024-09-16T07:53:04.197911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.058500+0000","last_change":"2024-09-16T07:52:53.038857+0000","last_active":"2024-09-16T07:53:05.058500+0000","last_peered":"2024-09-16T07:53:05.058500+0000","last_clean":"2024-09-16T07:53:05.058500+0000","last_became_active":"2024-09-16T07:52:52.148242+0000","last_became_peered":"2024-09-16T07:52:52.148242+0000","last_unstale":"2024-09-16T07:53:05.058500+0000","last_undegraded":"2024-09-16T07:53:05.058500+0000","last_fullsized":"2024-09-16T07:53:05.058500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002351+0000","last_change":"2024-09-16T07:51:38.145559+0000","last_active":"2024-09-16T07:51:53.002351+0000","last_peered":"2024-09-16T07:51:53.002351+0000","last_clean":"2024-09-16T07:51:53.002351+0000","last_became_active":"2024-09-16T07:51:38.123189+0000","last_became_peered":"2024-09-16T07:51:38.123189+0000","last_unstale":"2024-09-16T07:52:29.000775+0000","last_undegraded":"2024-09-16T07:51:53.002351+0000","last_fullsized":"2024-09-16T07:51:53.002351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.019915+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:52:53.019915+0000","last_peered":"2024-09-16T07:52:53.019915+0000","last_clean":"2024-09-16T07:52:53.019915+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:52:53.019915+0000","last_undegraded":"2024-09-16T07:52:53.019915+0000","last_fullsized":"2024-09-16T07:52:53.019915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":254607360,"num_objects":3885,"num_object_clones":0,"num_object_copies":11655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3885,"num_write_kb":248640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59322368,"data_stored":949157888,"data_compressed":45068600,"data_compressed_allocated":59322368,"data_compressed_original":949157888,"omap_allocated":0,"internal_metadata":0},"log_size":3885,"ondisk_log_size":3885,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60688,"kb_used_data":19328,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94311152,"statfs":{"total":96636764160,"available":96574619648,"internally_reserved":0,"allocated":19791872,"data_stored":305604333,"data_compressed":14500060,"data_compressed_allocated":19087360,"data_compressed_original":305315840,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62840,"kb_used_data":25832,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94309000,"statfs":{"total":96636764160,"available":96572416000,"internally_reserved":0,"allocated":26451968,"data_stored":411844754,"data_compressed":19544411,"data_compressed_allocated":25726976,"data_compressed_original":411549696,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50588,"kb_used_data":14348,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94321252,"statfs":{"total":96636764160,"available":96584962048,"internally_reserved":0,"allocated":14692352,"data_stored":224339168,"data_compressed":10639243,"data_compressed_allocated":14004224,"data_compressed_original":224067584,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":62,"seq":266287972382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43684,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94328156,"statfs":{"total":96636764160,"available":96592031744,"internally_reserved":0,"allocated":741376,"data_stored":2133457,"data_compressed":92233,"data_compressed_allocated":122880,"data_compressed_original":1884160,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":1310720,"data_compressed":62192,"data_compressed_allocated":81920,"data_compressed_original":1310720,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14024704,"data_stored":224395264,"data_compressed":10654803,"data_compressed_allocated":14024704,"data_compressed_original":224395264,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25759744,"data_stored":412155904,"data_compressed":19570386,"data_compressed_allocated":25759744,"data_compressed_original":412155904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":311296000,"data_compressed":14781219,"data_compressed_allocated":19456000,"data_compressed_original":311296000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:07.542 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:07.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:07.632+0000 7fb10c4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:07.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:07.644+0000 7fb10c4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:07.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:07.707+0000 7f5e37c4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:07.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:07.721+0000 7f5e37c4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:08.011 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:08.012 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:53:08.037 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-09-16T07:53:07.037956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":255197736,"num_objects":3889,"num_object_clones":0,"num_object_copies":11667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3965,"num_write_kb":249747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3940,"ondisk_log_size":3940,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":217800,"kb_used_data":60232,"kb_used_omap":0,"kb_used_meta":157504,"kb_avail":377269560,"statfs":{"total":386547056640,"available":386324029440,"internally_reserved":0,"allocated":61677568,"data_stored":943921712,"data_compressed":44775947,"data_compressed_allocated":58941440,"data_compressed_original":942817280,"omap_allocated":0,"internal_metadata":161284096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":93847552,"num_objects":1432,"num_object_clones":0,"num_object_copies":4296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1432,"num_write_kb":91648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.646155"},"pg_stats":[{"pgid":"5.f","version":"84'451","reported_seq":518,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.443382+0000","last_change":"2024-09-16T07:52:52.214675+0000","last_active":"2024-09-16T07:53:05.443382+0000","last_peered":"2024-09-16T07:53:05.443382+0000","last_clean":"2024-09-16T07:53:05.443382+0000","last_became_active":"2024-09-16T07:52:52.199189+0000","last_became_peered":"2024-09-16T07:52:52.199189+0000","last_unstale":"2024-09-16T07:53:05.443382+0000","last_undegraded":"2024-09-16T07:53:05.443382+0000","last_fullsized":"2024-09-16T07:53:05.443382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003910+0000","last_change":"2024-09-16T07:51:38.176497+0000","last_active":"2024-09-16T07:51:53.003910+0000","last_peered":"2024-09-16T07:51:53.003910+0000","last_clean":"2024-09-16T07:51:53.003910+0000","last_became_active":"2024-09-16T07:51:38.159939+0000","last_became_peered":"2024-09-16T07:51:38.159939+0000","last_unstale":"2024-09-16T07:52:29.000746+0000","last_undegraded":"2024-09-16T07:51:53.003910+0000","last_fullsized":"2024-09-16T07:51:53.003910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001960+0000","last_change":"2024-09-16T07:51:38.115751+0000","last_active":"2024-09-16T07:51:53.001960+0000","last_peered":"2024-09-16T07:51:53.001960+0000","last_clean":"2024-09-16T07:51:53.001960+0000","last_became_active":"2024-09-16T07:51:38.099152+0000","last_became_peered":"2024-09-16T07:51:38.099152+0000","last_unstale":"2024-09-16T07:52:29.000748+0000","last_undegraded":"2024-09-16T07:51:53.001960+0000","last_fullsized":"2024-09-16T07:51:53.001960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"83'461","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.278875+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:04.278875+0000","last_peered":"2024-09-16T07:53:04.278875+0000","last_clean":"2024-09-16T07:53:04.278875+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:53:04.278875+0000","last_undegraded":"2024-09-16T07:53:04.278875+0000","last_fullsized":"2024-09-16T07:53:04.278875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.004830+0000","last_change":"2024-09-16T07:51:38.154961+0000","last_active":"2024-09-16T07:51:53.004830+0000","last_peered":"2024-09-16T07:51:53.004830+0000","last_clean":"2024-09-16T07:51:53.004830+0000","last_became_active":"2024-09-16T07:51:38.134473+0000","last_became_peered":"2024-09-16T07:51:38.134473+0000","last_unstale":"2024-09-16T07:52:29.000749+0000","last_undegraded":"2024-09-16T07:51:53.004830+0000","last_fullsized":"2024-09-16T07:51:53.004830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"84'454","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.775210+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:05.775210+0000","last_peered":"2024-09-16T07:53:05.775210+0000","last_clean":"2024-09-16T07:53:05.775210+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:05.775210+0000","last_undegraded":"2024-09-16T07:53:05.775210+0000","last_fullsized":"2024-09-16T07:53:05.775210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":29056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"82'341","reported_seq":395,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:56.948374+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:52:56.948374+0000","last_peered":"2024-09-16T07:52:56.948374+0000","last_clean":"2024-09-16T07:52:56.948374+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:52:56.948374+0000","last_undegraded":"2024-09-16T07:52:56.948374+0000","last_fullsized":"2024-09-16T07:52:56.948374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001102+0000","last_change":"2024-09-16T07:51:38.169785+0000","last_active":"2024-09-16T07:51:53.001102+0000","last_peered":"2024-09-16T07:51:53.001102+0000","last_clean":"2024-09-16T07:51:53.001102+0000","last_became_active":"2024-09-16T07:51:38.149919+0000","last_became_peered":"2024-09-16T07:51:38.149919+0000","last_unstale":"2024-09-16T07:52:29.000752+0000","last_undegraded":"2024-09-16T07:51:53.001102+0000","last_fullsized":"2024-09-16T07:51:53.001102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"84'472","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.769668+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:53:05.769668+0000","last_peered":"2024-09-16T07:53:05.769668+0000","last_clean":"2024-09-16T07:53:05.769668+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:53:05.769668+0000","last_undegraded":"2024-09-16T07:53:05.769668+0000","last_fullsized":"2024-09-16T07:53:05.769668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.031381+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:04.031381+0000","last_peered":"2024-09-16T07:53:04.031381+0000","last_clean":"2024-09-16T07:53:04.031381+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:53:04.031381+0000","last_undegraded":"2024-09-16T07:53:04.031381+0000","last_fullsized":"2024-09-16T07:53:04.031381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":201,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.026027+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:52:53.026027+0000","last_peered":"2024-09-16T07:52:53.026027+0000","last_clean":"2024-09-16T07:52:53.026027+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:52:53.026027+0000","last_undegraded":"2024-09-16T07:52:53.026027+0000","last_fullsized":"2024-09-16T07:52:53.026027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.000096+0000","last_change":"2024-09-16T07:51:38.120872+0000","last_active":"2024-09-16T07:51:53.000096+0000","last_peered":"2024-09-16T07:51:53.000096+0000","last_clean":"2024-09-16T07:51:53.000096+0000","last_became_active":"2024-09-16T07:51:38.110191+0000","last_became_peered":"2024-09-16T07:51:38.110191+0000","last_unstale":"2024-09-16T07:52:29.000762+0000","last_undegraded":"2024-09-16T07:51:53.000096+0000","last_fullsized":"2024-09-16T07:51:53.000096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002784+0000","last_change":"2024-09-16T07:51:28.108718+0000","last_active":"2024-09-16T07:51:53.002784+0000","last_peered":"2024-09-16T07:51:53.002784+0000","last_clean":"2024-09-16T07:51:53.002784+0000","last_became_active":"2024-09-16T07:51:27.518387+0000","last_became_peered":"2024-09-16T07:51:27.518387+0000","last_unstale":"2024-09-16T07:52:29.000764+0000","last_undegraded":"2024-09-16T07:51:53.002784+0000","last_fullsized":"2024-09-16T07:51:53.002784+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"84'412","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.580277+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:05.580277+0000","last_peered":"2024-09-16T07:53:05.580277+0000","last_clean":"2024-09-16T07:53:05.580277+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:05.580277+0000","last_undegraded":"2024-09-16T07:53:05.580277+0000","last_fullsized":"2024-09-16T07:53:05.580277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":188,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.022681+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:52:53.022681+0000","last_peered":"2024-09-16T07:52:53.022681+0000","last_clean":"2024-09-16T07:52:53.022681+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:52:53.022681+0000","last_undegraded":"2024-09-16T07:52:53.022681+0000","last_fullsized":"2024-09-16T07:52:53.022681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"84'421","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.684454+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:53:05.684454+0000","last_peered":"2024-09-16T07:53:05.684454+0000","last_clean":"2024-09-16T07:53:05.684454+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:53:05.684454+0000","last_undegraded":"2024-09-16T07:53:05.684454+0000","last_fullsized":"2024-09-16T07:53:05.684454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:52.995846+0000","last_change":"2024-09-16T07:51:28.114509+0000","last_active":"2024-09-16T07:51:52.995846+0000","last_peered":"2024-09-16T07:51:52.995846+0000","last_clean":"2024-09-16T07:51:52.995846+0000","last_became_active":"2024-09-16T07:51:27.459621+0000","last_became_peered":"2024-09-16T07:51:27.459621+0000","last_unstale":"2024-09-16T07:52:29.000766+0000","last_undegraded":"2024-09-16T07:51:52.995846+0000","last_fullsized":"2024-09-16T07:51:52.995846+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"84'427","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.730196+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:53:05.730196+0000","last_peered":"2024-09-16T07:53:05.730196+0000","last_clean":"2024-09-16T07:53:05.730196+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:53:05.730196+0000","last_undegraded":"2024-09-16T07:53:05.730196+0000","last_fullsized":"2024-09-16T07:53:05.730196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.066207+0000","last_change":"2024-09-16T07:52:53.041802+0000","last_active":"2024-09-16T07:53:05.066207+0000","last_peered":"2024-09-16T07:53:05.066207+0000","last_clean":"2024-09-16T07:53:05.066207+0000","last_became_active":"2024-09-16T07:52:52.207206+0000","last_became_peered":"2024-09-16T07:52:52.207206+0000","last_unstale":"2024-09-16T07:53:05.066207+0000","last_undegraded":"2024-09-16T07:53:05.066207+0000","last_fullsized":"2024-09-16T07:53:05.066207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"68'2","reported_seq":23,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003297+0000","last_change":"2024-09-16T07:51:38.164960+0000","last_active":"2024-09-16T07:51:53.003297+0000","last_peered":"2024-09-16T07:51:53.003297+0000","last_clean":"2024-09-16T07:51:53.003297+0000","last_became_active":"2024-09-16T07:51:38.140920+0000","last_became_peered":"2024-09-16T07:51:38.140920+0000","last_unstale":"2024-09-16T07:52:29.000774+0000","last_undegraded":"2024-09-16T07:51:53.003297+0000","last_fullsized":"2024-09-16T07:51:53.003297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.032992+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:04.032992+0000","last_peered":"2024-09-16T07:53:04.032992+0000","last_clean":"2024-09-16T07:53:04.032992+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:53:04.032992+0000","last_undegraded":"2024-09-16T07:53:04.032992+0000","last_fullsized":"2024-09-16T07:53:04.032992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"83'435","reported_seq":494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.197911+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:04.197911+0000","last_peered":"2024-09-16T07:53:04.197911+0000","last_clean":"2024-09-16T07:53:04.197911+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:53:04.197911+0000","last_undegraded":"2024-09-16T07:53:04.197911+0000","last_fullsized":"2024-09-16T07:53:04.197911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.058500+0000","last_change":"2024-09-16T07:52:53.038857+0000","last_active":"2024-09-16T07:53:05.058500+0000","last_peered":"2024-09-16T07:53:05.058500+0000","last_clean":"2024-09-16T07:53:05.058500+0000","last_became_active":"2024-09-16T07:52:52.148242+0000","last_became_peered":"2024-09-16T07:52:52.148242+0000","last_unstale":"2024-09-16T07:53:05.058500+0000","last_undegraded":"2024-09-16T07:53:05.058500+0000","last_fullsized":"2024-09-16T07:53:05.058500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002351+0000","last_change":"2024-09-16T07:51:38.145559+0000","last_active":"2024-09-16T07:51:53.002351+0000","last_peered":"2024-09-16T07:51:53.002351+0000","last_clean":"2024-09-16T07:51:53.002351+0000","last_became_active":"2024-09-16T07:51:38.123189+0000","last_became_peered":"2024-09-16T07:51:38.123189+0000","last_unstale":"2024-09-16T07:52:29.000775+0000","last_undegraded":"2024-09-16T07:51:53.002351+0000","last_fullsized":"2024-09-16T07:51:53.002351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.019915+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:52:53.019915+0000","last_peered":"2024-09-16T07:52:53.019915+0000","last_clean":"2024-09-16T07:52:53.019915+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:52:53.019915+0000","last_undegraded":"2024-09-16T07:52:53.019915+0000","last_fullsized":"2024-09-16T07:52:53.019915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":254607360,"num_objects":3885,"num_object_clones":0,"num_object_copies":11655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3885,"num_write_kb":248640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59322368,"data_stored":949157888,"data_compressed":45068600,"data_compressed_allocated":59322368,"data_compressed_original":949157888,"omap_allocated":0,"internal_metadata":0},"log_size":3885,"ondisk_log_size":3885,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60688,"kb_used_data":19328,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94311152,"statfs":{"total":96636764160,"available":96574619648,"internally_reserved":0,"allocated":19791872,"data_stored":305604333,"data_compressed":14500060,"data_compressed_allocated":19087360,"data_compressed_original":305315840,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62840,"kb_used_data":25832,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94309000,"statfs":{"total":96636764160,"available":96572416000,"internally_reserved":0,"allocated":26451968,"data_stored":411844754,"data_compressed":19544411,"data_compressed_allocated":25726976,"data_compressed_original":411549696,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50588,"kb_used_data":14348,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94321252,"statfs":{"total":96636764160,"available":96584962048,"internally_reserved":0,"allocated":14692352,"data_stored":224339168,"data_compressed":10639243,"data_compressed_allocated":14004224,"data_compressed_original":224067584,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":62,"seq":266287972382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43684,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94328156,"statfs":{"total":96636764160,"available":96592031744,"internally_reserved":0,"allocated":741376,"data_stored":2133457,"data_compressed":92233,"data_compressed_allocated":122880,"data_compressed_original":1884160,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":1310720,"data_compressed":62192,"data_compressed_allocated":81920,"data_compressed_original":1310720,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14024704,"data_stored":224395264,"data_compressed":10654803,"data_compressed_allocated":14024704,"data_compressed_original":224395264,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25759744,"data_stored":412155904,"data_compressed":19570386,"data_compressed_allocated":25759744,"data_compressed_original":412155904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":311296000,"data_compressed":14781219,"data_compressed_allocated":19456000,"data_compressed_original":311296000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:08.038 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:53:08.078 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 89 16 7659 7643 5.36672 11.4375 0.0700978 0.186217 2024-09-16T07:53:08.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:08.205+0000 7f0cc1991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:08.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:08.217+0000 7f0cc1991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:08.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:08.702 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":490,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":86,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473171,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":16},{"state_name":"stale+active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":3889,"data_bytes":255197736,"bytes_used":223027200,"bytes_avail":386324029440,"bytes_total":386547056640,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":32761,"recovering_keys_per_sec":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"write_bytes_sec":15637929,"read_op_per_sec":0,"write_op_per_sec":238},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:53:08.721 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:53:08.722 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:08.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:08.889+0000 7f4aed09c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:08.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:08.904+0000 7f4aed09c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:09.078 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 90 15 7847 7832 5.43832 11.8125 0.065342 0.183771 2024-09-16T07:53:09.162 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:09.163 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:53:09.176 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-16T07:53:08.392966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":255197736,"num_objects":3889,"num_object_clones":0,"num_object_copies":11667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3965,"num_write_kb":249747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3940,"ondisk_log_size":3940,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":217800,"kb_used_data":60232,"kb_used_omap":0,"kb_used_meta":157504,"kb_avail":377269560,"statfs":{"total":386547056640,"available":386324029440,"internally_reserved":0,"allocated":61677568,"data_stored":943921712,"data_compressed":44775947,"data_compressed_allocated":58941440,"data_compressed_original":942817280,"omap_allocated":0,"internal_metadata":161284096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":93847552,"num_objects":1432,"num_object_clones":0,"num_object_copies":4296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1432,"num_write_kb":91648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.379675"},"pg_stats":[{"pgid":"5.f","version":"84'451","reported_seq":518,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.443382+0000","last_change":"2024-09-16T07:52:52.214675+0000","last_active":"2024-09-16T07:53:05.443382+0000","last_peered":"2024-09-16T07:53:05.443382+0000","last_clean":"2024-09-16T07:53:05.443382+0000","last_became_active":"2024-09-16T07:52:52.199189+0000","last_became_peered":"2024-09-16T07:52:52.199189+0000","last_unstale":"2024-09-16T07:53:05.443382+0000","last_undegraded":"2024-09-16T07:53:05.443382+0000","last_fullsized":"2024-09-16T07:53:05.443382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003910+0000","last_change":"2024-09-16T07:51:38.176497+0000","last_active":"2024-09-16T07:51:53.003910+0000","last_peered":"2024-09-16T07:51:53.003910+0000","last_clean":"2024-09-16T07:51:53.003910+0000","last_became_active":"2024-09-16T07:51:38.159939+0000","last_became_peered":"2024-09-16T07:51:38.159939+0000","last_unstale":"2024-09-16T07:52:29.000746+0000","last_undegraded":"2024-09-16T07:51:53.003910+0000","last_fullsized":"2024-09-16T07:51:53.003910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001960+0000","last_change":"2024-09-16T07:51:38.115751+0000","last_active":"2024-09-16T07:51:53.001960+0000","last_peered":"2024-09-16T07:51:53.001960+0000","last_clean":"2024-09-16T07:51:53.001960+0000","last_became_active":"2024-09-16T07:51:38.099152+0000","last_became_peered":"2024-09-16T07:51:38.099152+0000","last_unstale":"2024-09-16T07:52:29.000748+0000","last_undegraded":"2024-09-16T07:51:53.001960+0000","last_fullsized":"2024-09-16T07:51:53.001960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"83'461","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.278875+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:04.278875+0000","last_peered":"2024-09-16T07:53:04.278875+0000","last_clean":"2024-09-16T07:53:04.278875+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:53:04.278875+0000","last_undegraded":"2024-09-16T07:53:04.278875+0000","last_fullsized":"2024-09-16T07:53:04.278875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.004830+0000","last_change":"2024-09-16T07:51:38.154961+0000","last_active":"2024-09-16T07:51:53.004830+0000","last_peered":"2024-09-16T07:51:53.004830+0000","last_clean":"2024-09-16T07:51:53.004830+0000","last_became_active":"2024-09-16T07:51:38.134473+0000","last_became_peered":"2024-09-16T07:51:38.134473+0000","last_unstale":"2024-09-16T07:52:29.000749+0000","last_undegraded":"2024-09-16T07:51:53.004830+0000","last_fullsized":"2024-09-16T07:51:53.004830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"84'454","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.775210+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:05.775210+0000","last_peered":"2024-09-16T07:53:05.775210+0000","last_clean":"2024-09-16T07:53:05.775210+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:05.775210+0000","last_undegraded":"2024-09-16T07:53:05.775210+0000","last_fullsized":"2024-09-16T07:53:05.775210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":29056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"82'341","reported_seq":395,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:56.948374+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:52:56.948374+0000","last_peered":"2024-09-16T07:52:56.948374+0000","last_clean":"2024-09-16T07:52:56.948374+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:52:56.948374+0000","last_undegraded":"2024-09-16T07:52:56.948374+0000","last_fullsized":"2024-09-16T07:52:56.948374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001102+0000","last_change":"2024-09-16T07:51:38.169785+0000","last_active":"2024-09-16T07:51:53.001102+0000","last_peered":"2024-09-16T07:51:53.001102+0000","last_clean":"2024-09-16T07:51:53.001102+0000","last_became_active":"2024-09-16T07:51:38.149919+0000","last_became_peered":"2024-09-16T07:51:38.149919+0000","last_unstale":"2024-09-16T07:52:29.000752+0000","last_undegraded":"2024-09-16T07:51:53.001102+0000","last_fullsized":"2024-09-16T07:51:53.001102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"84'472","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.769668+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:53:05.769668+0000","last_peered":"2024-09-16T07:53:05.769668+0000","last_clean":"2024-09-16T07:53:05.769668+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:53:05.769668+0000","last_undegraded":"2024-09-16T07:53:05.769668+0000","last_fullsized":"2024-09-16T07:53:05.769668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.031381+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:04.031381+0000","last_peered":"2024-09-16T07:53:04.031381+0000","last_clean":"2024-09-16T07:53:04.031381+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:53:04.031381+0000","last_undegraded":"2024-09-16T07:53:04.031381+0000","last_fullsized":"2024-09-16T07:53:04.031381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":201,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.026027+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:52:53.026027+0000","last_peered":"2024-09-16T07:52:53.026027+0000","last_clean":"2024-09-16T07:52:53.026027+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:52:53.026027+0000","last_undegraded":"2024-09-16T07:52:53.026027+0000","last_fullsized":"2024-09-16T07:52:53.026027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.000096+0000","last_change":"2024-09-16T07:51:38.120872+0000","last_active":"2024-09-16T07:51:53.000096+0000","last_peered":"2024-09-16T07:51:53.000096+0000","last_clean":"2024-09-16T07:51:53.000096+0000","last_became_active":"2024-09-16T07:51:38.110191+0000","last_became_peered":"2024-09-16T07:51:38.110191+0000","last_unstale":"2024-09-16T07:52:29.000762+0000","last_undegraded":"2024-09-16T07:51:53.000096+0000","last_fullsized":"2024-09-16T07:51:53.000096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002784+0000","last_change":"2024-09-16T07:51:28.108718+0000","last_active":"2024-09-16T07:51:53.002784+0000","last_peered":"2024-09-16T07:51:53.002784+0000","last_clean":"2024-09-16T07:51:53.002784+0000","last_became_active":"2024-09-16T07:51:27.518387+0000","last_became_peered":"2024-09-16T07:51:27.518387+0000","last_unstale":"2024-09-16T07:52:29.000764+0000","last_undegraded":"2024-09-16T07:51:53.002784+0000","last_fullsized":"2024-09-16T07:51:53.002784+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"84'412","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.580277+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:05.580277+0000","last_peered":"2024-09-16T07:53:05.580277+0000","last_clean":"2024-09-16T07:53:05.580277+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:05.580277+0000","last_undegraded":"2024-09-16T07:53:05.580277+0000","last_fullsized":"2024-09-16T07:53:05.580277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":188,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.022681+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:52:53.022681+0000","last_peered":"2024-09-16T07:52:53.022681+0000","last_clean":"2024-09-16T07:52:53.022681+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:52:53.022681+0000","last_undegraded":"2024-09-16T07:52:53.022681+0000","last_fullsized":"2024-09-16T07:52:53.022681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"84'421","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.684454+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:53:05.684454+0000","last_peered":"2024-09-16T07:53:05.684454+0000","last_clean":"2024-09-16T07:53:05.684454+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:53:05.684454+0000","last_undegraded":"2024-09-16T07:53:05.684454+0000","last_fullsized":"2024-09-16T07:53:05.684454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:52.995846+0000","last_change":"2024-09-16T07:51:28.114509+0000","last_active":"2024-09-16T07:51:52.995846+0000","last_peered":"2024-09-16T07:51:52.995846+0000","last_clean":"2024-09-16T07:51:52.995846+0000","last_became_active":"2024-09-16T07:51:27.459621+0000","last_became_peered":"2024-09-16T07:51:27.459621+0000","last_unstale":"2024-09-16T07:52:29.000766+0000","last_undegraded":"2024-09-16T07:51:52.995846+0000","last_fullsized":"2024-09-16T07:51:52.995846+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"84'427","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.730196+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:53:05.730196+0000","last_peered":"2024-09-16T07:53:05.730196+0000","last_clean":"2024-09-16T07:53:05.730196+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:53:05.730196+0000","last_undegraded":"2024-09-16T07:53:05.730196+0000","last_fullsized":"2024-09-16T07:53:05.730196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.066207+0000","last_change":"2024-09-16T07:52:53.041802+0000","last_active":"2024-09-16T07:53:05.066207+0000","last_peered":"2024-09-16T07:53:05.066207+0000","last_clean":"2024-09-16T07:53:05.066207+0000","last_became_active":"2024-09-16T07:52:52.207206+0000","last_became_peered":"2024-09-16T07:52:52.207206+0000","last_unstale":"2024-09-16T07:53:05.066207+0000","last_undegraded":"2024-09-16T07:53:05.066207+0000","last_fullsized":"2024-09-16T07:53:05.066207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"68'2","reported_seq":23,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003297+0000","last_change":"2024-09-16T07:51:38.164960+0000","last_active":"2024-09-16T07:51:53.003297+0000","last_peered":"2024-09-16T07:51:53.003297+0000","last_clean":"2024-09-16T07:51:53.003297+0000","last_became_active":"2024-09-16T07:51:38.140920+0000","last_became_peered":"2024-09-16T07:51:38.140920+0000","last_unstale":"2024-09-16T07:52:29.000774+0000","last_undegraded":"2024-09-16T07:51:53.003297+0000","last_fullsized":"2024-09-16T07:51:53.003297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.032992+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:04.032992+0000","last_peered":"2024-09-16T07:53:04.032992+0000","last_clean":"2024-09-16T07:53:04.032992+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:53:04.032992+0000","last_undegraded":"2024-09-16T07:53:04.032992+0000","last_fullsized":"2024-09-16T07:53:04.032992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"83'435","reported_seq":494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.197911+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:04.197911+0000","last_peered":"2024-09-16T07:53:04.197911+0000","last_clean":"2024-09-16T07:53:04.197911+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:53:04.197911+0000","last_undegraded":"2024-09-16T07:53:04.197911+0000","last_fullsized":"2024-09-16T07:53:04.197911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.058500+0000","last_change":"2024-09-16T07:52:53.038857+0000","last_active":"2024-09-16T07:53:05.058500+0000","last_peered":"2024-09-16T07:53:05.058500+0000","last_clean":"2024-09-16T07:53:05.058500+0000","last_became_active":"2024-09-16T07:52:52.148242+0000","last_became_peered":"2024-09-16T07:52:52.148242+0000","last_unstale":"2024-09-16T07:53:05.058500+0000","last_undegraded":"2024-09-16T07:53:05.058500+0000","last_fullsized":"2024-09-16T07:53:05.058500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002351+0000","last_change":"2024-09-16T07:51:38.145559+0000","last_active":"2024-09-16T07:51:53.002351+0000","last_peered":"2024-09-16T07:51:53.002351+0000","last_clean":"2024-09-16T07:51:53.002351+0000","last_became_active":"2024-09-16T07:51:38.123189+0000","last_became_peered":"2024-09-16T07:51:38.123189+0000","last_unstale":"2024-09-16T07:52:29.000775+0000","last_undegraded":"2024-09-16T07:51:53.002351+0000","last_fullsized":"2024-09-16T07:51:53.002351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.019915+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:52:53.019915+0000","last_peered":"2024-09-16T07:52:53.019915+0000","last_clean":"2024-09-16T07:52:53.019915+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:52:53.019915+0000","last_undegraded":"2024-09-16T07:52:53.019915+0000","last_fullsized":"2024-09-16T07:52:53.019915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":254607360,"num_objects":3885,"num_object_clones":0,"num_object_copies":11655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3885,"num_write_kb":248640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59322368,"data_stored":949157888,"data_compressed":45068600,"data_compressed_allocated":59322368,"data_compressed_original":949157888,"omap_allocated":0,"internal_metadata":0},"log_size":3885,"ondisk_log_size":3885,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60688,"kb_used_data":19328,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94311152,"statfs":{"total":96636764160,"available":96574619648,"internally_reserved":0,"allocated":19791872,"data_stored":305604333,"data_compressed":14500060,"data_compressed_allocated":19087360,"data_compressed_original":305315840,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62840,"kb_used_data":25832,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94309000,"statfs":{"total":96636764160,"available":96572416000,"internally_reserved":0,"allocated":26451968,"data_stored":411844754,"data_compressed":19544411,"data_compressed_allocated":25726976,"data_compressed_original":411549696,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50588,"kb_used_data":14348,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94321252,"statfs":{"total":96636764160,"available":96584962048,"internally_reserved":0,"allocated":14692352,"data_stored":224339168,"data_compressed":10639243,"data_compressed_allocated":14004224,"data_compressed_original":224067584,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":62,"seq":266287972382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43684,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94328156,"statfs":{"total":96636764160,"available":96592031744,"internally_reserved":0,"allocated":741376,"data_stored":2133457,"data_compressed":92233,"data_compressed_allocated":122880,"data_compressed_original":1884160,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":1310720,"data_compressed":62192,"data_compressed_allocated":81920,"data_compressed_original":1310720,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14024704,"data_stored":224395264,"data_compressed":10654803,"data_compressed_allocated":14024704,"data_compressed_original":224395264,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25759744,"data_stored":412155904,"data_compressed":19570386,"data_compressed_allocated":25759744,"data_compressed_original":412155904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":311296000,"data_compressed":14781219,"data_compressed_allocated":19456000,"data_compressed_original":311296000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:10.078 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Total time run: 90.0568 2024-09-16T07:53:10.078 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Total writes made: 7847 2024-09-16T07:53:10.078 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Write size: 65536 2024-09-16T07:53:10.078 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Object size: 65536 2024-09-16T07:53:10.079 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Bandwidth (MB/sec): 5.44587 2024-09-16T07:53:10.079 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev Bandwidth: 6.23514 2024-09-16T07:53:10.079 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max bandwidth (MB/sec): 13.9375 2024-09-16T07:53:10.079 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min bandwidth (MB/sec): 0 2024-09-16T07:53:10.079 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Average IOPS: 87 2024-09-16T07:53:10.079 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev IOPS: 99.7792 2024-09-16T07:53:10.079 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max IOPS: 223 2024-09-16T07:53:10.079 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min IOPS: 0 2024-09-16T07:53:10.079 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Average Latency(s): 0.183577 2024-09-16T07:53:10.079 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev Latency(s): 1.34961 2024-09-16T07:53:10.079 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max latency(s): 20.3424 2024-09-16T07:53:10.079 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min latency(s): 0.0153521 2024-09-16T07:53:10.082 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:10.107 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T07:53:10.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:10.255+0000 7f88f7991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:10.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:10.269+0000 7f88f7991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:12.178 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:12.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:12.340+0000 7f4142b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:12.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:12.352+0000 7f4142b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:12.623 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:12.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:53:12.743 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-16T07:53:12.393841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":255197736,"num_objects":3889,"num_object_clones":0,"num_object_copies":11667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3965,"num_write_kb":249747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3940,"ondisk_log_size":3940,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":217800,"kb_used_data":60232,"kb_used_omap":0,"kb_used_meta":157504,"kb_avail":377269560,"statfs":{"total":386547056640,"available":386324029440,"internally_reserved":0,"allocated":61677568,"data_stored":943921712,"data_compressed":44775947,"data_compressed_allocated":58941440,"data_compressed_original":942817280,"omap_allocated":0,"internal_metadata":161284096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":71892992,"num_objects":1097,"num_object_clones":0,"num_object_copies":3291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":70208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.372891"},"pg_stats":[{"pgid":"5.f","version":"84'451","reported_seq":518,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.443382+0000","last_change":"2024-09-16T07:52:52.214675+0000","last_active":"2024-09-16T07:53:05.443382+0000","last_peered":"2024-09-16T07:53:05.443382+0000","last_clean":"2024-09-16T07:53:05.443382+0000","last_became_active":"2024-09-16T07:52:52.199189+0000","last_became_peered":"2024-09-16T07:52:52.199189+0000","last_unstale":"2024-09-16T07:53:05.443382+0000","last_undegraded":"2024-09-16T07:53:05.443382+0000","last_fullsized":"2024-09-16T07:53:05.443382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003910+0000","last_change":"2024-09-16T07:51:38.176497+0000","last_active":"2024-09-16T07:51:53.003910+0000","last_peered":"2024-09-16T07:51:53.003910+0000","last_clean":"2024-09-16T07:51:53.003910+0000","last_became_active":"2024-09-16T07:51:38.159939+0000","last_became_peered":"2024-09-16T07:51:38.159939+0000","last_unstale":"2024-09-16T07:52:29.000746+0000","last_undegraded":"2024-09-16T07:51:53.003910+0000","last_fullsized":"2024-09-16T07:51:53.003910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001960+0000","last_change":"2024-09-16T07:51:38.115751+0000","last_active":"2024-09-16T07:51:53.001960+0000","last_peered":"2024-09-16T07:51:53.001960+0000","last_clean":"2024-09-16T07:51:53.001960+0000","last_became_active":"2024-09-16T07:51:38.099152+0000","last_became_peered":"2024-09-16T07:51:38.099152+0000","last_unstale":"2024-09-16T07:52:29.000748+0000","last_undegraded":"2024-09-16T07:51:53.001960+0000","last_fullsized":"2024-09-16T07:51:53.001960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"83'461","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.278875+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:04.278875+0000","last_peered":"2024-09-16T07:53:04.278875+0000","last_clean":"2024-09-16T07:53:04.278875+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:53:04.278875+0000","last_undegraded":"2024-09-16T07:53:04.278875+0000","last_fullsized":"2024-09-16T07:53:04.278875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.004830+0000","last_change":"2024-09-16T07:51:38.154961+0000","last_active":"2024-09-16T07:51:53.004830+0000","last_peered":"2024-09-16T07:51:53.004830+0000","last_clean":"2024-09-16T07:51:53.004830+0000","last_became_active":"2024-09-16T07:51:38.134473+0000","last_became_peered":"2024-09-16T07:51:38.134473+0000","last_unstale":"2024-09-16T07:52:29.000749+0000","last_undegraded":"2024-09-16T07:51:53.004830+0000","last_fullsized":"2024-09-16T07:51:53.004830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"84'454","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.775210+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:05.775210+0000","last_peered":"2024-09-16T07:53:05.775210+0000","last_clean":"2024-09-16T07:53:05.775210+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:05.775210+0000","last_undegraded":"2024-09-16T07:53:05.775210+0000","last_fullsized":"2024-09-16T07:53:05.775210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":29056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"82'341","reported_seq":395,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:56.948374+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:52:56.948374+0000","last_peered":"2024-09-16T07:52:56.948374+0000","last_clean":"2024-09-16T07:52:56.948374+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:52:56.948374+0000","last_undegraded":"2024-09-16T07:52:56.948374+0000","last_fullsized":"2024-09-16T07:52:56.948374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001102+0000","last_change":"2024-09-16T07:51:38.169785+0000","last_active":"2024-09-16T07:51:53.001102+0000","last_peered":"2024-09-16T07:51:53.001102+0000","last_clean":"2024-09-16T07:51:53.001102+0000","last_became_active":"2024-09-16T07:51:38.149919+0000","last_became_peered":"2024-09-16T07:51:38.149919+0000","last_unstale":"2024-09-16T07:52:29.000752+0000","last_undegraded":"2024-09-16T07:51:53.001102+0000","last_fullsized":"2024-09-16T07:51:53.001102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"84'472","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.769668+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:53:05.769668+0000","last_peered":"2024-09-16T07:53:05.769668+0000","last_clean":"2024-09-16T07:53:05.769668+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:53:05.769668+0000","last_undegraded":"2024-09-16T07:53:05.769668+0000","last_fullsized":"2024-09-16T07:53:05.769668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.031381+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:04.031381+0000","last_peered":"2024-09-16T07:53:04.031381+0000","last_clean":"2024-09-16T07:53:04.031381+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:53:04.031381+0000","last_undegraded":"2024-09-16T07:53:04.031381+0000","last_fullsized":"2024-09-16T07:53:04.031381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":201,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.026027+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:52:53.026027+0000","last_peered":"2024-09-16T07:52:53.026027+0000","last_clean":"2024-09-16T07:52:53.026027+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:52:53.026027+0000","last_undegraded":"2024-09-16T07:52:53.026027+0000","last_fullsized":"2024-09-16T07:52:53.026027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.000096+0000","last_change":"2024-09-16T07:51:38.120872+0000","last_active":"2024-09-16T07:51:53.000096+0000","last_peered":"2024-09-16T07:51:53.000096+0000","last_clean":"2024-09-16T07:51:53.000096+0000","last_became_active":"2024-09-16T07:51:38.110191+0000","last_became_peered":"2024-09-16T07:51:38.110191+0000","last_unstale":"2024-09-16T07:52:29.000762+0000","last_undegraded":"2024-09-16T07:51:53.000096+0000","last_fullsized":"2024-09-16T07:51:53.000096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002784+0000","last_change":"2024-09-16T07:51:28.108718+0000","last_active":"2024-09-16T07:51:53.002784+0000","last_peered":"2024-09-16T07:51:53.002784+0000","last_clean":"2024-09-16T07:51:53.002784+0000","last_became_active":"2024-09-16T07:51:27.518387+0000","last_became_peered":"2024-09-16T07:51:27.518387+0000","last_unstale":"2024-09-16T07:52:29.000764+0000","last_undegraded":"2024-09-16T07:51:53.002784+0000","last_fullsized":"2024-09-16T07:51:53.002784+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"84'412","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.580277+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:05.580277+0000","last_peered":"2024-09-16T07:53:05.580277+0000","last_clean":"2024-09-16T07:53:05.580277+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:05.580277+0000","last_undegraded":"2024-09-16T07:53:05.580277+0000","last_fullsized":"2024-09-16T07:53:05.580277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":188,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.022681+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:52:53.022681+0000","last_peered":"2024-09-16T07:52:53.022681+0000","last_clean":"2024-09-16T07:52:53.022681+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:52:53.022681+0000","last_undegraded":"2024-09-16T07:52:53.022681+0000","last_fullsized":"2024-09-16T07:52:53.022681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"84'421","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.684454+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:53:05.684454+0000","last_peered":"2024-09-16T07:53:05.684454+0000","last_clean":"2024-09-16T07:53:05.684454+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:53:05.684454+0000","last_undegraded":"2024-09-16T07:53:05.684454+0000","last_fullsized":"2024-09-16T07:53:05.684454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:52.995846+0000","last_change":"2024-09-16T07:51:28.114509+0000","last_active":"2024-09-16T07:51:52.995846+0000","last_peered":"2024-09-16T07:51:52.995846+0000","last_clean":"2024-09-16T07:51:52.995846+0000","last_became_active":"2024-09-16T07:51:27.459621+0000","last_became_peered":"2024-09-16T07:51:27.459621+0000","last_unstale":"2024-09-16T07:52:29.000766+0000","last_undegraded":"2024-09-16T07:51:52.995846+0000","last_fullsized":"2024-09-16T07:51:52.995846+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"84'427","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.730196+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:53:05.730196+0000","last_peered":"2024-09-16T07:53:05.730196+0000","last_clean":"2024-09-16T07:53:05.730196+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:53:05.730196+0000","last_undegraded":"2024-09-16T07:53:05.730196+0000","last_fullsized":"2024-09-16T07:53:05.730196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.066207+0000","last_change":"2024-09-16T07:52:53.041802+0000","last_active":"2024-09-16T07:53:05.066207+0000","last_peered":"2024-09-16T07:53:05.066207+0000","last_clean":"2024-09-16T07:53:05.066207+0000","last_became_active":"2024-09-16T07:52:52.207206+0000","last_became_peered":"2024-09-16T07:52:52.207206+0000","last_unstale":"2024-09-16T07:53:05.066207+0000","last_undegraded":"2024-09-16T07:53:05.066207+0000","last_fullsized":"2024-09-16T07:53:05.066207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"68'2","reported_seq":23,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003297+0000","last_change":"2024-09-16T07:51:38.164960+0000","last_active":"2024-09-16T07:51:53.003297+0000","last_peered":"2024-09-16T07:51:53.003297+0000","last_clean":"2024-09-16T07:51:53.003297+0000","last_became_active":"2024-09-16T07:51:38.140920+0000","last_became_peered":"2024-09-16T07:51:38.140920+0000","last_unstale":"2024-09-16T07:52:29.000774+0000","last_undegraded":"2024-09-16T07:51:53.003297+0000","last_fullsized":"2024-09-16T07:51:53.003297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.032992+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:04.032992+0000","last_peered":"2024-09-16T07:53:04.032992+0000","last_clean":"2024-09-16T07:53:04.032992+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:53:04.032992+0000","last_undegraded":"2024-09-16T07:53:04.032992+0000","last_fullsized":"2024-09-16T07:53:04.032992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"83'435","reported_seq":494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.197911+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:04.197911+0000","last_peered":"2024-09-16T07:53:04.197911+0000","last_clean":"2024-09-16T07:53:04.197911+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:53:04.197911+0000","last_undegraded":"2024-09-16T07:53:04.197911+0000","last_fullsized":"2024-09-16T07:53:04.197911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.058500+0000","last_change":"2024-09-16T07:52:53.038857+0000","last_active":"2024-09-16T07:53:05.058500+0000","last_peered":"2024-09-16T07:53:05.058500+0000","last_clean":"2024-09-16T07:53:05.058500+0000","last_became_active":"2024-09-16T07:52:52.148242+0000","last_became_peered":"2024-09-16T07:52:52.148242+0000","last_unstale":"2024-09-16T07:53:05.058500+0000","last_undegraded":"2024-09-16T07:53:05.058500+0000","last_fullsized":"2024-09-16T07:53:05.058500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002351+0000","last_change":"2024-09-16T07:51:38.145559+0000","last_active":"2024-09-16T07:51:53.002351+0000","last_peered":"2024-09-16T07:51:53.002351+0000","last_clean":"2024-09-16T07:51:53.002351+0000","last_became_active":"2024-09-16T07:51:38.123189+0000","last_became_peered":"2024-09-16T07:51:38.123189+0000","last_unstale":"2024-09-16T07:52:29.000775+0000","last_undegraded":"2024-09-16T07:51:53.002351+0000","last_fullsized":"2024-09-16T07:51:53.002351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.019915+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:52:53.019915+0000","last_peered":"2024-09-16T07:52:53.019915+0000","last_clean":"2024-09-16T07:52:53.019915+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:52:53.019915+0000","last_undegraded":"2024-09-16T07:52:53.019915+0000","last_fullsized":"2024-09-16T07:52:53.019915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":254607360,"num_objects":3885,"num_object_clones":0,"num_object_copies":11655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3885,"num_write_kb":248640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59322368,"data_stored":949157888,"data_compressed":45068600,"data_compressed_allocated":59322368,"data_compressed_original":949157888,"omap_allocated":0,"internal_metadata":0},"log_size":3885,"ondisk_log_size":3885,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60688,"kb_used_data":19328,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94311152,"statfs":{"total":96636764160,"available":96574619648,"internally_reserved":0,"allocated":19791872,"data_stored":305604333,"data_compressed":14500060,"data_compressed_allocated":19087360,"data_compressed_original":305315840,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62840,"kb_used_data":25832,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94309000,"statfs":{"total":96636764160,"available":96572416000,"internally_reserved":0,"allocated":26451968,"data_stored":411844754,"data_compressed":19544411,"data_compressed_allocated":25726976,"data_compressed_original":411549696,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50588,"kb_used_data":14348,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94321252,"statfs":{"total":96636764160,"available":96584962048,"internally_reserved":0,"allocated":14692352,"data_stored":224339168,"data_compressed":10639243,"data_compressed_allocated":14004224,"data_compressed_original":224067584,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":62,"seq":266287972382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43684,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94328156,"statfs":{"total":96636764160,"available":96592031744,"internally_reserved":0,"allocated":741376,"data_stored":2133457,"data_compressed":92233,"data_compressed_allocated":122880,"data_compressed_original":1884160,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":1310720,"data_compressed":62192,"data_compressed_allocated":81920,"data_compressed_original":1310720,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14024704,"data_stored":224395264,"data_compressed":10654803,"data_compressed_allocated":14024704,"data_compressed_original":224395264,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25759744,"data_stored":412155904,"data_compressed":19570386,"data_compressed_allocated":25759744,"data_compressed_original":412155904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":311296000,"data_compressed":14781219,"data_compressed_allocated":19456000,"data_compressed_original":311296000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:12.746 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:53:12.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:12.785+0000 7fe180ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:12.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:12.799+0000 7fe180ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:12.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:12.903+0000 7fed16391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:12.915+0000 7fed16391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:13.352 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:13.353 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":495,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":86,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473171,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":16},{"state_name":"stale+active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":3889,"data_bytes":255197736,"bytes_used":223027200,"bytes_avail":386324029440,"bytes_total":386547056640,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":26666,"recovering_keys_per_sec":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"write_bytes_sec":9750990,"read_op_per_sec":0,"write_op_per_sec":148},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:53:13.370 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:53:13.370 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:13.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:13.530+0000 7fcd8d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:13.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:13.545+0000 7fcd8d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:13.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:13.826 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:53:13.843 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-16T07:53:12.393841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":255197736,"num_objects":3889,"num_object_clones":0,"num_object_copies":11667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3965,"num_write_kb":249747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3940,"ondisk_log_size":3940,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":217800,"kb_used_data":60232,"kb_used_omap":0,"kb_used_meta":157504,"kb_avail":377269560,"statfs":{"total":386547056640,"available":386324029440,"internally_reserved":0,"allocated":61677568,"data_stored":943921712,"data_compressed":44775947,"data_compressed_allocated":58941440,"data_compressed_original":942817280,"omap_allocated":0,"internal_metadata":161284096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":71892992,"num_objects":1097,"num_object_clones":0,"num_object_copies":3291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":70208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.372891"},"pg_stats":[{"pgid":"5.f","version":"84'451","reported_seq":518,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.443382+0000","last_change":"2024-09-16T07:52:52.214675+0000","last_active":"2024-09-16T07:53:05.443382+0000","last_peered":"2024-09-16T07:53:05.443382+0000","last_clean":"2024-09-16T07:53:05.443382+0000","last_became_active":"2024-09-16T07:52:52.199189+0000","last_became_peered":"2024-09-16T07:52:52.199189+0000","last_unstale":"2024-09-16T07:53:05.443382+0000","last_undegraded":"2024-09-16T07:53:05.443382+0000","last_fullsized":"2024-09-16T07:53:05.443382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003910+0000","last_change":"2024-09-16T07:51:38.176497+0000","last_active":"2024-09-16T07:51:53.003910+0000","last_peered":"2024-09-16T07:51:53.003910+0000","last_clean":"2024-09-16T07:51:53.003910+0000","last_became_active":"2024-09-16T07:51:38.159939+0000","last_became_peered":"2024-09-16T07:51:38.159939+0000","last_unstale":"2024-09-16T07:52:29.000746+0000","last_undegraded":"2024-09-16T07:51:53.003910+0000","last_fullsized":"2024-09-16T07:51:53.003910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001960+0000","last_change":"2024-09-16T07:51:38.115751+0000","last_active":"2024-09-16T07:51:53.001960+0000","last_peered":"2024-09-16T07:51:53.001960+0000","last_clean":"2024-09-16T07:51:53.001960+0000","last_became_active":"2024-09-16T07:51:38.099152+0000","last_became_peered":"2024-09-16T07:51:38.099152+0000","last_unstale":"2024-09-16T07:52:29.000748+0000","last_undegraded":"2024-09-16T07:51:53.001960+0000","last_fullsized":"2024-09-16T07:51:53.001960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"83'461","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.278875+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:04.278875+0000","last_peered":"2024-09-16T07:53:04.278875+0000","last_clean":"2024-09-16T07:53:04.278875+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:53:04.278875+0000","last_undegraded":"2024-09-16T07:53:04.278875+0000","last_fullsized":"2024-09-16T07:53:04.278875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.004830+0000","last_change":"2024-09-16T07:51:38.154961+0000","last_active":"2024-09-16T07:51:53.004830+0000","last_peered":"2024-09-16T07:51:53.004830+0000","last_clean":"2024-09-16T07:51:53.004830+0000","last_became_active":"2024-09-16T07:51:38.134473+0000","last_became_peered":"2024-09-16T07:51:38.134473+0000","last_unstale":"2024-09-16T07:52:29.000749+0000","last_undegraded":"2024-09-16T07:51:53.004830+0000","last_fullsized":"2024-09-16T07:51:53.004830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"84'454","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.775210+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:05.775210+0000","last_peered":"2024-09-16T07:53:05.775210+0000","last_clean":"2024-09-16T07:53:05.775210+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:05.775210+0000","last_undegraded":"2024-09-16T07:53:05.775210+0000","last_fullsized":"2024-09-16T07:53:05.775210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":29056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"82'341","reported_seq":395,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:56.948374+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:52:56.948374+0000","last_peered":"2024-09-16T07:52:56.948374+0000","last_clean":"2024-09-16T07:52:56.948374+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:52:56.948374+0000","last_undegraded":"2024-09-16T07:52:56.948374+0000","last_fullsized":"2024-09-16T07:52:56.948374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001102+0000","last_change":"2024-09-16T07:51:38.169785+0000","last_active":"2024-09-16T07:51:53.001102+0000","last_peered":"2024-09-16T07:51:53.001102+0000","last_clean":"2024-09-16T07:51:53.001102+0000","last_became_active":"2024-09-16T07:51:38.149919+0000","last_became_peered":"2024-09-16T07:51:38.149919+0000","last_unstale":"2024-09-16T07:52:29.000752+0000","last_undegraded":"2024-09-16T07:51:53.001102+0000","last_fullsized":"2024-09-16T07:51:53.001102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"84'472","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.769668+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:53:05.769668+0000","last_peered":"2024-09-16T07:53:05.769668+0000","last_clean":"2024-09-16T07:53:05.769668+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:53:05.769668+0000","last_undegraded":"2024-09-16T07:53:05.769668+0000","last_fullsized":"2024-09-16T07:53:05.769668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.031381+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:04.031381+0000","last_peered":"2024-09-16T07:53:04.031381+0000","last_clean":"2024-09-16T07:53:04.031381+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:53:04.031381+0000","last_undegraded":"2024-09-16T07:53:04.031381+0000","last_fullsized":"2024-09-16T07:53:04.031381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":201,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.026027+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:52:53.026027+0000","last_peered":"2024-09-16T07:52:53.026027+0000","last_clean":"2024-09-16T07:52:53.026027+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:52:53.026027+0000","last_undegraded":"2024-09-16T07:52:53.026027+0000","last_fullsized":"2024-09-16T07:52:53.026027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.000096+0000","last_change":"2024-09-16T07:51:38.120872+0000","last_active":"2024-09-16T07:51:53.000096+0000","last_peered":"2024-09-16T07:51:53.000096+0000","last_clean":"2024-09-16T07:51:53.000096+0000","last_became_active":"2024-09-16T07:51:38.110191+0000","last_became_peered":"2024-09-16T07:51:38.110191+0000","last_unstale":"2024-09-16T07:52:29.000762+0000","last_undegraded":"2024-09-16T07:51:53.000096+0000","last_fullsized":"2024-09-16T07:51:53.000096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002784+0000","last_change":"2024-09-16T07:51:28.108718+0000","last_active":"2024-09-16T07:51:53.002784+0000","last_peered":"2024-09-16T07:51:53.002784+0000","last_clean":"2024-09-16T07:51:53.002784+0000","last_became_active":"2024-09-16T07:51:27.518387+0000","last_became_peered":"2024-09-16T07:51:27.518387+0000","last_unstale":"2024-09-16T07:52:29.000764+0000","last_undegraded":"2024-09-16T07:51:53.002784+0000","last_fullsized":"2024-09-16T07:51:53.002784+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"84'412","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.580277+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:05.580277+0000","last_peered":"2024-09-16T07:53:05.580277+0000","last_clean":"2024-09-16T07:53:05.580277+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:05.580277+0000","last_undegraded":"2024-09-16T07:53:05.580277+0000","last_fullsized":"2024-09-16T07:53:05.580277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":188,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.022681+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:52:53.022681+0000","last_peered":"2024-09-16T07:52:53.022681+0000","last_clean":"2024-09-16T07:52:53.022681+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:52:53.022681+0000","last_undegraded":"2024-09-16T07:52:53.022681+0000","last_fullsized":"2024-09-16T07:52:53.022681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"84'421","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.684454+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:53:05.684454+0000","last_peered":"2024-09-16T07:53:05.684454+0000","last_clean":"2024-09-16T07:53:05.684454+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:53:05.684454+0000","last_undegraded":"2024-09-16T07:53:05.684454+0000","last_fullsized":"2024-09-16T07:53:05.684454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:52.995846+0000","last_change":"2024-09-16T07:51:28.114509+0000","last_active":"2024-09-16T07:51:52.995846+0000","last_peered":"2024-09-16T07:51:52.995846+0000","last_clean":"2024-09-16T07:51:52.995846+0000","last_became_active":"2024-09-16T07:51:27.459621+0000","last_became_peered":"2024-09-16T07:51:27.459621+0000","last_unstale":"2024-09-16T07:52:29.000766+0000","last_undegraded":"2024-09-16T07:51:52.995846+0000","last_fullsized":"2024-09-16T07:51:52.995846+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"84'427","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.730196+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:53:05.730196+0000","last_peered":"2024-09-16T07:53:05.730196+0000","last_clean":"2024-09-16T07:53:05.730196+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:53:05.730196+0000","last_undegraded":"2024-09-16T07:53:05.730196+0000","last_fullsized":"2024-09-16T07:53:05.730196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.066207+0000","last_change":"2024-09-16T07:52:53.041802+0000","last_active":"2024-09-16T07:53:05.066207+0000","last_peered":"2024-09-16T07:53:05.066207+0000","last_clean":"2024-09-16T07:53:05.066207+0000","last_became_active":"2024-09-16T07:52:52.207206+0000","last_became_peered":"2024-09-16T07:52:52.207206+0000","last_unstale":"2024-09-16T07:53:05.066207+0000","last_undegraded":"2024-09-16T07:53:05.066207+0000","last_fullsized":"2024-09-16T07:53:05.066207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"68'2","reported_seq":23,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003297+0000","last_change":"2024-09-16T07:51:38.164960+0000","last_active":"2024-09-16T07:51:53.003297+0000","last_peered":"2024-09-16T07:51:53.003297+0000","last_clean":"2024-09-16T07:51:53.003297+0000","last_became_active":"2024-09-16T07:51:38.140920+0000","last_became_peered":"2024-09-16T07:51:38.140920+0000","last_unstale":"2024-09-16T07:52:29.000774+0000","last_undegraded":"2024-09-16T07:51:53.003297+0000","last_fullsized":"2024-09-16T07:51:53.003297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.032992+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:04.032992+0000","last_peered":"2024-09-16T07:53:04.032992+0000","last_clean":"2024-09-16T07:53:04.032992+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:53:04.032992+0000","last_undegraded":"2024-09-16T07:53:04.032992+0000","last_fullsized":"2024-09-16T07:53:04.032992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"83'435","reported_seq":494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.197911+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:04.197911+0000","last_peered":"2024-09-16T07:53:04.197911+0000","last_clean":"2024-09-16T07:53:04.197911+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:53:04.197911+0000","last_undegraded":"2024-09-16T07:53:04.197911+0000","last_fullsized":"2024-09-16T07:53:04.197911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.058500+0000","last_change":"2024-09-16T07:52:53.038857+0000","last_active":"2024-09-16T07:53:05.058500+0000","last_peered":"2024-09-16T07:53:05.058500+0000","last_clean":"2024-09-16T07:53:05.058500+0000","last_became_active":"2024-09-16T07:52:52.148242+0000","last_became_peered":"2024-09-16T07:52:52.148242+0000","last_unstale":"2024-09-16T07:53:05.058500+0000","last_undegraded":"2024-09-16T07:53:05.058500+0000","last_fullsized":"2024-09-16T07:53:05.058500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002351+0000","last_change":"2024-09-16T07:51:38.145559+0000","last_active":"2024-09-16T07:51:53.002351+0000","last_peered":"2024-09-16T07:51:53.002351+0000","last_clean":"2024-09-16T07:51:53.002351+0000","last_became_active":"2024-09-16T07:51:38.123189+0000","last_became_peered":"2024-09-16T07:51:38.123189+0000","last_unstale":"2024-09-16T07:52:29.000775+0000","last_undegraded":"2024-09-16T07:51:53.002351+0000","last_fullsized":"2024-09-16T07:51:53.002351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.019915+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:52:53.019915+0000","last_peered":"2024-09-16T07:52:53.019915+0000","last_clean":"2024-09-16T07:52:53.019915+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:52:53.019915+0000","last_undegraded":"2024-09-16T07:52:53.019915+0000","last_fullsized":"2024-09-16T07:52:53.019915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":254607360,"num_objects":3885,"num_object_clones":0,"num_object_copies":11655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3885,"num_write_kb":248640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59322368,"data_stored":949157888,"data_compressed":45068600,"data_compressed_allocated":59322368,"data_compressed_original":949157888,"omap_allocated":0,"internal_metadata":0},"log_size":3885,"ondisk_log_size":3885,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60688,"kb_used_data":19328,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94311152,"statfs":{"total":96636764160,"available":96574619648,"internally_reserved":0,"allocated":19791872,"data_stored":305604333,"data_compressed":14500060,"data_compressed_allocated":19087360,"data_compressed_original":305315840,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62840,"kb_used_data":25832,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94309000,"statfs":{"total":96636764160,"available":96572416000,"internally_reserved":0,"allocated":26451968,"data_stored":411844754,"data_compressed":19544411,"data_compressed_allocated":25726976,"data_compressed_original":411549696,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50588,"kb_used_data":14348,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94321252,"statfs":{"total":96636764160,"available":96584962048,"internally_reserved":0,"allocated":14692352,"data_stored":224339168,"data_compressed":10639243,"data_compressed_allocated":14004224,"data_compressed_original":224067584,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":62,"seq":266287972382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43684,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94328156,"statfs":{"total":96636764160,"available":96592031744,"internally_reserved":0,"allocated":741376,"data_stored":2133457,"data_compressed":92233,"data_compressed_allocated":122880,"data_compressed_original":1884160,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":1310720,"data_compressed":62192,"data_compressed_allocated":81920,"data_compressed_original":1310720,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14024704,"data_stored":224395264,"data_compressed":10654803,"data_compressed_allocated":14024704,"data_compressed_original":224395264,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25759744,"data_stored":412155904,"data_compressed":19570386,"data_compressed_allocated":25759744,"data_compressed_original":412155904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":311296000,"data_compressed":14781219,"data_compressed_allocated":19456000,"data_compressed_original":311296000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:15.057 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:15.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:15.206+0000 7ff12484f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:15.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:15.216+0000 7ff12484f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:16.845 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:17.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:17.001+0000 7f958f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:17.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:17.013+0000 7f958f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:17.361 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:17.363 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:53:17.384 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-16T07:53:16.394636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":255197736,"num_objects":3889,"num_object_clones":0,"num_object_copies":11667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3965,"num_write_kb":249747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3940,"ondisk_log_size":3940,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":217800,"kb_used_data":60232,"kb_used_omap":0,"kb_used_meta":157504,"kb_avail":377269560,"statfs":{"total":386547056640,"available":386324029440,"internally_reserved":0,"allocated":61677568,"data_stored":943921712,"data_compressed":44775947,"data_compressed_allocated":58941440,"data_compressed_original":942817280,"omap_allocated":0,"internal_metadata":161284096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002031"},"pg_stats":[{"pgid":"5.f","version":"84'451","reported_seq":518,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.443382+0000","last_change":"2024-09-16T07:52:52.214675+0000","last_active":"2024-09-16T07:53:05.443382+0000","last_peered":"2024-09-16T07:53:05.443382+0000","last_clean":"2024-09-16T07:53:05.443382+0000","last_became_active":"2024-09-16T07:52:52.199189+0000","last_became_peered":"2024-09-16T07:52:52.199189+0000","last_unstale":"2024-09-16T07:53:05.443382+0000","last_undegraded":"2024-09-16T07:53:05.443382+0000","last_fullsized":"2024-09-16T07:53:05.443382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003910+0000","last_change":"2024-09-16T07:51:38.176497+0000","last_active":"2024-09-16T07:51:53.003910+0000","last_peered":"2024-09-16T07:51:53.003910+0000","last_clean":"2024-09-16T07:51:53.003910+0000","last_became_active":"2024-09-16T07:51:38.159939+0000","last_became_peered":"2024-09-16T07:51:38.159939+0000","last_unstale":"2024-09-16T07:52:29.000746+0000","last_undegraded":"2024-09-16T07:51:53.003910+0000","last_fullsized":"2024-09-16T07:51:53.003910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001960+0000","last_change":"2024-09-16T07:51:38.115751+0000","last_active":"2024-09-16T07:51:53.001960+0000","last_peered":"2024-09-16T07:51:53.001960+0000","last_clean":"2024-09-16T07:51:53.001960+0000","last_became_active":"2024-09-16T07:51:38.099152+0000","last_became_peered":"2024-09-16T07:51:38.099152+0000","last_unstale":"2024-09-16T07:52:29.000748+0000","last_undegraded":"2024-09-16T07:51:53.001960+0000","last_fullsized":"2024-09-16T07:51:53.001960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"83'461","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.278875+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:04.278875+0000","last_peered":"2024-09-16T07:53:04.278875+0000","last_clean":"2024-09-16T07:53:04.278875+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:53:04.278875+0000","last_undegraded":"2024-09-16T07:53:04.278875+0000","last_fullsized":"2024-09-16T07:53:04.278875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.004830+0000","last_change":"2024-09-16T07:51:38.154961+0000","last_active":"2024-09-16T07:51:53.004830+0000","last_peered":"2024-09-16T07:51:53.004830+0000","last_clean":"2024-09-16T07:51:53.004830+0000","last_became_active":"2024-09-16T07:51:38.134473+0000","last_became_peered":"2024-09-16T07:51:38.134473+0000","last_unstale":"2024-09-16T07:52:29.000749+0000","last_undegraded":"2024-09-16T07:51:53.004830+0000","last_fullsized":"2024-09-16T07:51:53.004830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"84'454","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.775210+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:05.775210+0000","last_peered":"2024-09-16T07:53:05.775210+0000","last_clean":"2024-09-16T07:53:05.775210+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:05.775210+0000","last_undegraded":"2024-09-16T07:53:05.775210+0000","last_fullsized":"2024-09-16T07:53:05.775210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":29056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"82'341","reported_seq":395,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:56.948374+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:52:56.948374+0000","last_peered":"2024-09-16T07:52:56.948374+0000","last_clean":"2024-09-16T07:52:56.948374+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:52:56.948374+0000","last_undegraded":"2024-09-16T07:52:56.948374+0000","last_fullsized":"2024-09-16T07:52:56.948374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001102+0000","last_change":"2024-09-16T07:51:38.169785+0000","last_active":"2024-09-16T07:51:53.001102+0000","last_peered":"2024-09-16T07:51:53.001102+0000","last_clean":"2024-09-16T07:51:53.001102+0000","last_became_active":"2024-09-16T07:51:38.149919+0000","last_became_peered":"2024-09-16T07:51:38.149919+0000","last_unstale":"2024-09-16T07:52:29.000752+0000","last_undegraded":"2024-09-16T07:51:53.001102+0000","last_fullsized":"2024-09-16T07:51:53.001102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"84'472","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.769668+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:53:05.769668+0000","last_peered":"2024-09-16T07:53:05.769668+0000","last_clean":"2024-09-16T07:53:05.769668+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:53:05.769668+0000","last_undegraded":"2024-09-16T07:53:05.769668+0000","last_fullsized":"2024-09-16T07:53:05.769668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.031381+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:04.031381+0000","last_peered":"2024-09-16T07:53:04.031381+0000","last_clean":"2024-09-16T07:53:04.031381+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:53:04.031381+0000","last_undegraded":"2024-09-16T07:53:04.031381+0000","last_fullsized":"2024-09-16T07:53:04.031381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":201,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.026027+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:52:53.026027+0000","last_peered":"2024-09-16T07:52:53.026027+0000","last_clean":"2024-09-16T07:52:53.026027+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:52:53.026027+0000","last_undegraded":"2024-09-16T07:52:53.026027+0000","last_fullsized":"2024-09-16T07:52:53.026027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.000096+0000","last_change":"2024-09-16T07:51:38.120872+0000","last_active":"2024-09-16T07:51:53.000096+0000","last_peered":"2024-09-16T07:51:53.000096+0000","last_clean":"2024-09-16T07:51:53.000096+0000","last_became_active":"2024-09-16T07:51:38.110191+0000","last_became_peered":"2024-09-16T07:51:38.110191+0000","last_unstale":"2024-09-16T07:52:29.000762+0000","last_undegraded":"2024-09-16T07:51:53.000096+0000","last_fullsized":"2024-09-16T07:51:53.000096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002784+0000","last_change":"2024-09-16T07:51:28.108718+0000","last_active":"2024-09-16T07:51:53.002784+0000","last_peered":"2024-09-16T07:51:53.002784+0000","last_clean":"2024-09-16T07:51:53.002784+0000","last_became_active":"2024-09-16T07:51:27.518387+0000","last_became_peered":"2024-09-16T07:51:27.518387+0000","last_unstale":"2024-09-16T07:52:29.000764+0000","last_undegraded":"2024-09-16T07:51:53.002784+0000","last_fullsized":"2024-09-16T07:51:53.002784+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"84'412","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.580277+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:05.580277+0000","last_peered":"2024-09-16T07:53:05.580277+0000","last_clean":"2024-09-16T07:53:05.580277+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:05.580277+0000","last_undegraded":"2024-09-16T07:53:05.580277+0000","last_fullsized":"2024-09-16T07:53:05.580277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":188,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.022681+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:52:53.022681+0000","last_peered":"2024-09-16T07:52:53.022681+0000","last_clean":"2024-09-16T07:52:53.022681+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:52:53.022681+0000","last_undegraded":"2024-09-16T07:52:53.022681+0000","last_fullsized":"2024-09-16T07:52:53.022681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"84'421","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.684454+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:53:05.684454+0000","last_peered":"2024-09-16T07:53:05.684454+0000","last_clean":"2024-09-16T07:53:05.684454+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:53:05.684454+0000","last_undegraded":"2024-09-16T07:53:05.684454+0000","last_fullsized":"2024-09-16T07:53:05.684454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:52.995846+0000","last_change":"2024-09-16T07:51:28.114509+0000","last_active":"2024-09-16T07:51:52.995846+0000","last_peered":"2024-09-16T07:51:52.995846+0000","last_clean":"2024-09-16T07:51:52.995846+0000","last_became_active":"2024-09-16T07:51:27.459621+0000","last_became_peered":"2024-09-16T07:51:27.459621+0000","last_unstale":"2024-09-16T07:52:29.000766+0000","last_undegraded":"2024-09-16T07:51:52.995846+0000","last_fullsized":"2024-09-16T07:51:52.995846+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"84'427","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.730196+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:53:05.730196+0000","last_peered":"2024-09-16T07:53:05.730196+0000","last_clean":"2024-09-16T07:53:05.730196+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:53:05.730196+0000","last_undegraded":"2024-09-16T07:53:05.730196+0000","last_fullsized":"2024-09-16T07:53:05.730196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.066207+0000","last_change":"2024-09-16T07:52:53.041802+0000","last_active":"2024-09-16T07:53:05.066207+0000","last_peered":"2024-09-16T07:53:05.066207+0000","last_clean":"2024-09-16T07:53:05.066207+0000","last_became_active":"2024-09-16T07:52:52.207206+0000","last_became_peered":"2024-09-16T07:52:52.207206+0000","last_unstale":"2024-09-16T07:53:05.066207+0000","last_undegraded":"2024-09-16T07:53:05.066207+0000","last_fullsized":"2024-09-16T07:53:05.066207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"68'2","reported_seq":23,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003297+0000","last_change":"2024-09-16T07:51:38.164960+0000","last_active":"2024-09-16T07:51:53.003297+0000","last_peered":"2024-09-16T07:51:53.003297+0000","last_clean":"2024-09-16T07:51:53.003297+0000","last_became_active":"2024-09-16T07:51:38.140920+0000","last_became_peered":"2024-09-16T07:51:38.140920+0000","last_unstale":"2024-09-16T07:52:29.000774+0000","last_undegraded":"2024-09-16T07:51:53.003297+0000","last_fullsized":"2024-09-16T07:51:53.003297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.032992+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:04.032992+0000","last_peered":"2024-09-16T07:53:04.032992+0000","last_clean":"2024-09-16T07:53:04.032992+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:53:04.032992+0000","last_undegraded":"2024-09-16T07:53:04.032992+0000","last_fullsized":"2024-09-16T07:53:04.032992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"83'435","reported_seq":494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.197911+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:04.197911+0000","last_peered":"2024-09-16T07:53:04.197911+0000","last_clean":"2024-09-16T07:53:04.197911+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:53:04.197911+0000","last_undegraded":"2024-09-16T07:53:04.197911+0000","last_fullsized":"2024-09-16T07:53:04.197911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.058500+0000","last_change":"2024-09-16T07:52:53.038857+0000","last_active":"2024-09-16T07:53:05.058500+0000","last_peered":"2024-09-16T07:53:05.058500+0000","last_clean":"2024-09-16T07:53:05.058500+0000","last_became_active":"2024-09-16T07:52:52.148242+0000","last_became_peered":"2024-09-16T07:52:52.148242+0000","last_unstale":"2024-09-16T07:53:05.058500+0000","last_undegraded":"2024-09-16T07:53:05.058500+0000","last_fullsized":"2024-09-16T07:53:05.058500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002351+0000","last_change":"2024-09-16T07:51:38.145559+0000","last_active":"2024-09-16T07:51:53.002351+0000","last_peered":"2024-09-16T07:51:53.002351+0000","last_clean":"2024-09-16T07:51:53.002351+0000","last_became_active":"2024-09-16T07:51:38.123189+0000","last_became_peered":"2024-09-16T07:51:38.123189+0000","last_unstale":"2024-09-16T07:52:29.000775+0000","last_undegraded":"2024-09-16T07:51:53.002351+0000","last_fullsized":"2024-09-16T07:51:53.002351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.019915+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:52:53.019915+0000","last_peered":"2024-09-16T07:52:53.019915+0000","last_clean":"2024-09-16T07:52:53.019915+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:52:53.019915+0000","last_undegraded":"2024-09-16T07:52:53.019915+0000","last_fullsized":"2024-09-16T07:52:53.019915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":254607360,"num_objects":3885,"num_object_clones":0,"num_object_copies":11655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3885,"num_write_kb":248640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59322368,"data_stored":949157888,"data_compressed":45068600,"data_compressed_allocated":59322368,"data_compressed_original":949157888,"omap_allocated":0,"internal_metadata":0},"log_size":3885,"ondisk_log_size":3885,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60688,"kb_used_data":19328,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94311152,"statfs":{"total":96636764160,"available":96574619648,"internally_reserved":0,"allocated":19791872,"data_stored":305604333,"data_compressed":14500060,"data_compressed_allocated":19087360,"data_compressed_original":305315840,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62840,"kb_used_data":25832,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94309000,"statfs":{"total":96636764160,"available":96572416000,"internally_reserved":0,"allocated":26451968,"data_stored":411844754,"data_compressed":19544411,"data_compressed_allocated":25726976,"data_compressed_original":411549696,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50588,"kb_used_data":14348,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94321252,"statfs":{"total":96636764160,"available":96584962048,"internally_reserved":0,"allocated":14692352,"data_stored":224339168,"data_compressed":10639243,"data_compressed_allocated":14004224,"data_compressed_original":224067584,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":62,"seq":266287972382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43684,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94328156,"statfs":{"total":96636764160,"available":96592031744,"internally_reserved":0,"allocated":741376,"data_stored":2133457,"data_compressed":92233,"data_compressed_allocated":122880,"data_compressed_original":1884160,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":1310720,"data_compressed":62192,"data_compressed_allocated":81920,"data_compressed_original":1310720,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14024704,"data_stored":224395264,"data_compressed":10654803,"data_compressed_allocated":14024704,"data_compressed_original":224395264,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25759744,"data_stored":412155904,"data_compressed":19570386,"data_compressed_allocated":25759744,"data_compressed_original":412155904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":311296000,"data_compressed":14781219,"data_compressed_allocated":19456000,"data_compressed_original":311296000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:17.386 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:53:17.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:17.531+0000 7ff581951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:17.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:17.544+0000 7ff581951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:17.581 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:17.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:17.757+0000 7f65dca4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:17.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:17.769+0000 7f65d759e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:18.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:18.053 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":500,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":86,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473171,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":16},{"state_name":"stale+active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":3889,"data_bytes":255197736,"bytes_used":223027200,"bytes_avail":386324029440,"bytes_total":386547056640},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:53:18.074 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:53:18.074 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:18.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:18.236+0000 7f6305511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:18.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:18.251+0000 7f6305511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:18.617 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:18.617 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:53:18.640 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-09-16T07:53:18.395087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":255197736,"num_objects":3889,"num_object_clones":0,"num_object_copies":11667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3965,"num_write_kb":249747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3940,"ondisk_log_size":3940,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":217800,"kb_used_data":60232,"kb_used_omap":0,"kb_used_meta":157504,"kb_avail":377269560,"statfs":{"total":386547056640,"available":386324029440,"internally_reserved":0,"allocated":61677568,"data_stored":943921712,"data_compressed":44775947,"data_compressed_allocated":58941440,"data_compressed_original":942817280,"omap_allocated":0,"internal_metadata":161284096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.357131"},"pg_stats":[{"pgid":"5.f","version":"84'451","reported_seq":518,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.443382+0000","last_change":"2024-09-16T07:52:52.214675+0000","last_active":"2024-09-16T07:53:05.443382+0000","last_peered":"2024-09-16T07:53:05.443382+0000","last_clean":"2024-09-16T07:53:05.443382+0000","last_became_active":"2024-09-16T07:52:52.199189+0000","last_became_peered":"2024-09-16T07:52:52.199189+0000","last_unstale":"2024-09-16T07:53:05.443382+0000","last_undegraded":"2024-09-16T07:53:05.443382+0000","last_fullsized":"2024-09-16T07:53:05.443382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003910+0000","last_change":"2024-09-16T07:51:38.176497+0000","last_active":"2024-09-16T07:51:53.003910+0000","last_peered":"2024-09-16T07:51:53.003910+0000","last_clean":"2024-09-16T07:51:53.003910+0000","last_became_active":"2024-09-16T07:51:38.159939+0000","last_became_peered":"2024-09-16T07:51:38.159939+0000","last_unstale":"2024-09-16T07:52:29.000746+0000","last_undegraded":"2024-09-16T07:51:53.003910+0000","last_fullsized":"2024-09-16T07:51:53.003910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001960+0000","last_change":"2024-09-16T07:51:38.115751+0000","last_active":"2024-09-16T07:51:53.001960+0000","last_peered":"2024-09-16T07:51:53.001960+0000","last_clean":"2024-09-16T07:51:53.001960+0000","last_became_active":"2024-09-16T07:51:38.099152+0000","last_became_peered":"2024-09-16T07:51:38.099152+0000","last_unstale":"2024-09-16T07:52:29.000748+0000","last_undegraded":"2024-09-16T07:51:53.001960+0000","last_fullsized":"2024-09-16T07:51:53.001960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"83'461","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.278875+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:04.278875+0000","last_peered":"2024-09-16T07:53:04.278875+0000","last_clean":"2024-09-16T07:53:04.278875+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:53:04.278875+0000","last_undegraded":"2024-09-16T07:53:04.278875+0000","last_fullsized":"2024-09-16T07:53:04.278875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.004830+0000","last_change":"2024-09-16T07:51:38.154961+0000","last_active":"2024-09-16T07:51:53.004830+0000","last_peered":"2024-09-16T07:51:53.004830+0000","last_clean":"2024-09-16T07:51:53.004830+0000","last_became_active":"2024-09-16T07:51:38.134473+0000","last_became_peered":"2024-09-16T07:51:38.134473+0000","last_unstale":"2024-09-16T07:52:29.000749+0000","last_undegraded":"2024-09-16T07:51:53.004830+0000","last_fullsized":"2024-09-16T07:51:53.004830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"84'454","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.775210+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:05.775210+0000","last_peered":"2024-09-16T07:53:05.775210+0000","last_clean":"2024-09-16T07:53:05.775210+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:05.775210+0000","last_undegraded":"2024-09-16T07:53:05.775210+0000","last_fullsized":"2024-09-16T07:53:05.775210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":29056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"82'341","reported_seq":395,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:56.948374+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:52:56.948374+0000","last_peered":"2024-09-16T07:52:56.948374+0000","last_clean":"2024-09-16T07:52:56.948374+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:52:56.948374+0000","last_undegraded":"2024-09-16T07:52:56.948374+0000","last_fullsized":"2024-09-16T07:52:56.948374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001102+0000","last_change":"2024-09-16T07:51:38.169785+0000","last_active":"2024-09-16T07:51:53.001102+0000","last_peered":"2024-09-16T07:51:53.001102+0000","last_clean":"2024-09-16T07:51:53.001102+0000","last_became_active":"2024-09-16T07:51:38.149919+0000","last_became_peered":"2024-09-16T07:51:38.149919+0000","last_unstale":"2024-09-16T07:52:29.000752+0000","last_undegraded":"2024-09-16T07:51:53.001102+0000","last_fullsized":"2024-09-16T07:51:53.001102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"84'472","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.769668+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:53:05.769668+0000","last_peered":"2024-09-16T07:53:05.769668+0000","last_clean":"2024-09-16T07:53:05.769668+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:53:05.769668+0000","last_undegraded":"2024-09-16T07:53:05.769668+0000","last_fullsized":"2024-09-16T07:53:05.769668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.031381+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:04.031381+0000","last_peered":"2024-09-16T07:53:04.031381+0000","last_clean":"2024-09-16T07:53:04.031381+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:53:04.031381+0000","last_undegraded":"2024-09-16T07:53:04.031381+0000","last_fullsized":"2024-09-16T07:53:04.031381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":201,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.026027+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:52:53.026027+0000","last_peered":"2024-09-16T07:52:53.026027+0000","last_clean":"2024-09-16T07:52:53.026027+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:52:53.026027+0000","last_undegraded":"2024-09-16T07:52:53.026027+0000","last_fullsized":"2024-09-16T07:52:53.026027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.000096+0000","last_change":"2024-09-16T07:51:38.120872+0000","last_active":"2024-09-16T07:51:53.000096+0000","last_peered":"2024-09-16T07:51:53.000096+0000","last_clean":"2024-09-16T07:51:53.000096+0000","last_became_active":"2024-09-16T07:51:38.110191+0000","last_became_peered":"2024-09-16T07:51:38.110191+0000","last_unstale":"2024-09-16T07:52:29.000762+0000","last_undegraded":"2024-09-16T07:51:53.000096+0000","last_fullsized":"2024-09-16T07:51:53.000096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002784+0000","last_change":"2024-09-16T07:51:28.108718+0000","last_active":"2024-09-16T07:51:53.002784+0000","last_peered":"2024-09-16T07:51:53.002784+0000","last_clean":"2024-09-16T07:51:53.002784+0000","last_became_active":"2024-09-16T07:51:27.518387+0000","last_became_peered":"2024-09-16T07:51:27.518387+0000","last_unstale":"2024-09-16T07:52:29.000764+0000","last_undegraded":"2024-09-16T07:51:53.002784+0000","last_fullsized":"2024-09-16T07:51:53.002784+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"84'412","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.580277+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:05.580277+0000","last_peered":"2024-09-16T07:53:05.580277+0000","last_clean":"2024-09-16T07:53:05.580277+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:05.580277+0000","last_undegraded":"2024-09-16T07:53:05.580277+0000","last_fullsized":"2024-09-16T07:53:05.580277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":188,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.022681+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:52:53.022681+0000","last_peered":"2024-09-16T07:52:53.022681+0000","last_clean":"2024-09-16T07:52:53.022681+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:52:53.022681+0000","last_undegraded":"2024-09-16T07:52:53.022681+0000","last_fullsized":"2024-09-16T07:52:53.022681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"84'421","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.684454+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:53:05.684454+0000","last_peered":"2024-09-16T07:53:05.684454+0000","last_clean":"2024-09-16T07:53:05.684454+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:53:05.684454+0000","last_undegraded":"2024-09-16T07:53:05.684454+0000","last_fullsized":"2024-09-16T07:53:05.684454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:52.995846+0000","last_change":"2024-09-16T07:51:28.114509+0000","last_active":"2024-09-16T07:51:52.995846+0000","last_peered":"2024-09-16T07:51:52.995846+0000","last_clean":"2024-09-16T07:51:52.995846+0000","last_became_active":"2024-09-16T07:51:27.459621+0000","last_became_peered":"2024-09-16T07:51:27.459621+0000","last_unstale":"2024-09-16T07:52:29.000766+0000","last_undegraded":"2024-09-16T07:51:52.995846+0000","last_fullsized":"2024-09-16T07:51:52.995846+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"84'427","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.730196+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:53:05.730196+0000","last_peered":"2024-09-16T07:53:05.730196+0000","last_clean":"2024-09-16T07:53:05.730196+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:53:05.730196+0000","last_undegraded":"2024-09-16T07:53:05.730196+0000","last_fullsized":"2024-09-16T07:53:05.730196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.066207+0000","last_change":"2024-09-16T07:52:53.041802+0000","last_active":"2024-09-16T07:53:05.066207+0000","last_peered":"2024-09-16T07:53:05.066207+0000","last_clean":"2024-09-16T07:53:05.066207+0000","last_became_active":"2024-09-16T07:52:52.207206+0000","last_became_peered":"2024-09-16T07:52:52.207206+0000","last_unstale":"2024-09-16T07:53:05.066207+0000","last_undegraded":"2024-09-16T07:53:05.066207+0000","last_fullsized":"2024-09-16T07:53:05.066207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"68'2","reported_seq":23,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003297+0000","last_change":"2024-09-16T07:51:38.164960+0000","last_active":"2024-09-16T07:51:53.003297+0000","last_peered":"2024-09-16T07:51:53.003297+0000","last_clean":"2024-09-16T07:51:53.003297+0000","last_became_active":"2024-09-16T07:51:38.140920+0000","last_became_peered":"2024-09-16T07:51:38.140920+0000","last_unstale":"2024-09-16T07:52:29.000774+0000","last_undegraded":"2024-09-16T07:51:53.003297+0000","last_fullsized":"2024-09-16T07:51:53.003297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.032992+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:04.032992+0000","last_peered":"2024-09-16T07:53:04.032992+0000","last_clean":"2024-09-16T07:53:04.032992+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:53:04.032992+0000","last_undegraded":"2024-09-16T07:53:04.032992+0000","last_fullsized":"2024-09-16T07:53:04.032992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"83'435","reported_seq":494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.197911+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:04.197911+0000","last_peered":"2024-09-16T07:53:04.197911+0000","last_clean":"2024-09-16T07:53:04.197911+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:53:04.197911+0000","last_undegraded":"2024-09-16T07:53:04.197911+0000","last_fullsized":"2024-09-16T07:53:04.197911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.058500+0000","last_change":"2024-09-16T07:52:53.038857+0000","last_active":"2024-09-16T07:53:05.058500+0000","last_peered":"2024-09-16T07:53:05.058500+0000","last_clean":"2024-09-16T07:53:05.058500+0000","last_became_active":"2024-09-16T07:52:52.148242+0000","last_became_peered":"2024-09-16T07:52:52.148242+0000","last_unstale":"2024-09-16T07:53:05.058500+0000","last_undegraded":"2024-09-16T07:53:05.058500+0000","last_fullsized":"2024-09-16T07:53:05.058500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002351+0000","last_change":"2024-09-16T07:51:38.145559+0000","last_active":"2024-09-16T07:51:53.002351+0000","last_peered":"2024-09-16T07:51:53.002351+0000","last_clean":"2024-09-16T07:51:53.002351+0000","last_became_active":"2024-09-16T07:51:38.123189+0000","last_became_peered":"2024-09-16T07:51:38.123189+0000","last_unstale":"2024-09-16T07:52:29.000775+0000","last_undegraded":"2024-09-16T07:51:53.002351+0000","last_fullsized":"2024-09-16T07:51:53.002351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.019915+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:52:53.019915+0000","last_peered":"2024-09-16T07:52:53.019915+0000","last_clean":"2024-09-16T07:52:53.019915+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:52:53.019915+0000","last_undegraded":"2024-09-16T07:52:53.019915+0000","last_fullsized":"2024-09-16T07:52:53.019915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":254607360,"num_objects":3885,"num_object_clones":0,"num_object_copies":11655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3885,"num_write_kb":248640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59322368,"data_stored":949157888,"data_compressed":45068600,"data_compressed_allocated":59322368,"data_compressed_original":949157888,"omap_allocated":0,"internal_metadata":0},"log_size":3885,"ondisk_log_size":3885,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60688,"kb_used_data":19328,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94311152,"statfs":{"total":96636764160,"available":96574619648,"internally_reserved":0,"allocated":19791872,"data_stored":305604333,"data_compressed":14500060,"data_compressed_allocated":19087360,"data_compressed_original":305315840,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62840,"kb_used_data":25832,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94309000,"statfs":{"total":96636764160,"available":96572416000,"internally_reserved":0,"allocated":26451968,"data_stored":411844754,"data_compressed":19544411,"data_compressed_allocated":25726976,"data_compressed_original":411549696,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50588,"kb_used_data":14348,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94321252,"statfs":{"total":96636764160,"available":96584962048,"internally_reserved":0,"allocated":14692352,"data_stored":224339168,"data_compressed":10639243,"data_compressed_allocated":14004224,"data_compressed_original":224067584,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":62,"seq":266287972382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43684,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94328156,"statfs":{"total":96636764160,"available":96592031744,"internally_reserved":0,"allocated":741376,"data_stored":2133457,"data_compressed":92233,"data_compressed_allocated":122880,"data_compressed_original":1884160,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":1310720,"data_compressed":62192,"data_compressed_allocated":81920,"data_compressed_original":1310720,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14024704,"data_stored":224395264,"data_compressed":10654803,"data_compressed_allocated":14024704,"data_compressed_original":224395264,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25759744,"data_stored":412155904,"data_compressed":19570386,"data_compressed_allocated":25759744,"data_compressed_original":412155904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":311296000,"data_compressed":14781219,"data_compressed_allocated":19456000,"data_compressed_original":311296000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:20.155 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:20.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:20.310+0000 7f3382b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:20.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:20.320+0000 7f3382b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:21.642 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:21.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:21.808+0000 7fc2cbafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:21.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:21.821+0000 7fc2cbafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:22.167 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:22.168 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:53:22.187 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-16T07:53:20.395430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":255197736,"num_objects":3889,"num_object_clones":0,"num_object_copies":11667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3965,"num_write_kb":249747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3940,"ondisk_log_size":3940,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":217800,"kb_used_data":60232,"kb_used_omap":0,"kb_used_meta":157504,"kb_avail":377269560,"statfs":{"total":386547056640,"available":386324029440,"internally_reserved":0,"allocated":61677568,"data_stored":943921712,"data_compressed":44775947,"data_compressed_allocated":58941440,"data_compressed_original":942817280,"omap_allocated":0,"internal_metadata":161284096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002464"},"pg_stats":[{"pgid":"5.f","version":"84'451","reported_seq":518,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.443382+0000","last_change":"2024-09-16T07:52:52.214675+0000","last_active":"2024-09-16T07:53:05.443382+0000","last_peered":"2024-09-16T07:53:05.443382+0000","last_clean":"2024-09-16T07:53:05.443382+0000","last_became_active":"2024-09-16T07:52:52.199189+0000","last_became_peered":"2024-09-16T07:52:52.199189+0000","last_unstale":"2024-09-16T07:53:05.443382+0000","last_undegraded":"2024-09-16T07:53:05.443382+0000","last_fullsized":"2024-09-16T07:53:05.443382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003910+0000","last_change":"2024-09-16T07:51:38.176497+0000","last_active":"2024-09-16T07:51:53.003910+0000","last_peered":"2024-09-16T07:51:53.003910+0000","last_clean":"2024-09-16T07:51:53.003910+0000","last_became_active":"2024-09-16T07:51:38.159939+0000","last_became_peered":"2024-09-16T07:51:38.159939+0000","last_unstale":"2024-09-16T07:52:29.000746+0000","last_undegraded":"2024-09-16T07:51:53.003910+0000","last_fullsized":"2024-09-16T07:51:53.003910+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001960+0000","last_change":"2024-09-16T07:51:38.115751+0000","last_active":"2024-09-16T07:51:53.001960+0000","last_peered":"2024-09-16T07:51:53.001960+0000","last_clean":"2024-09-16T07:51:53.001960+0000","last_became_active":"2024-09-16T07:51:38.099152+0000","last_became_peered":"2024-09-16T07:51:38.099152+0000","last_unstale":"2024-09-16T07:52:29.000748+0000","last_undegraded":"2024-09-16T07:51:53.001960+0000","last_fullsized":"2024-09-16T07:51:53.001960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"83'461","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.278875+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:04.278875+0000","last_peered":"2024-09-16T07:53:04.278875+0000","last_clean":"2024-09-16T07:53:04.278875+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:53:04.278875+0000","last_undegraded":"2024-09-16T07:53:04.278875+0000","last_fullsized":"2024-09-16T07:53:04.278875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.004830+0000","last_change":"2024-09-16T07:51:38.154961+0000","last_active":"2024-09-16T07:51:53.004830+0000","last_peered":"2024-09-16T07:51:53.004830+0000","last_clean":"2024-09-16T07:51:53.004830+0000","last_became_active":"2024-09-16T07:51:38.134473+0000","last_became_peered":"2024-09-16T07:51:38.134473+0000","last_unstale":"2024-09-16T07:52:29.000749+0000","last_undegraded":"2024-09-16T07:51:53.004830+0000","last_fullsized":"2024-09-16T07:51:53.004830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"84'454","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.775210+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:05.775210+0000","last_peered":"2024-09-16T07:53:05.775210+0000","last_clean":"2024-09-16T07:53:05.775210+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:05.775210+0000","last_undegraded":"2024-09-16T07:53:05.775210+0000","last_fullsized":"2024-09-16T07:53:05.775210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":29056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"82'341","reported_seq":395,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:56.948374+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:52:56.948374+0000","last_peered":"2024-09-16T07:52:56.948374+0000","last_clean":"2024-09-16T07:52:56.948374+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:52:56.948374+0000","last_undegraded":"2024-09-16T07:52:56.948374+0000","last_fullsized":"2024-09-16T07:52:56.948374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.001102+0000","last_change":"2024-09-16T07:51:38.169785+0000","last_active":"2024-09-16T07:51:53.001102+0000","last_peered":"2024-09-16T07:51:53.001102+0000","last_clean":"2024-09-16T07:51:53.001102+0000","last_became_active":"2024-09-16T07:51:38.149919+0000","last_became_peered":"2024-09-16T07:51:38.149919+0000","last_unstale":"2024-09-16T07:52:29.000752+0000","last_undegraded":"2024-09-16T07:51:53.001102+0000","last_fullsized":"2024-09-16T07:51:53.001102+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"84'472","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.769668+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:53:05.769668+0000","last_peered":"2024-09-16T07:53:05.769668+0000","last_clean":"2024-09-16T07:53:05.769668+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:53:05.769668+0000","last_undegraded":"2024-09-16T07:53:05.769668+0000","last_fullsized":"2024-09-16T07:53:05.769668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.031381+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:04.031381+0000","last_peered":"2024-09-16T07:53:04.031381+0000","last_clean":"2024-09-16T07:53:04.031381+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:53:04.031381+0000","last_undegraded":"2024-09-16T07:53:04.031381+0000","last_fullsized":"2024-09-16T07:53:04.031381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":201,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.026027+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:52:53.026027+0000","last_peered":"2024-09-16T07:52:53.026027+0000","last_clean":"2024-09-16T07:52:53.026027+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:52:53.026027+0000","last_undegraded":"2024-09-16T07:52:53.026027+0000","last_fullsized":"2024-09-16T07:52:53.026027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"68'1","reported_seq":22,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.000096+0000","last_change":"2024-09-16T07:51:38.120872+0000","last_active":"2024-09-16T07:51:53.000096+0000","last_peered":"2024-09-16T07:51:53.000096+0000","last_clean":"2024-09-16T07:51:53.000096+0000","last_became_active":"2024-09-16T07:51:38.110191+0000","last_became_peered":"2024-09-16T07:51:38.110191+0000","last_unstale":"2024-09-16T07:52:29.000762+0000","last_undegraded":"2024-09-16T07:51:53.000096+0000","last_fullsized":"2024-09-16T07:51:53.000096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002784+0000","last_change":"2024-09-16T07:51:28.108718+0000","last_active":"2024-09-16T07:51:53.002784+0000","last_peered":"2024-09-16T07:51:53.002784+0000","last_clean":"2024-09-16T07:51:53.002784+0000","last_became_active":"2024-09-16T07:51:27.518387+0000","last_became_peered":"2024-09-16T07:51:27.518387+0000","last_unstale":"2024-09-16T07:52:29.000764+0000","last_undegraded":"2024-09-16T07:51:53.002784+0000","last_fullsized":"2024-09-16T07:51:53.002784+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"84'412","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.580277+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:05.580277+0000","last_peered":"2024-09-16T07:53:05.580277+0000","last_clean":"2024-09-16T07:53:05.580277+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:05.580277+0000","last_undegraded":"2024-09-16T07:53:05.580277+0000","last_fullsized":"2024-09-16T07:53:05.580277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":188,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.022681+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:52:53.022681+0000","last_peered":"2024-09-16T07:52:53.022681+0000","last_clean":"2024-09-16T07:52:53.022681+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:52:53.022681+0000","last_undegraded":"2024-09-16T07:52:53.022681+0000","last_fullsized":"2024-09-16T07:52:53.022681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"84'421","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.684454+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:53:05.684454+0000","last_peered":"2024-09-16T07:53:05.684454+0000","last_clean":"2024-09-16T07:53:05.684454+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:53:05.684454+0000","last_undegraded":"2024-09-16T07:53:05.684454+0000","last_fullsized":"2024-09-16T07:53:05.684454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":94,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:52.995846+0000","last_change":"2024-09-16T07:51:28.114509+0000","last_active":"2024-09-16T07:51:52.995846+0000","last_peered":"2024-09-16T07:51:52.995846+0000","last_clean":"2024-09-16T07:51:52.995846+0000","last_became_active":"2024-09-16T07:51:27.459621+0000","last_became_peered":"2024-09-16T07:51:27.459621+0000","last_unstale":"2024-09-16T07:52:29.000766+0000","last_undegraded":"2024-09-16T07:51:52.995846+0000","last_fullsized":"2024-09-16T07:51:52.995846+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"84'427","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.730196+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:53:05.730196+0000","last_peered":"2024-09-16T07:53:05.730196+0000","last_clean":"2024-09-16T07:53:05.730196+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:53:05.730196+0000","last_undegraded":"2024-09-16T07:53:05.730196+0000","last_fullsized":"2024-09-16T07:53:05.730196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.066207+0000","last_change":"2024-09-16T07:52:53.041802+0000","last_active":"2024-09-16T07:53:05.066207+0000","last_peered":"2024-09-16T07:53:05.066207+0000","last_clean":"2024-09-16T07:53:05.066207+0000","last_became_active":"2024-09-16T07:52:52.207206+0000","last_became_peered":"2024-09-16T07:52:52.207206+0000","last_unstale":"2024-09-16T07:53:05.066207+0000","last_undegraded":"2024-09-16T07:53:05.066207+0000","last_fullsized":"2024-09-16T07:53:05.066207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"68'2","reported_seq":23,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.003297+0000","last_change":"2024-09-16T07:51:38.164960+0000","last_active":"2024-09-16T07:51:53.003297+0000","last_peered":"2024-09-16T07:51:53.003297+0000","last_clean":"2024-09-16T07:51:53.003297+0000","last_became_active":"2024-09-16T07:51:38.140920+0000","last_became_peered":"2024-09-16T07:51:38.140920+0000","last_unstale":"2024-09-16T07:52:29.000774+0000","last_undegraded":"2024-09-16T07:51:53.003297+0000","last_fullsized":"2024-09-16T07:51:53.003297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.032992+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:04.032992+0000","last_peered":"2024-09-16T07:53:04.032992+0000","last_clean":"2024-09-16T07:53:04.032992+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:53:04.032992+0000","last_undegraded":"2024-09-16T07:53:04.032992+0000","last_fullsized":"2024-09-16T07:53:04.032992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"83'435","reported_seq":494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.197911+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:04.197911+0000","last_peered":"2024-09-16T07:53:04.197911+0000","last_clean":"2024-09-16T07:53:04.197911+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:53:04.197911+0000","last_undegraded":"2024-09-16T07:53:04.197911+0000","last_fullsized":"2024-09-16T07:53:04.197911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.058500+0000","last_change":"2024-09-16T07:52:53.038857+0000","last_active":"2024-09-16T07:53:05.058500+0000","last_peered":"2024-09-16T07:53:05.058500+0000","last_clean":"2024-09-16T07:53:05.058500+0000","last_became_active":"2024-09-16T07:52:52.148242+0000","last_became_peered":"2024-09-16T07:52:52.148242+0000","last_unstale":"2024-09-16T07:53:05.058500+0000","last_undegraded":"2024-09-16T07:53:05.058500+0000","last_fullsized":"2024-09-16T07:53:05.058500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"68'3","reported_seq":24,"reported_epoch":71,"state":"stale+active+clean","last_fresh":"2024-09-16T07:51:53.002351+0000","last_change":"2024-09-16T07:51:38.145559+0000","last_active":"2024-09-16T07:51:53.002351+0000","last_peered":"2024-09-16T07:51:53.002351+0000","last_clean":"2024-09-16T07:51:53.002351+0000","last_became_active":"2024-09-16T07:51:38.123189+0000","last_became_peered":"2024-09-16T07:51:38.123189+0000","last_unstale":"2024-09-16T07:52:29.000775+0000","last_undegraded":"2024-09-16T07:51:53.002351+0000","last_fullsized":"2024-09-16T07:51:53.002351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.019915+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:52:53.019915+0000","last_peered":"2024-09-16T07:52:53.019915+0000","last_clean":"2024-09-16T07:52:53.019915+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:52:53.019915+0000","last_undegraded":"2024-09-16T07:52:53.019915+0000","last_fullsized":"2024-09-16T07:52:53.019915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":254607360,"num_objects":3885,"num_object_clones":0,"num_object_copies":11655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3885,"num_write_kb":248640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59322368,"data_stored":949157888,"data_compressed":45068600,"data_compressed_allocated":59322368,"data_compressed_original":949157888,"omap_allocated":0,"internal_metadata":0},"log_size":3885,"ondisk_log_size":3885,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60688,"kb_used_data":19328,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94311152,"statfs":{"total":96636764160,"available":96574619648,"internally_reserved":0,"allocated":19791872,"data_stored":305604333,"data_compressed":14500060,"data_compressed_allocated":19087360,"data_compressed_original":305315840,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62840,"kb_used_data":25832,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94309000,"statfs":{"total":96636764160,"available":96572416000,"internally_reserved":0,"allocated":26451968,"data_stored":411844754,"data_compressed":19544411,"data_compressed_allocated":25726976,"data_compressed_original":411549696,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50588,"kb_used_data":14348,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94321252,"statfs":{"total":96636764160,"available":96584962048,"internally_reserved":0,"allocated":14692352,"data_stored":224339168,"data_compressed":10639243,"data_compressed_allocated":14004224,"data_compressed_original":224067584,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":62,"seq":266287972382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43684,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94328156,"statfs":{"total":96636764160,"available":96592031744,"internally_reserved":0,"allocated":741376,"data_stored":2133457,"data_compressed":92233,"data_compressed_allocated":122880,"data_compressed_original":1884160,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":1310720,"data_compressed":62192,"data_compressed_allocated":81920,"data_compressed_original":1310720,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14024704,"data_stored":224395264,"data_compressed":10654803,"data_compressed_allocated":14024704,"data_compressed_original":224395264,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25759744,"data_stored":412155904,"data_compressed":19570386,"data_compressed_allocated":25759744,"data_compressed_original":412155904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":311296000,"data_compressed":14781219,"data_compressed_allocated":19456000,"data_compressed_original":311296000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:22.188 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:53:22.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:22.336+0000 7fcd23791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:22.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:22.347+0000 7fcd23791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:22.717 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:22.791 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:22.791 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":504,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":86,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473171,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":25}],"num_pgs":25,"num_pools":3,"num_objects":6327,"data_bytes":414908992,"bytes_used":240955392,"bytes_avail":386306101248,"bytes_total":386547056640,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":49142,"recovering_keys_per_sec":0,"num_objects_recovered":9,"num_bytes_recovered":589824,"num_keys_recovered":0,"read_bytes_sec":85,"write_bytes_sec":18761423,"read_op_per_sec":0,"write_op_per_sec":369},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:53:22.811 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:53:22.811 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:22.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:22.887+0000 7fecdbe63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:22.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:22.900+0000 7fecdbe63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:22.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:22.970+0000 7fc257791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:22.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:22.981+0000 7fc257791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:23.281 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:23.281 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:53:23.296 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-16T07:53:22.395862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":414908992,"num_objects":6327,"num_object_clones":0,"num_object_copies":18981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":8401,"num_write_kb":469652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8390,"ondisk_log_size":8390,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":235308,"kb_used_data":78764,"kb_used_omap":0,"kb_used_meta":156480,"kb_avail":377252052,"statfs":{"total":386547056640,"available":386306101248,"internally_reserved":0,"allocated":80654336,"data_stored":1245570715,"data_compressed":59097419,"data_compressed_allocated":77791232,"data_compressed_original":1244413952,"omap_allocated":0,"internal_metadata":160235520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":159711256,"num_objects":2438,"num_object_clones":0,"num_object_copies":7314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4436,"num_write_kb":219905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":589824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002432"},"pg_stats":[{"pgid":"5.f","version":"84'451","reported_seq":518,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.443382+0000","last_change":"2024-09-16T07:52:52.214675+0000","last_active":"2024-09-16T07:53:05.443382+0000","last_peered":"2024-09-16T07:53:05.443382+0000","last_clean":"2024-09-16T07:53:05.443382+0000","last_became_active":"2024-09-16T07:52:52.199189+0000","last_became_peered":"2024-09-16T07:52:52.199189+0000","last_unstale":"2024-09-16T07:53:05.443382+0000","last_undegraded":"2024-09-16T07:53:05.443382+0000","last_fullsized":"2024-09-16T07:53:05.443382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"86'704","reported_seq":768,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.491286+0000","last_change":"2024-09-16T07:52:52.277260+0000","last_active":"2024-09-16T07:53:20.491286+0000","last_peered":"2024-09-16T07:53:20.491286+0000","last_clean":"2024-09-16T07:53:20.491286+0000","last_became_active":"2024-09-16T07:52:52.262891+0000","last_became_peered":"2024-09-16T07:52:52.262891+0000","last_unstale":"2024-09-16T07:53:20.491286+0000","last_undegraded":"2024-09-16T07:53:20.491286+0000","last_fullsized":"2024-09-16T07:53:20.491286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"86'605","reported_seq":670,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.423521+0000","last_change":"2024-09-16T07:52:52.289123+0000","last_active":"2024-09-16T07:53:20.423521+0000","last_peered":"2024-09-16T07:53:20.423521+0000","last_clean":"2024-09-16T07:53:20.423521+0000","last_became_active":"2024-09-16T07:52:52.272220+0000","last_became_peered":"2024-09-16T07:52:52.272220+0000","last_unstale":"2024-09-16T07:53:20.423521+0000","last_undegraded":"2024-09-16T07:53:20.423521+0000","last_fullsized":"2024-09-16T07:53:20.423521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971544,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":603,"num_write_kb":29505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"83'461","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.278875+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:04.278875+0000","last_peered":"2024-09-16T07:53:04.278875+0000","last_clean":"2024-09-16T07:53:04.278875+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:53:04.278875+0000","last_undegraded":"2024-09-16T07:53:04.278875+0000","last_fullsized":"2024-09-16T07:53:04.278875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"86'642","reported_seq":711,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.415550+0000","last_change":"2024-09-16T07:52:52.234905+0000","last_active":"2024-09-16T07:53:20.415550+0000","last_peered":"2024-09-16T07:53:20.415550+0000","last_clean":"2024-09-16T07:53:20.415550+0000","last_became_active":"2024-09-16T07:52:52.218746+0000","last_became_peered":"2024-09-16T07:52:52.218746+0000","last_unstale":"2024-09-16T07:53:20.415550+0000","last_undegraded":"2024-09-16T07:53:20.415550+0000","last_fullsized":"2024-09-16T07:53:20.415550+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24379392,"num_objects":372,"num_object_clones":0,"num_object_copies":1116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"84'454","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.775210+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:05.775210+0000","last_peered":"2024-09-16T07:53:05.775210+0000","last_clean":"2024-09-16T07:53:05.775210+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:05.775210+0000","last_undegraded":"2024-09-16T07:53:05.775210+0000","last_fullsized":"2024-09-16T07:53:05.775210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":29056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"82'341","reported_seq":395,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:56.948374+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:52:56.948374+0000","last_peered":"2024-09-16T07:52:56.948374+0000","last_clean":"2024-09-16T07:52:56.948374+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:52:56.948374+0000","last_undegraded":"2024-09-16T07:52:56.948374+0000","last_fullsized":"2024-09-16T07:52:56.948374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"86'582","reported_seq":651,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.190824+0000","last_change":"2024-09-16T07:52:52.200280+0000","last_active":"2024-09-16T07:53:20.190824+0000","last_peered":"2024-09-16T07:53:20.190824+0000","last_clean":"2024-09-16T07:53:20.190824+0000","last_became_active":"2024-09-16T07:52:52.189353+0000","last_became_peered":"2024-09-16T07:52:52.189353+0000","last_unstale":"2024-09-16T07:53:20.190824+0000","last_undegraded":"2024-09-16T07:53:20.190824+0000","last_fullsized":"2024-09-16T07:53:20.190824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":29312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"84'472","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.769668+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:53:05.769668+0000","last_peered":"2024-09-16T07:53:05.769668+0000","last_clean":"2024-09-16T07:53:05.769668+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:53:05.769668+0000","last_undegraded":"2024-09-16T07:53:05.769668+0000","last_fullsized":"2024-09-16T07:53:05.769668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.031381+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:04.031381+0000","last_peered":"2024-09-16T07:53:04.031381+0000","last_clean":"2024-09-16T07:53:04.031381+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:53:04.031381+0000","last_undegraded":"2024-09-16T07:53:04.031381+0000","last_fullsized":"2024-09-16T07:53:04.031381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":201,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.026027+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:52:53.026027+0000","last_peered":"2024-09-16T07:52:53.026027+0000","last_clean":"2024-09-16T07:52:53.026027+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:52:53.026027+0000","last_undegraded":"2024-09-16T07:52:53.026027+0000","last_fullsized":"2024-09-16T07:52:53.026027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"86'636","reported_seq":705,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.370448+0000","last_change":"2024-09-16T07:52:52.282162+0000","last_active":"2024-09-16T07:53:20.370448+0000","last_peered":"2024-09-16T07:53:20.370448+0000","last_clean":"2024-09-16T07:53:20.370448+0000","last_became_active":"2024-09-16T07:52:52.259966+0000","last_became_peered":"2024-09-16T07:52:52.259966+0000","last_unstale":"2024-09-16T07:53:20.370448+0000","last_undegraded":"2024-09-16T07:53:20.370448+0000","last_fullsized":"2024-09-16T07:53:20.370448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":634,"num_write_kb":31168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.089151+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:53:07.089151+0000","last_peered":"2024-09-16T07:53:07.089151+0000","last_clean":"2024-09-16T07:53:07.089151+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:53:07.089151+0000","last_undegraded":"2024-09-16T07:53:07.089151+0000","last_fullsized":"2024-09-16T07:53:07.089151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"84'412","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.580277+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:05.580277+0000","last_peered":"2024-09-16T07:53:05.580277+0000","last_clean":"2024-09-16T07:53:05.580277+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:05.580277+0000","last_undegraded":"2024-09-16T07:53:05.580277+0000","last_fullsized":"2024-09-16T07:53:05.580277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":188,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.022681+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:52:53.022681+0000","last_peered":"2024-09-16T07:52:53.022681+0000","last_clean":"2024-09-16T07:52:53.022681+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:52:53.022681+0000","last_undegraded":"2024-09-16T07:52:53.022681+0000","last_fullsized":"2024-09-16T07:52:53.022681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"84'421","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.684454+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:53:05.684454+0000","last_peered":"2024-09-16T07:53:05.684454+0000","last_clean":"2024-09-16T07:53:05.684454+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:53:05.684454+0000","last_undegraded":"2024-09-16T07:53:05.684454+0000","last_fullsized":"2024-09-16T07:53:05.684454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":138,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.084006+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:53:07.084006+0000","last_peered":"2024-09-16T07:53:07.084006+0000","last_clean":"2024-09-16T07:53:07.084006+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:53:07.084006+0000","last_undegraded":"2024-09-16T07:53:07.084006+0000","last_fullsized":"2024-09-16T07:53:07.084006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"84'427","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.730196+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:53:05.730196+0000","last_peered":"2024-09-16T07:53:05.730196+0000","last_clean":"2024-09-16T07:53:05.730196+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:53:05.730196+0000","last_undegraded":"2024-09-16T07:53:05.730196+0000","last_fullsized":"2024-09-16T07:53:05.730196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.066207+0000","last_change":"2024-09-16T07:52:53.041802+0000","last_active":"2024-09-16T07:53:05.066207+0000","last_peered":"2024-09-16T07:53:05.066207+0000","last_clean":"2024-09-16T07:53:05.066207+0000","last_became_active":"2024-09-16T07:52:52.207206+0000","last_became_peered":"2024-09-16T07:52:52.207206+0000","last_unstale":"2024-09-16T07:53:05.066207+0000","last_undegraded":"2024-09-16T07:53:05.066207+0000","last_fullsized":"2024-09-16T07:53:05.066207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"86'652","reported_seq":723,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.569041+0000","last_change":"2024-09-16T07:52:52.205171+0000","last_active":"2024-09-16T07:53:20.569041+0000","last_peered":"2024-09-16T07:53:20.569041+0000","last_clean":"2024-09-16T07:53:20.569041+0000","last_became_active":"2024-09-16T07:52:52.197079+0000","last_became_peered":"2024-09-16T07:52:52.197079+0000","last_unstale":"2024-09-16T07:53:20.569041+0000","last_undegraded":"2024-09-16T07:53:20.569041+0000","last_fullsized":"2024-09-16T07:53:20.569041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":352,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.032992+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:04.032992+0000","last_peered":"2024-09-16T07:53:04.032992+0000","last_clean":"2024-09-16T07:53:04.032992+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:53:04.032992+0000","last_undegraded":"2024-09-16T07:53:04.032992+0000","last_fullsized":"2024-09-16T07:53:04.032992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"83'435","reported_seq":494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.197911+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:04.197911+0000","last_peered":"2024-09-16T07:53:04.197911+0000","last_clean":"2024-09-16T07:53:04.197911+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:53:04.197911+0000","last_undegraded":"2024-09-16T07:53:04.197911+0000","last_fullsized":"2024-09-16T07:53:04.197911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.058500+0000","last_change":"2024-09-16T07:52:53.038857+0000","last_active":"2024-09-16T07:53:05.058500+0000","last_peered":"2024-09-16T07:53:05.058500+0000","last_clean":"2024-09-16T07:53:05.058500+0000","last_became_active":"2024-09-16T07:52:52.148242+0000","last_became_peered":"2024-09-16T07:52:52.148242+0000","last_unstale":"2024-09-16T07:53:05.058500+0000","last_undegraded":"2024-09-16T07:53:05.058500+0000","last_fullsized":"2024-09-16T07:53:05.058500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"86'640","reported_seq":719,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.552990+0000","last_change":"2024-09-16T07:52:52.541645+0000","last_active":"2024-09-16T07:53:20.552990+0000","last_peered":"2024-09-16T07:53:20.552990+0000","last_clean":"2024-09-16T07:53:20.552990+0000","last_became_active":"2024-09-16T07:52:52.268878+0000","last_became_peered":"2024-09-16T07:52:52.268878+0000","last_unstale":"2024-09-16T07:53:20.552990+0000","last_undegraded":"2024-09-16T07:53:20.552990+0000","last_fullsized":"2024-09-16T07:53:20.552990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.019915+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:52:53.019915+0000","last_peered":"2024-09-16T07:52:53.019915+0000","last_clean":"2024-09-16T07:52:53.019915+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:52:53.019915+0000","last_undegraded":"2024-09-16T07:52:53.019915+0000","last_fullsized":"2024-09-16T07:52:53.019915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":414318616,"num_objects":6323,"num_object_clones":0,"num_object_copies":18969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8321,"num_write_kb":468545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77832192,"data_stored":1245249560,"data_compressed":59128664,"data_compressed_allocated":77828096,"data_compressed_original":1245249536,"omap_allocated":0,"internal_metadata":0},"log_size":8335,"ondisk_log_size":8335,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60688,"kb_used_data":19328,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94311152,"statfs":{"total":96636764160,"available":96574619648,"internally_reserved":0,"allocated":19791872,"data_stored":305604333,"data_compressed":14500060,"data_compressed_allocated":19087360,"data_compressed_original":305315840,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62840,"kb_used_data":25832,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94309000,"statfs":{"total":96636764160,"available":96572416000,"internally_reserved":0,"allocated":26451968,"data_stored":411844754,"data_compressed":19544411,"data_compressed_allocated":25726976,"data_compressed_original":411549696,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50588,"kb_used_data":14348,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94321252,"statfs":{"total":96636764160,"available":96584962048,"internally_reserved":0,"allocated":14692352,"data_stored":224339168,"data_compressed":10639243,"data_compressed_allocated":14004224,"data_compressed_original":224067584,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61192,"kb_used_data":19256,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94310648,"statfs":{"total":96636764160,"available":96574103552,"internally_reserved":0,"allocated":19718144,"data_stored":303782460,"data_compressed":14413705,"data_compressed_allocated":18972672,"data_compressed_original":303480832,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18591744,"data_stored":297402392,"data_compressed":14122256,"data_compressed_allocated":18587648,"data_compressed_original":297402368,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14024704,"data_stored":224395264,"data_compressed":10654803,"data_compressed_allocated":14024704,"data_compressed_original":224395264,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25759744,"data_stored":412155904,"data_compressed":19570386,"data_compressed_allocated":25759744,"data_compressed_original":412155904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":311296000,"data_compressed":14781219,"data_compressed_allocated":19456000,"data_compressed_original":311296000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:25.347 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:25.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:25.519+0000 7f4ac985c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:25.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:25.527+0000 7f4ac985c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:26.297 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:26.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:26.432+0000 7f306a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:26.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:26.443+0000 7f306a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:26.713 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:26.713 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:53:26.736 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-16T07:53:26.396630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":414908992,"num_objects":6327,"num_object_clones":0,"num_object_copies":18981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":8401,"num_write_kb":469652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8390,"ondisk_log_size":8390,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":235308,"kb_used_data":78764,"kb_used_omap":0,"kb_used_meta":156480,"kb_avail":377252052,"statfs":{"total":386547056640,"available":386306101248,"internally_reserved":0,"allocated":80654336,"data_stored":1245570715,"data_compressed":59097419,"data_compressed_allocated":77791232,"data_compressed_original":1244413952,"omap_allocated":0,"internal_metadata":160235520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":159711256,"num_objects":2438,"num_object_clones":0,"num_object_copies":7314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4436,"num_write_kb":219905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":589824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002346"},"pg_stats":[{"pgid":"5.f","version":"84'451","reported_seq":518,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.443382+0000","last_change":"2024-09-16T07:52:52.214675+0000","last_active":"2024-09-16T07:53:05.443382+0000","last_peered":"2024-09-16T07:53:05.443382+0000","last_clean":"2024-09-16T07:53:05.443382+0000","last_became_active":"2024-09-16T07:52:52.199189+0000","last_became_peered":"2024-09-16T07:52:52.199189+0000","last_unstale":"2024-09-16T07:53:05.443382+0000","last_undegraded":"2024-09-16T07:53:05.443382+0000","last_fullsized":"2024-09-16T07:53:05.443382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"86'704","reported_seq":768,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.491286+0000","last_change":"2024-09-16T07:52:52.277260+0000","last_active":"2024-09-16T07:53:20.491286+0000","last_peered":"2024-09-16T07:53:20.491286+0000","last_clean":"2024-09-16T07:53:20.491286+0000","last_became_active":"2024-09-16T07:52:52.262891+0000","last_became_peered":"2024-09-16T07:52:52.262891+0000","last_unstale":"2024-09-16T07:53:20.491286+0000","last_undegraded":"2024-09-16T07:53:20.491286+0000","last_fullsized":"2024-09-16T07:53:20.491286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"86'605","reported_seq":670,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.423521+0000","last_change":"2024-09-16T07:52:52.289123+0000","last_active":"2024-09-16T07:53:20.423521+0000","last_peered":"2024-09-16T07:53:20.423521+0000","last_clean":"2024-09-16T07:53:20.423521+0000","last_became_active":"2024-09-16T07:52:52.272220+0000","last_became_peered":"2024-09-16T07:52:52.272220+0000","last_unstale":"2024-09-16T07:53:20.423521+0000","last_undegraded":"2024-09-16T07:53:20.423521+0000","last_fullsized":"2024-09-16T07:53:20.423521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971544,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":603,"num_write_kb":29505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"83'461","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.278875+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:04.278875+0000","last_peered":"2024-09-16T07:53:04.278875+0000","last_clean":"2024-09-16T07:53:04.278875+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:53:04.278875+0000","last_undegraded":"2024-09-16T07:53:04.278875+0000","last_fullsized":"2024-09-16T07:53:04.278875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"86'642","reported_seq":711,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.415550+0000","last_change":"2024-09-16T07:52:52.234905+0000","last_active":"2024-09-16T07:53:20.415550+0000","last_peered":"2024-09-16T07:53:20.415550+0000","last_clean":"2024-09-16T07:53:20.415550+0000","last_became_active":"2024-09-16T07:52:52.218746+0000","last_became_peered":"2024-09-16T07:52:52.218746+0000","last_unstale":"2024-09-16T07:53:20.415550+0000","last_undegraded":"2024-09-16T07:53:20.415550+0000","last_fullsized":"2024-09-16T07:53:20.415550+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24379392,"num_objects":372,"num_object_clones":0,"num_object_copies":1116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"84'454","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.775210+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:05.775210+0000","last_peered":"2024-09-16T07:53:05.775210+0000","last_clean":"2024-09-16T07:53:05.775210+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:05.775210+0000","last_undegraded":"2024-09-16T07:53:05.775210+0000","last_fullsized":"2024-09-16T07:53:05.775210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":29056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"82'341","reported_seq":395,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:56.948374+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:52:56.948374+0000","last_peered":"2024-09-16T07:52:56.948374+0000","last_clean":"2024-09-16T07:52:56.948374+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:52:56.948374+0000","last_undegraded":"2024-09-16T07:52:56.948374+0000","last_fullsized":"2024-09-16T07:52:56.948374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"86'582","reported_seq":651,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.190824+0000","last_change":"2024-09-16T07:52:52.200280+0000","last_active":"2024-09-16T07:53:20.190824+0000","last_peered":"2024-09-16T07:53:20.190824+0000","last_clean":"2024-09-16T07:53:20.190824+0000","last_became_active":"2024-09-16T07:52:52.189353+0000","last_became_peered":"2024-09-16T07:52:52.189353+0000","last_unstale":"2024-09-16T07:53:20.190824+0000","last_undegraded":"2024-09-16T07:53:20.190824+0000","last_fullsized":"2024-09-16T07:53:20.190824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":29312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"84'472","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.769668+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:53:05.769668+0000","last_peered":"2024-09-16T07:53:05.769668+0000","last_clean":"2024-09-16T07:53:05.769668+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:53:05.769668+0000","last_undegraded":"2024-09-16T07:53:05.769668+0000","last_fullsized":"2024-09-16T07:53:05.769668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.031381+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:04.031381+0000","last_peered":"2024-09-16T07:53:04.031381+0000","last_clean":"2024-09-16T07:53:04.031381+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:53:04.031381+0000","last_undegraded":"2024-09-16T07:53:04.031381+0000","last_fullsized":"2024-09-16T07:53:04.031381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":201,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.026027+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:52:53.026027+0000","last_peered":"2024-09-16T07:52:53.026027+0000","last_clean":"2024-09-16T07:52:53.026027+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:52:53.026027+0000","last_undegraded":"2024-09-16T07:52:53.026027+0000","last_fullsized":"2024-09-16T07:52:53.026027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"86'636","reported_seq":705,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.370448+0000","last_change":"2024-09-16T07:52:52.282162+0000","last_active":"2024-09-16T07:53:20.370448+0000","last_peered":"2024-09-16T07:53:20.370448+0000","last_clean":"2024-09-16T07:53:20.370448+0000","last_became_active":"2024-09-16T07:52:52.259966+0000","last_became_peered":"2024-09-16T07:52:52.259966+0000","last_unstale":"2024-09-16T07:53:20.370448+0000","last_undegraded":"2024-09-16T07:53:20.370448+0000","last_fullsized":"2024-09-16T07:53:20.370448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":634,"num_write_kb":31168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.089151+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:53:07.089151+0000","last_peered":"2024-09-16T07:53:07.089151+0000","last_clean":"2024-09-16T07:53:07.089151+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:53:07.089151+0000","last_undegraded":"2024-09-16T07:53:07.089151+0000","last_fullsized":"2024-09-16T07:53:07.089151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"84'412","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.580277+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:05.580277+0000","last_peered":"2024-09-16T07:53:05.580277+0000","last_clean":"2024-09-16T07:53:05.580277+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:05.580277+0000","last_undegraded":"2024-09-16T07:53:05.580277+0000","last_fullsized":"2024-09-16T07:53:05.580277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":188,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.022681+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:52:53.022681+0000","last_peered":"2024-09-16T07:52:53.022681+0000","last_clean":"2024-09-16T07:52:53.022681+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:52:53.022681+0000","last_undegraded":"2024-09-16T07:52:53.022681+0000","last_fullsized":"2024-09-16T07:52:53.022681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"84'421","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.684454+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:53:05.684454+0000","last_peered":"2024-09-16T07:53:05.684454+0000","last_clean":"2024-09-16T07:53:05.684454+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:53:05.684454+0000","last_undegraded":"2024-09-16T07:53:05.684454+0000","last_fullsized":"2024-09-16T07:53:05.684454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":138,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.084006+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:53:07.084006+0000","last_peered":"2024-09-16T07:53:07.084006+0000","last_clean":"2024-09-16T07:53:07.084006+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:53:07.084006+0000","last_undegraded":"2024-09-16T07:53:07.084006+0000","last_fullsized":"2024-09-16T07:53:07.084006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"84'427","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.730196+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:53:05.730196+0000","last_peered":"2024-09-16T07:53:05.730196+0000","last_clean":"2024-09-16T07:53:05.730196+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:53:05.730196+0000","last_undegraded":"2024-09-16T07:53:05.730196+0000","last_fullsized":"2024-09-16T07:53:05.730196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.066207+0000","last_change":"2024-09-16T07:52:53.041802+0000","last_active":"2024-09-16T07:53:05.066207+0000","last_peered":"2024-09-16T07:53:05.066207+0000","last_clean":"2024-09-16T07:53:05.066207+0000","last_became_active":"2024-09-16T07:52:52.207206+0000","last_became_peered":"2024-09-16T07:52:52.207206+0000","last_unstale":"2024-09-16T07:53:05.066207+0000","last_undegraded":"2024-09-16T07:53:05.066207+0000","last_fullsized":"2024-09-16T07:53:05.066207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"86'652","reported_seq":723,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.569041+0000","last_change":"2024-09-16T07:52:52.205171+0000","last_active":"2024-09-16T07:53:20.569041+0000","last_peered":"2024-09-16T07:53:20.569041+0000","last_clean":"2024-09-16T07:53:20.569041+0000","last_became_active":"2024-09-16T07:52:52.197079+0000","last_became_peered":"2024-09-16T07:52:52.197079+0000","last_unstale":"2024-09-16T07:53:20.569041+0000","last_undegraded":"2024-09-16T07:53:20.569041+0000","last_fullsized":"2024-09-16T07:53:20.569041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":352,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.032992+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:04.032992+0000","last_peered":"2024-09-16T07:53:04.032992+0000","last_clean":"2024-09-16T07:53:04.032992+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:53:04.032992+0000","last_undegraded":"2024-09-16T07:53:04.032992+0000","last_fullsized":"2024-09-16T07:53:04.032992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"83'435","reported_seq":494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.197911+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:04.197911+0000","last_peered":"2024-09-16T07:53:04.197911+0000","last_clean":"2024-09-16T07:53:04.197911+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:53:04.197911+0000","last_undegraded":"2024-09-16T07:53:04.197911+0000","last_fullsized":"2024-09-16T07:53:04.197911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.058500+0000","last_change":"2024-09-16T07:52:53.038857+0000","last_active":"2024-09-16T07:53:05.058500+0000","last_peered":"2024-09-16T07:53:05.058500+0000","last_clean":"2024-09-16T07:53:05.058500+0000","last_became_active":"2024-09-16T07:52:52.148242+0000","last_became_peered":"2024-09-16T07:52:52.148242+0000","last_unstale":"2024-09-16T07:53:05.058500+0000","last_undegraded":"2024-09-16T07:53:05.058500+0000","last_fullsized":"2024-09-16T07:53:05.058500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"86'640","reported_seq":719,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.552990+0000","last_change":"2024-09-16T07:52:52.541645+0000","last_active":"2024-09-16T07:53:20.552990+0000","last_peered":"2024-09-16T07:53:20.552990+0000","last_clean":"2024-09-16T07:53:20.552990+0000","last_became_active":"2024-09-16T07:52:52.268878+0000","last_became_peered":"2024-09-16T07:52:52.268878+0000","last_unstale":"2024-09-16T07:53:20.552990+0000","last_undegraded":"2024-09-16T07:53:20.552990+0000","last_fullsized":"2024-09-16T07:53:20.552990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.019915+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:52:53.019915+0000","last_peered":"2024-09-16T07:52:53.019915+0000","last_clean":"2024-09-16T07:52:53.019915+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:52:53.019915+0000","last_undegraded":"2024-09-16T07:52:53.019915+0000","last_fullsized":"2024-09-16T07:52:53.019915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":414318616,"num_objects":6323,"num_object_clones":0,"num_object_copies":18969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8321,"num_write_kb":468545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77832192,"data_stored":1245249560,"data_compressed":59128664,"data_compressed_allocated":77828096,"data_compressed_original":1245249536,"omap_allocated":0,"internal_metadata":0},"log_size":8335,"ondisk_log_size":8335,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60688,"kb_used_data":19328,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94311152,"statfs":{"total":96636764160,"available":96574619648,"internally_reserved":0,"allocated":19791872,"data_stored":305604333,"data_compressed":14500060,"data_compressed_allocated":19087360,"data_compressed_original":305315840,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62840,"kb_used_data":25832,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94309000,"statfs":{"total":96636764160,"available":96572416000,"internally_reserved":0,"allocated":26451968,"data_stored":411844754,"data_compressed":19544411,"data_compressed_allocated":25726976,"data_compressed_original":411549696,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50588,"kb_used_data":14348,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94321252,"statfs":{"total":96636764160,"available":96584962048,"internally_reserved":0,"allocated":14692352,"data_stored":224339168,"data_compressed":10639243,"data_compressed_allocated":14004224,"data_compressed_original":224067584,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61192,"kb_used_data":19256,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94310648,"statfs":{"total":96636764160,"available":96574103552,"internally_reserved":0,"allocated":19718144,"data_stored":303782460,"data_compressed":14413705,"data_compressed_allocated":18972672,"data_compressed_original":303480832,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18591744,"data_stored":297402392,"data_compressed":14122256,"data_compressed_allocated":18587648,"data_compressed_original":297402368,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14024704,"data_stored":224395264,"data_compressed":10654803,"data_compressed_allocated":14024704,"data_compressed_original":224395264,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25759744,"data_stored":412155904,"data_compressed":19570386,"data_compressed_allocated":25759744,"data_compressed_original":412155904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":311296000,"data_compressed":14781219,"data_compressed_allocated":19456000,"data_compressed_original":311296000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:26.737 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:53:26.737 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:53:26.738 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:26.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:26.908+0000 7ff5c0d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:26.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:26.923+0000 7ff5c0d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:27.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:27.316 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:53:27.332 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-16T07:53:26.396630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":414908992,"num_objects":6327,"num_object_clones":0,"num_object_copies":18981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":8401,"num_write_kb":469652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8390,"ondisk_log_size":8390,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":235308,"kb_used_data":78764,"kb_used_omap":0,"kb_used_meta":156480,"kb_avail":377252052,"statfs":{"total":386547056640,"available":386306101248,"internally_reserved":0,"allocated":80654336,"data_stored":1245570715,"data_compressed":59097419,"data_compressed_allocated":77791232,"data_compressed_original":1244413952,"omap_allocated":0,"internal_metadata":160235520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":159711256,"num_objects":2438,"num_object_clones":0,"num_object_copies":7314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4436,"num_write_kb":219905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":589824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002346"},"pg_stats":[{"pgid":"5.f","version":"84'451","reported_seq":518,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.443382+0000","last_change":"2024-09-16T07:52:52.214675+0000","last_active":"2024-09-16T07:53:05.443382+0000","last_peered":"2024-09-16T07:53:05.443382+0000","last_clean":"2024-09-16T07:53:05.443382+0000","last_became_active":"2024-09-16T07:52:52.199189+0000","last_became_peered":"2024-09-16T07:52:52.199189+0000","last_unstale":"2024-09-16T07:53:05.443382+0000","last_undegraded":"2024-09-16T07:53:05.443382+0000","last_fullsized":"2024-09-16T07:53:05.443382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"86'704","reported_seq":768,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.491286+0000","last_change":"2024-09-16T07:52:52.277260+0000","last_active":"2024-09-16T07:53:20.491286+0000","last_peered":"2024-09-16T07:53:20.491286+0000","last_clean":"2024-09-16T07:53:20.491286+0000","last_became_active":"2024-09-16T07:52:52.262891+0000","last_became_peered":"2024-09-16T07:52:52.262891+0000","last_unstale":"2024-09-16T07:53:20.491286+0000","last_undegraded":"2024-09-16T07:53:20.491286+0000","last_fullsized":"2024-09-16T07:53:20.491286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"86'605","reported_seq":670,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.423521+0000","last_change":"2024-09-16T07:52:52.289123+0000","last_active":"2024-09-16T07:53:20.423521+0000","last_peered":"2024-09-16T07:53:20.423521+0000","last_clean":"2024-09-16T07:53:20.423521+0000","last_became_active":"2024-09-16T07:52:52.272220+0000","last_became_peered":"2024-09-16T07:52:52.272220+0000","last_unstale":"2024-09-16T07:53:20.423521+0000","last_undegraded":"2024-09-16T07:53:20.423521+0000","last_fullsized":"2024-09-16T07:53:20.423521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971544,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":603,"num_write_kb":29505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"83'461","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.278875+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:04.278875+0000","last_peered":"2024-09-16T07:53:04.278875+0000","last_clean":"2024-09-16T07:53:04.278875+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:53:04.278875+0000","last_undegraded":"2024-09-16T07:53:04.278875+0000","last_fullsized":"2024-09-16T07:53:04.278875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"86'642","reported_seq":711,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.415550+0000","last_change":"2024-09-16T07:52:52.234905+0000","last_active":"2024-09-16T07:53:20.415550+0000","last_peered":"2024-09-16T07:53:20.415550+0000","last_clean":"2024-09-16T07:53:20.415550+0000","last_became_active":"2024-09-16T07:52:52.218746+0000","last_became_peered":"2024-09-16T07:52:52.218746+0000","last_unstale":"2024-09-16T07:53:20.415550+0000","last_undegraded":"2024-09-16T07:53:20.415550+0000","last_fullsized":"2024-09-16T07:53:20.415550+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24379392,"num_objects":372,"num_object_clones":0,"num_object_copies":1116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"84'454","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.775210+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:05.775210+0000","last_peered":"2024-09-16T07:53:05.775210+0000","last_clean":"2024-09-16T07:53:05.775210+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:05.775210+0000","last_undegraded":"2024-09-16T07:53:05.775210+0000","last_fullsized":"2024-09-16T07:53:05.775210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":29056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"82'341","reported_seq":395,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:56.948374+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:52:56.948374+0000","last_peered":"2024-09-16T07:52:56.948374+0000","last_clean":"2024-09-16T07:52:56.948374+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:52:56.948374+0000","last_undegraded":"2024-09-16T07:52:56.948374+0000","last_fullsized":"2024-09-16T07:52:56.948374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":341,"num_write_kb":21824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"86'582","reported_seq":651,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.190824+0000","last_change":"2024-09-16T07:52:52.200280+0000","last_active":"2024-09-16T07:53:20.190824+0000","last_peered":"2024-09-16T07:53:20.190824+0000","last_clean":"2024-09-16T07:53:20.190824+0000","last_became_active":"2024-09-16T07:52:52.189353+0000","last_became_peered":"2024-09-16T07:52:52.189353+0000","last_unstale":"2024-09-16T07:53:20.190824+0000","last_undegraded":"2024-09-16T07:53:20.190824+0000","last_fullsized":"2024-09-16T07:53:20.190824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":29312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"84'472","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.769668+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:53:05.769668+0000","last_peered":"2024-09-16T07:53:05.769668+0000","last_clean":"2024-09-16T07:53:05.769668+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:53:05.769668+0000","last_undegraded":"2024-09-16T07:53:05.769668+0000","last_fullsized":"2024-09-16T07:53:05.769668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.031381+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:04.031381+0000","last_peered":"2024-09-16T07:53:04.031381+0000","last_clean":"2024-09-16T07:53:04.031381+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:53:04.031381+0000","last_undegraded":"2024-09-16T07:53:04.031381+0000","last_fullsized":"2024-09-16T07:53:04.031381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":201,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.026027+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:52:53.026027+0000","last_peered":"2024-09-16T07:52:53.026027+0000","last_clean":"2024-09-16T07:52:53.026027+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:52:53.026027+0000","last_undegraded":"2024-09-16T07:52:53.026027+0000","last_fullsized":"2024-09-16T07:52:53.026027+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"86'636","reported_seq":705,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.370448+0000","last_change":"2024-09-16T07:52:52.282162+0000","last_active":"2024-09-16T07:53:20.370448+0000","last_peered":"2024-09-16T07:53:20.370448+0000","last_clean":"2024-09-16T07:53:20.370448+0000","last_became_active":"2024-09-16T07:52:52.259966+0000","last_became_peered":"2024-09-16T07:52:52.259966+0000","last_unstale":"2024-09-16T07:53:20.370448+0000","last_undegraded":"2024-09-16T07:53:20.370448+0000","last_fullsized":"2024-09-16T07:53:20.370448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":634,"num_write_kb":31168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.089151+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:53:07.089151+0000","last_peered":"2024-09-16T07:53:07.089151+0000","last_clean":"2024-09-16T07:53:07.089151+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:53:07.089151+0000","last_undegraded":"2024-09-16T07:53:07.089151+0000","last_fullsized":"2024-09-16T07:53:07.089151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"84'412","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.580277+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:05.580277+0000","last_peered":"2024-09-16T07:53:05.580277+0000","last_clean":"2024-09-16T07:53:05.580277+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:05.580277+0000","last_undegraded":"2024-09-16T07:53:05.580277+0000","last_fullsized":"2024-09-16T07:53:05.580277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":188,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.022681+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:52:53.022681+0000","last_peered":"2024-09-16T07:52:53.022681+0000","last_clean":"2024-09-16T07:52:53.022681+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:52:53.022681+0000","last_undegraded":"2024-09-16T07:52:53.022681+0000","last_fullsized":"2024-09-16T07:52:53.022681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"84'421","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.684454+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:53:05.684454+0000","last_peered":"2024-09-16T07:53:05.684454+0000","last_clean":"2024-09-16T07:53:05.684454+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:53:05.684454+0000","last_undegraded":"2024-09-16T07:53:05.684454+0000","last_fullsized":"2024-09-16T07:53:05.684454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":138,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.084006+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:53:07.084006+0000","last_peered":"2024-09-16T07:53:07.084006+0000","last_clean":"2024-09-16T07:53:07.084006+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:53:07.084006+0000","last_undegraded":"2024-09-16T07:53:07.084006+0000","last_fullsized":"2024-09-16T07:53:07.084006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"84'427","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.730196+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:53:05.730196+0000","last_peered":"2024-09-16T07:53:05.730196+0000","last_clean":"2024-09-16T07:53:05.730196+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:53:05.730196+0000","last_undegraded":"2024-09-16T07:53:05.730196+0000","last_fullsized":"2024-09-16T07:53:05.730196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.066207+0000","last_change":"2024-09-16T07:52:53.041802+0000","last_active":"2024-09-16T07:53:05.066207+0000","last_peered":"2024-09-16T07:53:05.066207+0000","last_clean":"2024-09-16T07:53:05.066207+0000","last_became_active":"2024-09-16T07:52:52.207206+0000","last_became_peered":"2024-09-16T07:52:52.207206+0000","last_unstale":"2024-09-16T07:53:05.066207+0000","last_undegraded":"2024-09-16T07:53:05.066207+0000","last_fullsized":"2024-09-16T07:53:05.066207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"86'652","reported_seq":723,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.569041+0000","last_change":"2024-09-16T07:52:52.205171+0000","last_active":"2024-09-16T07:53:20.569041+0000","last_peered":"2024-09-16T07:53:20.569041+0000","last_clean":"2024-09-16T07:53:20.569041+0000","last_became_active":"2024-09-16T07:52:52.197079+0000","last_became_peered":"2024-09-16T07:52:52.197079+0000","last_unstale":"2024-09-16T07:53:20.569041+0000","last_undegraded":"2024-09-16T07:53:20.569041+0000","last_fullsized":"2024-09-16T07:53:20.569041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":352,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.032992+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:04.032992+0000","last_peered":"2024-09-16T07:53:04.032992+0000","last_clean":"2024-09-16T07:53:04.032992+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:53:04.032992+0000","last_undegraded":"2024-09-16T07:53:04.032992+0000","last_fullsized":"2024-09-16T07:53:04.032992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"83'435","reported_seq":494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.197911+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:04.197911+0000","last_peered":"2024-09-16T07:53:04.197911+0000","last_clean":"2024-09-16T07:53:04.197911+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:53:04.197911+0000","last_undegraded":"2024-09-16T07:53:04.197911+0000","last_fullsized":"2024-09-16T07:53:04.197911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.058500+0000","last_change":"2024-09-16T07:52:53.038857+0000","last_active":"2024-09-16T07:53:05.058500+0000","last_peered":"2024-09-16T07:53:05.058500+0000","last_clean":"2024-09-16T07:53:05.058500+0000","last_became_active":"2024-09-16T07:52:52.148242+0000","last_became_peered":"2024-09-16T07:52:52.148242+0000","last_unstale":"2024-09-16T07:53:05.058500+0000","last_undegraded":"2024-09-16T07:53:05.058500+0000","last_fullsized":"2024-09-16T07:53:05.058500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"86'640","reported_seq":719,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.552990+0000","last_change":"2024-09-16T07:52:52.541645+0000","last_active":"2024-09-16T07:53:20.552990+0000","last_peered":"2024-09-16T07:53:20.552990+0000","last_clean":"2024-09-16T07:53:20.552990+0000","last_became_active":"2024-09-16T07:52:52.268878+0000","last_became_peered":"2024-09-16T07:52:52.268878+0000","last_unstale":"2024-09-16T07:53:20.552990+0000","last_undegraded":"2024-09-16T07:53:20.552990+0000","last_fullsized":"2024-09-16T07:53:20.552990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-16T07:52:53.019915+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:52:53.019915+0000","last_peered":"2024-09-16T07:52:53.019915+0000","last_clean":"2024-09-16T07:52:53.019915+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:52:53.019915+0000","last_undegraded":"2024-09-16T07:52:53.019915+0000","last_fullsized":"2024-09-16T07:52:53.019915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":414318616,"num_objects":6323,"num_object_clones":0,"num_object_copies":18969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8321,"num_write_kb":468545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77832192,"data_stored":1245249560,"data_compressed":59128664,"data_compressed_allocated":77828096,"data_compressed_original":1245249536,"omap_allocated":0,"internal_metadata":0},"log_size":8335,"ondisk_log_size":8335,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60688,"kb_used_data":19328,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94311152,"statfs":{"total":96636764160,"available":96574619648,"internally_reserved":0,"allocated":19791872,"data_stored":305604333,"data_compressed":14500060,"data_compressed_allocated":19087360,"data_compressed_original":305315840,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62840,"kb_used_data":25832,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94309000,"statfs":{"total":96636764160,"available":96572416000,"internally_reserved":0,"allocated":26451968,"data_stored":411844754,"data_compressed":19544411,"data_compressed_allocated":25726976,"data_compressed_original":411549696,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50588,"kb_used_data":14348,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94321252,"statfs":{"total":96636764160,"available":96584962048,"internally_reserved":0,"allocated":14692352,"data_stored":224339168,"data_compressed":10639243,"data_compressed_allocated":14004224,"data_compressed_original":224067584,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61192,"kb_used_data":19256,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94310648,"statfs":{"total":96636764160,"available":96574103552,"internally_reserved":0,"allocated":19718144,"data_stored":303782460,"data_compressed":14413705,"data_compressed_allocated":18972672,"data_compressed_original":303480832,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18591744,"data_stored":297402392,"data_compressed":14122256,"data_compressed_allocated":18587648,"data_compressed_original":297402368,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14024704,"data_stored":224395264,"data_compressed":10654803,"data_compressed_allocated":14024704,"data_compressed_original":224395264,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25759744,"data_stored":412155904,"data_compressed":19570386,"data_compressed_allocated":25759744,"data_compressed_original":412155904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":311296000,"data_compressed":14781219,"data_compressed_allocated":19456000,"data_compressed_original":311296000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:27.881 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:28.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:28.046+0000 7f56bb85c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:28.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:28.058+0000 7f56bb85c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:30.400 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:30.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:30.554+0000 7f9410d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:30.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:30.563+0000 7f9410d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:32.334 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 2, 1, 0] 2024-09-16T07:53:32.334 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:53:32.334 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:32.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:32.502+0000 7f2b1d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:32.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:32.513+0000 7f2b1d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:32.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:32.786 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:53:32.810 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-16T07:53:32.397817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":410124864,"num_objects":6254,"num_object_clones":0,"num_object_copies":18762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":8780,"num_write_kb":479444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8769,"ondisk_log_size":8769,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":232472,"kb_used_data":75928,"kb_used_omap":0,"kb_used_meta":156480,"kb_avail":377254888,"statfs":{"total":386547056640,"available":386309005312,"internally_reserved":0,"allocated":77750272,"data_stored":1198594495,"data_compressed":56866800,"data_compressed_allocated":74854400,"data_compressed_original":1197424640,"omap_allocated":0,"internal_metadata":160235520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":154927128,"num_objects":2365,"num_object_clones":0,"num_object_copies":7095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4815,"num_write_kb":229697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":589824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002387"},"pg_stats":[{"pgid":"5.f","version":"84'451","reported_seq":518,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.443382+0000","last_change":"2024-09-16T07:52:52.214675+0000","last_active":"2024-09-16T07:53:05.443382+0000","last_peered":"2024-09-16T07:53:05.443382+0000","last_clean":"2024-09-16T07:53:05.443382+0000","last_became_active":"2024-09-16T07:52:52.199189+0000","last_became_peered":"2024-09-16T07:52:52.199189+0000","last_unstale":"2024-09-16T07:53:05.443382+0000","last_undegraded":"2024-09-16T07:53:05.443382+0000","last_fullsized":"2024-09-16T07:53:05.443382+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":451,"num_write_kb":28864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"86'704","reported_seq":768,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.491286+0000","last_change":"2024-09-16T07:52:52.277260+0000","last_active":"2024-09-16T07:53:20.491286+0000","last_peered":"2024-09-16T07:53:20.491286+0000","last_clean":"2024-09-16T07:53:20.491286+0000","last_became_active":"2024-09-16T07:52:52.262891+0000","last_became_peered":"2024-09-16T07:52:52.262891+0000","last_unstale":"2024-09-16T07:53:20.491286+0000","last_undegraded":"2024-09-16T07:53:20.491286+0000","last_fullsized":"2024-09-16T07:53:20.491286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"86'605","reported_seq":670,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.423521+0000","last_change":"2024-09-16T07:52:52.289123+0000","last_active":"2024-09-16T07:53:20.423521+0000","last_peered":"2024-09-16T07:53:20.423521+0000","last_clean":"2024-09-16T07:53:20.423521+0000","last_became_active":"2024-09-16T07:52:52.272220+0000","last_became_peered":"2024-09-16T07:52:52.272220+0000","last_unstale":"2024-09-16T07:53:20.423521+0000","last_undegraded":"2024-09-16T07:53:20.423521+0000","last_fullsized":"2024-09-16T07:53:20.423521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971544,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":603,"num_write_kb":29505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"83'461","reported_seq":525,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.278875+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:04.278875+0000","last_peered":"2024-09-16T07:53:04.278875+0000","last_clean":"2024-09-16T07:53:04.278875+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:53:04.278875+0000","last_undegraded":"2024-09-16T07:53:04.278875+0000","last_fullsized":"2024-09-16T07:53:04.278875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30212096,"num_objects":461,"num_object_clones":0,"num_object_copies":1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":29504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"86'642","reported_seq":711,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.415550+0000","last_change":"2024-09-16T07:52:52.234905+0000","last_active":"2024-09-16T07:53:20.415550+0000","last_peered":"2024-09-16T07:53:20.415550+0000","last_clean":"2024-09-16T07:53:20.415550+0000","last_became_active":"2024-09-16T07:52:52.218746+0000","last_became_peered":"2024-09-16T07:52:52.218746+0000","last_unstale":"2024-09-16T07:53:20.415550+0000","last_undegraded":"2024-09-16T07:53:20.415550+0000","last_fullsized":"2024-09-16T07:53:20.415550+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24379392,"num_objects":372,"num_object_clones":0,"num_object_copies":1116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"84'454","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.775210+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:05.775210+0000","last_peered":"2024-09-16T07:53:05.775210+0000","last_clean":"2024-09-16T07:53:05.775210+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:05.775210+0000","last_undegraded":"2024-09-16T07:53:05.775210+0000","last_fullsized":"2024-09-16T07:53:05.775210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":454,"num_write_kb":29056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"86'720","reported_seq":786,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:26.973542+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:53:26.973542+0000","last_peered":"2024-09-16T07:53:26.973542+0000","last_clean":"2024-09-16T07:53:26.973542+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:53:26.973542+0000","last_undegraded":"2024-09-16T07:53:26.973542+0000","last_fullsized":"2024-09-16T07:53:26.973542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":31616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"86'582","reported_seq":651,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.190824+0000","last_change":"2024-09-16T07:52:52.200280+0000","last_active":"2024-09-16T07:53:20.190824+0000","last_peered":"2024-09-16T07:53:20.190824+0000","last_clean":"2024-09-16T07:53:20.190824+0000","last_became_active":"2024-09-16T07:52:52.189353+0000","last_became_peered":"2024-09-16T07:52:52.189353+0000","last_unstale":"2024-09-16T07:53:20.190824+0000","last_undegraded":"2024-09-16T07:53:20.190824+0000","last_fullsized":"2024-09-16T07:53:20.190824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":29312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"84'472","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.769668+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:53:05.769668+0000","last_peered":"2024-09-16T07:53:05.769668+0000","last_clean":"2024-09-16T07:53:05.769668+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:53:05.769668+0000","last_undegraded":"2024-09-16T07:53:05.769668+0000","last_fullsized":"2024-09-16T07:53:05.769668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.031381+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:04.031381+0000","last_peered":"2024-09-16T07:53:04.031381+0000","last_clean":"2024-09-16T07:53:04.031381+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:53:04.031381+0000","last_undegraded":"2024-09-16T07:53:04.031381+0000","last_fullsized":"2024-09-16T07:53:04.031381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":213,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.083910+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:53:07.083910+0000","last_peered":"2024-09-16T07:53:07.083910+0000","last_clean":"2024-09-16T07:53:07.083910+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:53:07.083910+0000","last_undegraded":"2024-09-16T07:53:07.083910+0000","last_fullsized":"2024-09-16T07:53:07.083910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"86'636","reported_seq":705,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.370448+0000","last_change":"2024-09-16T07:52:52.282162+0000","last_active":"2024-09-16T07:53:20.370448+0000","last_peered":"2024-09-16T07:53:20.370448+0000","last_clean":"2024-09-16T07:53:20.370448+0000","last_became_active":"2024-09-16T07:52:52.259966+0000","last_became_peered":"2024-09-16T07:52:52.259966+0000","last_unstale":"2024-09-16T07:53:20.370448+0000","last_undegraded":"2024-09-16T07:53:20.370448+0000","last_fullsized":"2024-09-16T07:53:20.370448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":634,"num_write_kb":31168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.089151+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:53:07.089151+0000","last_peered":"2024-09-16T07:53:07.089151+0000","last_clean":"2024-09-16T07:53:07.089151+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:53:07.089151+0000","last_undegraded":"2024-09-16T07:53:07.089151+0000","last_fullsized":"2024-09-16T07:53:07.089151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"84'412","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.580277+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:05.580277+0000","last_peered":"2024-09-16T07:53:05.580277+0000","last_clean":"2024-09-16T07:53:05.580277+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:05.580277+0000","last_undegraded":"2024-09-16T07:53:05.580277+0000","last_fullsized":"2024-09-16T07:53:05.580277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":412,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.078278+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:53:07.078278+0000","last_peered":"2024-09-16T07:53:07.078278+0000","last_clean":"2024-09-16T07:53:07.078278+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:53:07.078278+0000","last_undegraded":"2024-09-16T07:53:07.078278+0000","last_fullsized":"2024-09-16T07:53:07.078278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"84'421","reported_seq":482,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.684454+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:53:05.684454+0000","last_peered":"2024-09-16T07:53:05.684454+0000","last_clean":"2024-09-16T07:53:05.684454+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:53:05.684454+0000","last_undegraded":"2024-09-16T07:53:05.684454+0000","last_fullsized":"2024-09-16T07:53:05.684454+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27590656,"num_objects":421,"num_object_clones":0,"num_object_copies":1263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":421,"num_write_kb":26944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":138,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.084006+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:53:07.084006+0000","last_peered":"2024-09-16T07:53:07.084006+0000","last_clean":"2024-09-16T07:53:07.084006+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:53:07.084006+0000","last_undegraded":"2024-09-16T07:53:07.084006+0000","last_fullsized":"2024-09-16T07:53:07.084006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"84'427","reported_seq":498,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.730196+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:53:05.730196+0000","last_peered":"2024-09-16T07:53:05.730196+0000","last_clean":"2024-09-16T07:53:05.730196+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:53:05.730196+0000","last_undegraded":"2024-09-16T07:53:05.730196+0000","last_fullsized":"2024-09-16T07:53:05.730196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27983872,"num_objects":427,"num_object_clones":0,"num_object_copies":1281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":427,"num_write_kb":27328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.066207+0000","last_change":"2024-09-16T07:52:53.041802+0000","last_active":"2024-09-16T07:53:05.066207+0000","last_peered":"2024-09-16T07:53:05.066207+0000","last_clean":"2024-09-16T07:53:05.066207+0000","last_became_active":"2024-09-16T07:52:52.207206+0000","last_became_peered":"2024-09-16T07:52:52.207206+0000","last_unstale":"2024-09-16T07:53:05.066207+0000","last_undegraded":"2024-09-16T07:53:05.066207+0000","last_fullsized":"2024-09-16T07:53:05.066207+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"86'652","reported_seq":723,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.569041+0000","last_change":"2024-09-16T07:52:52.205171+0000","last_active":"2024-09-16T07:53:20.569041+0000","last_peered":"2024-09-16T07:53:20.569041+0000","last_clean":"2024-09-16T07:53:20.569041+0000","last_became_active":"2024-09-16T07:52:52.197079+0000","last_became_peered":"2024-09-16T07:52:52.197079+0000","last_unstale":"2024-09-16T07:53:20.569041+0000","last_undegraded":"2024-09-16T07:53:20.569041+0000","last_fullsized":"2024-09-16T07:53:20.569041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":352,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.032992+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:04.032992+0000","last_peered":"2024-09-16T07:53:04.032992+0000","last_clean":"2024-09-16T07:53:04.032992+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:53:04.032992+0000","last_undegraded":"2024-09-16T07:53:04.032992+0000","last_fullsized":"2024-09-16T07:53:04.032992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"83'435","reported_seq":494,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-16T07:53:04.197911+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:04.197911+0000","last_peered":"2024-09-16T07:53:04.197911+0000","last_clean":"2024-09-16T07:53:04.197911+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:53:04.197911+0000","last_undegraded":"2024-09-16T07:53:04.197911+0000","last_fullsized":"2024-09-16T07:53:04.197911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":212,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T07:53:05.058500+0000","last_change":"2024-09-16T07:52:53.038857+0000","last_active":"2024-09-16T07:53:05.058500+0000","last_peered":"2024-09-16T07:53:05.058500+0000","last_clean":"2024-09-16T07:53:05.058500+0000","last_became_active":"2024-09-16T07:52:52.148242+0000","last_became_peered":"2024-09-16T07:52:52.148242+0000","last_unstale":"2024-09-16T07:53:05.058500+0000","last_undegraded":"2024-09-16T07:53:05.058500+0000","last_fullsized":"2024-09-16T07:53:05.058500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"86'640","reported_seq":719,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.552990+0000","last_change":"2024-09-16T07:52:52.541645+0000","last_active":"2024-09-16T07:53:20.552990+0000","last_peered":"2024-09-16T07:53:20.552990+0000","last_clean":"2024-09-16T07:53:20.552990+0000","last_became_active":"2024-09-16T07:52:52.268878+0000","last_became_peered":"2024-09-16T07:52:52.268878+0000","last_unstale":"2024-09-16T07:53:20.552990+0000","last_undegraded":"2024-09-16T07:53:20.552990+0000","last_fullsized":"2024-09-16T07:53:20.552990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.079591+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:53:07.079591+0000","last_peered":"2024-09-16T07:53:07.079591+0000","last_clean":"2024-09-16T07:53:07.079591+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:53:07.079591+0000","last_undegraded":"2024-09-16T07:53:07.079591+0000","last_fullsized":"2024-09-16T07:53:07.079591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":409534488,"num_objects":6250,"num_object_clones":0,"num_object_copies":18750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8700,"num_write_kb":478337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74338304,"data_stored":1189347352,"data_compressed":56474813,"data_compressed_allocated":74334208,"data_compressed_original":1189347328,"omap_allocated":0,"internal_metadata":0},"log_size":8714,"ondisk_log_size":8714,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60688,"kb_used_data":19328,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94311152,"statfs":{"total":96636764160,"available":96574619648,"internally_reserved":0,"allocated":19791872,"data_stored":305604333,"data_compressed":14500060,"data_compressed_allocated":19087360,"data_compressed_original":305315840,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62840,"kb_used_data":25832,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94309000,"statfs":{"total":96636764160,"available":96572416000,"internally_reserved":0,"allocated":26451968,"data_stored":411844754,"data_compressed":19544411,"data_compressed_allocated":25726976,"data_compressed_original":411549696,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612696,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47752,"kb_used_data":11512,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94324088,"statfs":{"total":96636764160,"available":96587866112,"internally_reserved":0,"allocated":11788288,"data_stored":177362948,"data_compressed":8408624,"data_compressed_allocated":11067392,"data_compressed_original":177078272,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61192,"kb_used_data":19256,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94310648,"statfs":{"total":96636764160,"available":96574103552,"internally_reserved":0,"allocated":19718144,"data_stored":303782460,"data_compressed":14413705,"data_compressed_allocated":18972672,"data_compressed_original":303480832,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18591744,"data_stored":297402392,"data_compressed":14122256,"data_compressed_allocated":18587648,"data_compressed_original":297402368,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10530816,"data_stored":168493056,"data_compressed":8000952,"data_compressed_allocated":10530816,"data_compressed_original":168493056,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25759744,"data_stored":412155904,"data_compressed":19570386,"data_compressed_allocated":25759744,"data_compressed_original":412155904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19456000,"data_stored":311296000,"data_compressed":14781219,"data_compressed_allocated":19456000,"data_compressed_original":311296000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:32.840 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:32.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:32.984+0000 7f2554391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:32.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:32.994+0000 7f2554391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:35.353 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:35.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:35.508+0000 7ff325f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:35.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:35.516+0000 7ff325f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:37.812 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 2, 1, 0] 2024-09-16T07:53:37.812 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:53:37.813 INFO:tasks.thrashosds.thrasher:Killing osd 3, live_osds are [3, 2, 1, 0] 2024-09-16T07:53:37.813 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T07:53:37.813 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:53:37.856 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:37.913 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T07:53:37.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:37.979+0000 7fd11de63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:37.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:37.985+0000 7fd11de63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:42.914 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [3] live_osds: [2, 1, 0] 2024-09-16T07:53:42.914 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:53:42.914 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:43.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:43.039+0000 7f74d6591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:43.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:53:43.048+0000 7f74d6591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:43.251 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:53:43.252 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:53:43.264 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-09-16T07:53:42.399856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":254870080,"num_objects":3885,"num_object_clones":0,"num_object_copies":11655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":11867,"num_write_kb":502420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11856,"ondisk_log_size":11856,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":208108,"kb_used_data":47404,"kb_used_omap":0,"kb_used_meta":160640,"kb_avail":377279252,"statfs":{"total":386547056640,"available":386333954048,"internally_reserved":0,"allocated":48541696,"data_stored":730359461,"data_compressed":34633323,"data_compressed_allocated":45588480,"data_compressed_original":729169920,"omap_allocated":0,"internal_metadata":164495360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-155254784,"num_objects":-2369,"num_object_clones":0,"num_object_copies":-7107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3087,"num_write_kb":22976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002401"},"pg_stats":[{"pgid":"5.f","version":"86'843","reported_seq":916,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.775873+0000","last_change":"2024-09-16T07:52:52.214675+0000","last_active":"2024-09-16T07:53:35.775873+0000","last_peered":"2024-09-16T07:53:35.775873+0000","last_clean":"2024-09-16T07:53:35.775873+0000","last_became_active":"2024-09-16T07:52:52.199189+0000","last_became_peered":"2024-09-16T07:52:52.199189+0000","last_unstale":"2024-09-16T07:53:35.775873+0000","last_undegraded":"2024-09-16T07:53:35.775873+0000","last_fullsized":"2024-09-16T07:53:35.775873+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":843,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"86'704","reported_seq":768,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.491286+0000","last_change":"2024-09-16T07:52:52.277260+0000","last_active":"2024-09-16T07:53:20.491286+0000","last_peered":"2024-09-16T07:53:20.491286+0000","last_clean":"2024-09-16T07:53:20.491286+0000","last_became_active":"2024-09-16T07:52:52.262891+0000","last_became_peered":"2024-09-16T07:52:52.262891+0000","last_unstale":"2024-09-16T07:53:20.491286+0000","last_undegraded":"2024-09-16T07:53:20.491286+0000","last_fullsized":"2024-09-16T07:53:20.491286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"86'605","reported_seq":670,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.423521+0000","last_change":"2024-09-16T07:52:52.289123+0000","last_active":"2024-09-16T07:53:20.423521+0000","last_peered":"2024-09-16T07:53:20.423521+0000","last_clean":"2024-09-16T07:53:20.423521+0000","last_became_active":"2024-09-16T07:52:52.272220+0000","last_became_peered":"2024-09-16T07:52:52.272220+0000","last_unstale":"2024-09-16T07:53:20.423521+0000","last_undegraded":"2024-09-16T07:53:20.423521+0000","last_fullsized":"2024-09-16T07:53:20.423521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971544,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":603,"num_write_kb":29505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"86'888","reported_seq":961,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:34.155416+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:34.155416+0000","last_peered":"2024-09-16T07:53:34.155416+0000","last_clean":"2024-09-16T07:53:34.155416+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:53:34.155416+0000","last_undegraded":"2024-09-16T07:53:34.155416+0000","last_fullsized":"2024-09-16T07:53:34.155416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":33728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"86'642","reported_seq":711,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.415550+0000","last_change":"2024-09-16T07:52:52.234905+0000","last_active":"2024-09-16T07:53:20.415550+0000","last_peered":"2024-09-16T07:53:20.415550+0000","last_clean":"2024-09-16T07:53:20.415550+0000","last_became_active":"2024-09-16T07:52:52.218746+0000","last_became_peered":"2024-09-16T07:52:52.218746+0000","last_unstale":"2024-09-16T07:53:20.415550+0000","last_undegraded":"2024-09-16T07:53:20.415550+0000","last_fullsized":"2024-09-16T07:53:20.415550+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24379392,"num_objects":372,"num_object_clones":0,"num_object_copies":1116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"86'837","reported_seq":910,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.659685+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:35.659685+0000","last_peered":"2024-09-16T07:53:35.659685+0000","last_clean":"2024-09-16T07:53:35.659685+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:35.659685+0000","last_undegraded":"2024-09-16T07:53:35.659685+0000","last_fullsized":"2024-09-16T07:53:35.659685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"86'720","reported_seq":786,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:26.973542+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:53:26.973542+0000","last_peered":"2024-09-16T07:53:26.973542+0000","last_clean":"2024-09-16T07:53:26.973542+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:53:26.973542+0000","last_undegraded":"2024-09-16T07:53:26.973542+0000","last_fullsized":"2024-09-16T07:53:26.973542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":31616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"86'582","reported_seq":651,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.190824+0000","last_change":"2024-09-16T07:52:52.200280+0000","last_active":"2024-09-16T07:53:20.190824+0000","last_peered":"2024-09-16T07:53:20.190824+0000","last_clean":"2024-09-16T07:53:20.190824+0000","last_became_active":"2024-09-16T07:52:52.189353+0000","last_became_peered":"2024-09-16T07:52:52.189353+0000","last_unstale":"2024-09-16T07:53:20.190824+0000","last_undegraded":"2024-09-16T07:53:20.190824+0000","last_fullsized":"2024-09-16T07:53:20.190824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":29312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"86'852","reported_seq":934,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.716789+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:53:35.716789+0000","last_peered":"2024-09-16T07:53:35.716789+0000","last_clean":"2024-09-16T07:53:35.716789+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:53:35.716789+0000","last_undegraded":"2024-09-16T07:53:35.716789+0000","last_fullsized":"2024-09-16T07:53:35.716789+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10223616,"num_objects":156,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":852,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":269,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.062548+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:07.062548+0000","last_peered":"2024-09-16T07:53:07.062548+0000","last_clean":"2024-09-16T07:53:07.062548+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:53:07.062548+0000","last_undegraded":"2024-09-16T07:53:07.062548+0000","last_fullsized":"2024-09-16T07:53:07.062548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":213,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.083910+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:53:07.083910+0000","last_peered":"2024-09-16T07:53:07.083910+0000","last_clean":"2024-09-16T07:53:07.083910+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:53:07.083910+0000","last_undegraded":"2024-09-16T07:53:07.083910+0000","last_fullsized":"2024-09-16T07:53:07.083910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"86'636","reported_seq":705,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.370448+0000","last_change":"2024-09-16T07:52:52.282162+0000","last_active":"2024-09-16T07:53:20.370448+0000","last_peered":"2024-09-16T07:53:20.370448+0000","last_clean":"2024-09-16T07:53:20.370448+0000","last_became_active":"2024-09-16T07:52:52.259966+0000","last_became_peered":"2024-09-16T07:52:52.259966+0000","last_unstale":"2024-09-16T07:53:20.370448+0000","last_undegraded":"2024-09-16T07:53:20.370448+0000","last_fullsized":"2024-09-16T07:53:20.370448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22282240,"num_objects":340,"num_object_clones":0,"num_object_copies":1020,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":634,"num_write_kb":31168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.089151+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:53:07.089151+0000","last_peered":"2024-09-16T07:53:07.089151+0000","last_clean":"2024-09-16T07:53:07.089151+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:53:07.089151+0000","last_undegraded":"2024-09-16T07:53:07.089151+0000","last_fullsized":"2024-09-16T07:53:07.089151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"86'774","reported_seq":847,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.627019+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:35.627019+0000","last_peered":"2024-09-16T07:53:35.627019+0000","last_clean":"2024-09-16T07:53:35.627019+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:35.627019+0000","last_undegraded":"2024-09-16T07:53:35.627019+0000","last_fullsized":"2024-09-16T07:53:35.627019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.078278+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:53:07.078278+0000","last_peered":"2024-09-16T07:53:07.078278+0000","last_clean":"2024-09-16T07:53:07.078278+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:53:07.078278+0000","last_undegraded":"2024-09-16T07:53:07.078278+0000","last_fullsized":"2024-09-16T07:53:07.078278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"86'786","reported_seq":853,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.663620+0000","last_change":"2024-09-16T07:51:59.108998+0000","last_active":"2024-09-16T07:53:35.663620+0000","last_peered":"2024-09-16T07:53:35.663620+0000","last_clean":"2024-09-16T07:53:35.663620+0000","last_became_active":"2024-09-16T07:51:59.100746+0000","last_became_peered":"2024-09-16T07:51:59.100746+0000","last_unstale":"2024-09-16T07:53:35.663620+0000","last_undegraded":"2024-09-16T07:53:35.663620+0000","last_fullsized":"2024-09-16T07:53:35.663620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":786,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":138,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.084006+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:53:07.084006+0000","last_peered":"2024-09-16T07:53:07.084006+0000","last_clean":"2024-09-16T07:53:07.084006+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:53:07.084006+0000","last_undegraded":"2024-09-16T07:53:07.084006+0000","last_fullsized":"2024-09-16T07:53:07.084006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"86'800","reported_seq":877,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.687487+0000","last_change":"2024-09-16T07:51:59.332794+0000","last_active":"2024-09-16T07:53:35.687487+0000","last_peered":"2024-09-16T07:53:35.687487+0000","last_clean":"2024-09-16T07:53:35.687487+0000","last_became_active":"2024-09-16T07:51:59.135170+0000","last_became_peered":"2024-09-16T07:51:59.135170+0000","last_unstale":"2024-09-16T07:53:35.687487+0000","last_undegraded":"2024-09-16T07:53:35.687487+0000","last_fullsized":"2024-09-16T07:53:35.687487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":218,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.068816+0000","last_change":"2024-09-16T07:52:53.041802+0000","last_active":"2024-09-16T07:53:07.068816+0000","last_peered":"2024-09-16T07:53:07.068816+0000","last_clean":"2024-09-16T07:53:07.068816+0000","last_became_active":"2024-09-16T07:52:52.207206+0000","last_became_peered":"2024-09-16T07:52:52.207206+0000","last_unstale":"2024-09-16T07:53:07.068816+0000","last_undegraded":"2024-09-16T07:53:07.068816+0000","last_fullsized":"2024-09-16T07:53:07.068816+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"86'652","reported_seq":723,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.569041+0000","last_change":"2024-09-16T07:52:52.205171+0000","last_active":"2024-09-16T07:53:20.569041+0000","last_peered":"2024-09-16T07:53:20.569041+0000","last_clean":"2024-09-16T07:53:20.569041+0000","last_became_active":"2024-09-16T07:52:52.197079+0000","last_became_peered":"2024-09-16T07:52:52.197079+0000","last_unstale":"2024-09-16T07:53:20.569041+0000","last_undegraded":"2024-09-16T07:53:20.569041+0000","last_fullsized":"2024-09-16T07:53:20.569041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":352,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":650,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.060956+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:07.060956+0000","last_peered":"2024-09-16T07:53:07.060956+0000","last_clean":"2024-09-16T07:53:07.060956+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:53:07.060956+0000","last_undegraded":"2024-09-16T07:53:07.060956+0000","last_fullsized":"2024-09-16T07:53:07.060956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"86'840","reported_seq":908,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:34.275962+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:34.275962+0000","last_peered":"2024-09-16T07:53:34.275962+0000","last_clean":"2024-09-16T07:53:34.275962+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:53:34.275962+0000","last_undegraded":"2024-09-16T07:53:34.275962+0000","last_fullsized":"2024-09-16T07:53:34.275962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":31488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":218,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.057429+0000","last_change":"2024-09-16T07:52:53.038857+0000","last_active":"2024-09-16T07:53:07.057429+0000","last_peered":"2024-09-16T07:53:07.057429+0000","last_clean":"2024-09-16T07:53:07.057429+0000","last_became_active":"2024-09-16T07:52:52.148242+0000","last_became_peered":"2024-09-16T07:52:52.148242+0000","last_unstale":"2024-09-16T07:53:07.057429+0000","last_undegraded":"2024-09-16T07:53:07.057429+0000","last_fullsized":"2024-09-16T07:53:07.057429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"86'640","reported_seq":719,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:20.552990+0000","last_change":"2024-09-16T07:52:52.541645+0000","last_active":"2024-09-16T07:53:20.552990+0000","last_peered":"2024-09-16T07:53:20.552990+0000","last_clean":"2024-09-16T07:53:20.552990+0000","last_became_active":"2024-09-16T07:52:52.268878+0000","last_became_peered":"2024-09-16T07:52:52.268878+0000","last_unstale":"2024-09-16T07:53:20.552990+0000","last_undegraded":"2024-09-16T07:53:20.552990+0000","last_fullsized":"2024-09-16T07:53:20.552990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23461888,"num_objects":358,"num_object_clones":0,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":638,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.079591+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:53:07.079591+0000","last_peered":"2024-09-16T07:53:07.079591+0000","last_clean":"2024-09-16T07:53:07.079591+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:53:07.079591+0000","last_undegraded":"2024-09-16T07:53:07.079591+0000","last_fullsized":"2024-09-16T07:53:07.079591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":254279704,"num_objects":3881,"num_object_clones":0,"num_object_copies":11643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11787,"num_write_kb":501313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44158976,"data_stored":706347080,"data_compressed":33541136,"data_compressed_allocated":44146688,"data_compressed_original":706347008,"omap_allocated":0,"internal_metadata":0},"log_size":11801,"ondisk_log_size":11801,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49464,"kb_used_data":8104,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94322376,"statfs":{"total":96636764160,"available":96586113024,"internally_reserved":0,"allocated":8298496,"data_stored":121133609,"data_compressed":5740561,"data_compressed_allocated":7557120,"data_compressed_original":120832000,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49700,"kb_used_data":8532,"kb_used_omap":0,"kb_used_meta":41152,"kb_avail":94322140,"statfs":{"total":96636764160,"available":96585871360,"internally_reserved":0,"allocated":8736768,"data_stored":128080444,"data_compressed":6070433,"data_compressed_allocated":7991296,"data_compressed_original":127778816,"omap_allocated":0,"internal_metadata":42139648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612696,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47752,"kb_used_data":11512,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94324088,"statfs":{"total":96636764160,"available":96587866112,"internally_reserved":0,"allocated":11788288,"data_stored":177362948,"data_compressed":8408624,"data_compressed_allocated":11067392,"data_compressed_original":177078272,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61192,"kb_used_data":19256,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94310648,"statfs":{"total":96636764160,"available":96574103552,"internally_reserved":0,"allocated":19718144,"data_stored":303782460,"data_compressed":14413705,"data_compressed_allocated":18972672,"data_compressed_original":303480832,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18591744,"data_stored":297402392,"data_compressed":14122256,"data_compressed_allocated":18587648,"data_compressed_original":297402368,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10530816,"data_stored":168493056,"data_compressed":8000952,"data_compressed_allocated":10530816,"data_compressed_original":168493056,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7913472,"data_stored":126550040,"data_compressed":6009272,"data_compressed_allocated":7909376,"data_compressed_original":126550016,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":113901592,"data_compressed":5408656,"data_compressed_allocated":7118848,"data_compressed_original":113901568,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:48.266 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [3] live_osds: [2, 1, 0] 2024-09-16T07:53:48.266 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:53:48.267 INFO:tasks.thrashosds.thrasher:Reviving osd 3 2024-09-16T07:53:48.267 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T07:53:48.267 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-16T07:53:48.270 INFO:tasks.ceph.osd.3:Started 2024-09-16T07:53:48.270 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T07:53:48.373 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:53:48.376 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:48.377 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-09-16T07:53:53.378 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T07:53:53.480 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:53:53.483 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:53.484 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-09-16T07:53:58.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T07:53:58.583 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:53:58.586 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:58.587 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-09-16T07:54:02.041 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-09-16T07:54:02.047 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:54:02.047 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:54:02.327 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-16T07:54:02.328+0000 7fc911d32640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-16T07:54:03.588 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-16T07:54:03.691 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-16T07:54:03.691 INFO:teuthology.orchestra.run.smithi134.stdout: "ops_in_flight": [] 2024-09-16T07:54:03.692 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-16T07:54:04.049 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:04.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:04.227+0000 7f377e551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:04.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:04.238+0000 7f377e551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:06.539 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:06.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:06.695+0000 7f8884b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:06.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:06.704+0000 7f8884b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:08.701 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [2, 1, 0, 3] 2024-09-16T07:54:08.701 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:54:08.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:08.859+0000 7ff2f16fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:08.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:08.874+0000 7ff2f16fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:09.039 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:09.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:09.191+0000 7f97f5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:09.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:09.201+0000 7f97f5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:10.008 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:54:10.030 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:54:10.192 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:10.179+0000 7f42f8b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:10.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:10.199+0000 7f42f8b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:11.014 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:54:11.035 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:54:11.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:11.181+0000 7f8bdf751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:11.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:11.195+0000 7f8bdf751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:11.593 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:11.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:11.744+0000 7fb4fe2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:11.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:11.753+0000 7fb4fe2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:12.021 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:54:12.040 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:54:12.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:12.200+0000 7f469b69c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:12.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:12.215+0000 7f469b69c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:13.008 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:54:13.030 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:54:13.031 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:13.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:13.176+0000 7fc97bc7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:13.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:13.188+0000 7fc97bc7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:13.433 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:13.434 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:13.449 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2024-09-16T07:54:13.010644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":124518976,"num_objects":1896,"num_object_clones":0,"num_object_copies":5688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13856,"num_write_kb":502420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13845,"ondisk_log_size":13845,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":187244,"kb_used_data":26540,"kb_used_omap":0,"kb_used_meta":160640,"kb_avail":377300116,"statfs":{"total":386547056640,"available":386355318784,"internally_reserved":0,"allocated":27176960,"data_stored":388141802,"data_compressed":18382459,"data_compressed_allocated":24199168,"data_compressed_original":386940928,"omap_allocated":0,"internal_metadata":164495360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.605783"},"pg_stats":[{"pgid":"5.f","version":"89'874","reported_seq":960,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.031938+0000","last_change":"2024-09-16T07:54:04.214969+0000","last_active":"2024-09-16T07:54:05.031938+0000","last_peered":"2024-09-16T07:54:05.031938+0000","last_clean":"2024-09-16T07:54:05.031938+0000","last_became_active":"2024-09-16T07:54:04.210072+0000","last_became_peered":"2024-09-16T07:54:04.210072+0000","last_unstale":"2024-09-16T07:54:05.031938+0000","last_undegraded":"2024-09-16T07:54:05.031938+0000","last_fullsized":"2024-09-16T07:54:05.031938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"86'959","reported_seq":1023,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.791120+0000","last_change":"2024-09-16T07:52:52.277260+0000","last_active":"2024-09-16T07:53:37.791120+0000","last_peered":"2024-09-16T07:53:37.791120+0000","last_clean":"2024-09-16T07:53:37.791120+0000","last_became_active":"2024-09-16T07:52:52.262891+0000","last_became_peered":"2024-09-16T07:52:52.262891+0000","last_unstale":"2024-09-16T07:53:37.791120+0000","last_undegraded":"2024-09-16T07:53:37.791120+0000","last_fullsized":"2024-09-16T07:53:37.791120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":957,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"86'819","reported_seq":884,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.770630+0000","last_change":"2024-09-16T07:52:52.289123+0000","last_active":"2024-09-16T07:53:37.770630+0000","last_peered":"2024-09-16T07:53:37.770630+0000","last_clean":"2024-09-16T07:53:37.770630+0000","last_became_active":"2024-09-16T07:52:52.272220+0000","last_became_peered":"2024-09-16T07:52:52.272220+0000","last_unstale":"2024-09-16T07:53:37.770630+0000","last_undegraded":"2024-09-16T07:53:37.770630+0000","last_fullsized":"2024-09-16T07:53:37.770630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946840,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":817,"num_write_kb":29505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"86'888","reported_seq":961,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:34.155416+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:34.155416+0000","last_peered":"2024-09-16T07:53:34.155416+0000","last_clean":"2024-09-16T07:53:34.155416+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:54:02.039638+0000","last_undegraded":"2024-09-16T07:53:34.155416+0000","last_fullsized":"2024-09-16T07:53:34.155416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":33728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"86'915","reported_seq":984,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.896054+0000","last_change":"2024-09-16T07:52:52.234905+0000","last_active":"2024-09-16T07:53:37.896054+0000","last_peered":"2024-09-16T07:53:37.896054+0000","last_clean":"2024-09-16T07:53:37.896054+0000","last_became_active":"2024-09-16T07:52:52.218746+0000","last_became_peered":"2024-09-16T07:52:52.218746+0000","last_unstale":"2024-09-16T07:53:37.896054+0000","last_undegraded":"2024-09-16T07:53:37.896054+0000","last_fullsized":"2024-09-16T07:53:37.896054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":913,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"86'837","reported_seq":910,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.659685+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:35.659685+0000","last_peered":"2024-09-16T07:53:35.659685+0000","last_clean":"2024-09-16T07:53:35.659685+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:35.659685+0000","last_undegraded":"2024-09-16T07:53:35.659685+0000","last_fullsized":"2024-09-16T07:53:35.659685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"86'894","reported_seq":960,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.846167+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:53:37.846167+0000","last_peered":"2024-09-16T07:53:37.846167+0000","last_clean":"2024-09-16T07:53:37.846167+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:53:37.846167+0000","last_undegraded":"2024-09-16T07:53:37.846167+0000","last_fullsized":"2024-09-16T07:53:37.846167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":894,"num_write_kb":31616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"86'817","reported_seq":886,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.581973+0000","last_change":"2024-09-16T07:52:52.200280+0000","last_active":"2024-09-16T07:53:37.581973+0000","last_peered":"2024-09-16T07:53:37.581973+0000","last_clean":"2024-09-16T07:53:37.581973+0000","last_became_active":"2024-09-16T07:52:52.189353+0000","last_became_peered":"2024-09-16T07:52:52.189353+0000","last_unstale":"2024-09-16T07:53:37.581973+0000","last_undegraded":"2024-09-16T07:53:37.581973+0000","last_fullsized":"2024-09-16T07:53:37.581973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":29312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"89'885","reported_seq":979,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.028546+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:54:05.028546+0000","last_peered":"2024-09-16T07:54:05.028546+0000","last_clean":"2024-09-16T07:54:05.028546+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:54:05.028546+0000","last_undegraded":"2024-09-16T07:54:05.028546+0000","last_fullsized":"2024-09-16T07:54:05.028546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":885,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":269,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.062548+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:07.062548+0000","last_peered":"2024-09-16T07:53:07.062548+0000","last_clean":"2024-09-16T07:53:07.062548+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:54:02.039639+0000","last_undegraded":"2024-09-16T07:53:07.062548+0000","last_fullsized":"2024-09-16T07:53:07.062548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":213,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.083910+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:53:07.083910+0000","last_peered":"2024-09-16T07:53:07.083910+0000","last_clean":"2024-09-16T07:53:07.083910+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:53:07.083910+0000","last_undegraded":"2024-09-16T07:53:07.083910+0000","last_fullsized":"2024-09-16T07:53:07.083910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"86'880","reported_seq":949,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.587837+0000","last_change":"2024-09-16T07:52:52.282162+0000","last_active":"2024-09-16T07:53:37.587837+0000","last_peered":"2024-09-16T07:53:37.587837+0000","last_clean":"2024-09-16T07:53:37.587837+0000","last_became_active":"2024-09-16T07:52:52.259966+0000","last_became_peered":"2024-09-16T07:52:52.259966+0000","last_unstale":"2024-09-16T07:53:37.587837+0000","last_undegraded":"2024-09-16T07:53:37.587837+0000","last_fullsized":"2024-09-16T07:53:37.587837+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":878,"num_write_kb":31168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.089151+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:53:07.089151+0000","last_peered":"2024-09-16T07:53:07.089151+0000","last_clean":"2024-09-16T07:53:07.089151+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:53:07.089151+0000","last_undegraded":"2024-09-16T07:53:07.089151+0000","last_fullsized":"2024-09-16T07:53:07.089151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"86'774","reported_seq":847,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.627019+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:35.627019+0000","last_peered":"2024-09-16T07:53:35.627019+0000","last_clean":"2024-09-16T07:53:35.627019+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:35.627019+0000","last_undegraded":"2024-09-16T07:53:35.627019+0000","last_fullsized":"2024-09-16T07:53:35.627019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.078278+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:53:07.078278+0000","last_peered":"2024-09-16T07:53:07.078278+0000","last_clean":"2024-09-16T07:53:07.078278+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:53:07.078278+0000","last_undegraded":"2024-09-16T07:53:07.078278+0000","last_fullsized":"2024-09-16T07:53:07.078278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"86'815","reported_seq":901,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.021553+0000","last_change":"2024-09-16T07:54:04.265645+0000","last_active":"2024-09-16T07:54:05.021553+0000","last_peered":"2024-09-16T07:54:05.021553+0000","last_clean":"2024-09-16T07:54:05.021553+0000","last_became_active":"2024-09-16T07:54:04.121359+0000","last_became_peered":"2024-09-16T07:54:04.121359+0000","last_unstale":"2024-09-16T07:54:05.021553+0000","last_undegraded":"2024-09-16T07:54:05.021553+0000","last_fullsized":"2024-09-16T07:54:05.021553+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":138,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.084006+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:53:07.084006+0000","last_peered":"2024-09-16T07:53:07.084006+0000","last_clean":"2024-09-16T07:53:07.084006+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:53:07.084006+0000","last_undegraded":"2024-09-16T07:53:07.084006+0000","last_fullsized":"2024-09-16T07:53:07.084006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"89'825","reported_seq":915,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.027941+0000","last_change":"2024-09-16T07:54:04.150160+0000","last_active":"2024-09-16T07:54:05.027941+0000","last_peered":"2024-09-16T07:54:05.027941+0000","last_clean":"2024-09-16T07:54:05.027941+0000","last_became_active":"2024-09-16T07:54:04.140385+0000","last_became_peered":"2024-09-16T07:54:04.140385+0000","last_unstale":"2024-09-16T07:54:05.027941+0000","last_undegraded":"2024-09-16T07:54:05.027941+0000","last_fullsized":"2024-09-16T07:54:05.027941+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.029835+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:05.029835+0000","last_peered":"2024-09-16T07:54:05.029835+0000","last_clean":"2024-09-16T07:54:05.029835+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:05.029835+0000","last_undegraded":"2024-09-16T07:54:05.029835+0000","last_fullsized":"2024-09-16T07:54:05.029835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"86'892","reported_seq":963,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.846279+0000","last_change":"2024-09-16T07:52:52.205171+0000","last_active":"2024-09-16T07:53:37.846279+0000","last_peered":"2024-09-16T07:53:37.846279+0000","last_clean":"2024-09-16T07:53:37.846279+0000","last_became_active":"2024-09-16T07:52:52.197079+0000","last_became_peered":"2024-09-16T07:52:52.197079+0000","last_unstale":"2024-09-16T07:53:37.846279+0000","last_undegraded":"2024-09-16T07:53:37.846279+0000","last_fullsized":"2024-09-16T07:53:37.846279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.060956+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:07.060956+0000","last_peered":"2024-09-16T07:53:07.060956+0000","last_clean":"2024-09-16T07:53:07.060956+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:54:02.039642+0000","last_undegraded":"2024-09-16T07:53:07.060956+0000","last_fullsized":"2024-09-16T07:53:07.060956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"86'840","reported_seq":908,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:34.275962+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:34.275962+0000","last_peered":"2024-09-16T07:53:34.275962+0000","last_clean":"2024-09-16T07:53:34.275962+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:54:02.039643+0000","last_undegraded":"2024-09-16T07:53:34.275962+0000","last_fullsized":"2024-09-16T07:53:34.275962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":31488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.024313+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:05.024313+0000","last_peered":"2024-09-16T07:54:05.024313+0000","last_clean":"2024-09-16T07:54:05.024313+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:05.024313+0000","last_undegraded":"2024-09-16T07:54:05.024313+0000","last_fullsized":"2024-09-16T07:54:05.024313+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"86'876","reported_seq":955,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.776804+0000","last_change":"2024-09-16T07:52:52.541645+0000","last_active":"2024-09-16T07:53:37.776804+0000","last_peered":"2024-09-16T07:53:37.776804+0000","last_clean":"2024-09-16T07:53:37.776804+0000","last_became_active":"2024-09-16T07:52:52.268878+0000","last_became_peered":"2024-09-16T07:52:52.268878+0000","last_unstale":"2024-09-16T07:53:37.776804+0000","last_undegraded":"2024-09-16T07:53:37.776804+0000","last_fullsized":"2024-09-16T07:53:37.776804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.079591+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:53:07.079591+0000","last_peered":"2024-09-16T07:53:07.079591+0000","last_clean":"2024-09-16T07:53:07.079591+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:53:07.079591+0000","last_undegraded":"2024-09-16T07:53:07.079591+0000","last_fullsized":"2024-09-16T07:53:07.079591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":123928600,"num_objects":1892,"num_object_clones":0,"num_object_copies":5676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13776,"num_write_kb":501313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23678976,"data_stored":378667080,"data_compressed":17981136,"data_compressed_allocated":23666688,"data_compressed_original":378667008,"omap_allocated":0,"internal_metadata":0},"log_size":13790,"ondisk_log_size":13790,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49464,"kb_used_data":8104,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94322376,"statfs":{"total":96636764160,"available":96586113024,"internally_reserved":0,"allocated":8298496,"data_stored":121133609,"data_compressed":5740561,"data_compressed_allocated":7557120,"data_compressed_original":120832000,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48064,"kb_used_data":6896,"kb_used_omap":0,"kb_used_meta":41152,"kb_avail":94323776,"statfs":{"total":96636764160,"available":96587546624,"internally_reserved":0,"allocated":7061504,"data_stored":100894337,"data_compressed":4778953,"data_compressed_allocated":6291456,"data_compressed_original":100581376,"omap_allocated":0,"internal_metadata":42139648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612726,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45400,"kb_used_data":5000,"kb_used_omap":0,"kb_used_meta":40384,"kb_avail":94326440,"statfs":{"total":96636764160,"available":96590274560,"internally_reserved":0,"allocated":5120000,"data_stored":70670340,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":41353216},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44316,"kb_used_data":6540,"kb_used_omap":0,"kb_used_meta":37760,"kb_avail":94327524,"statfs":{"total":96636764160,"available":96591384576,"internally_reserved":0,"allocated":6696960,"data_stored":95443516,"data_compressed":4520657,"data_compressed_allocated":5951488,"data_compressed_original":95141888,"omap_allocated":0,"internal_metadata":38666240},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5914624,"data_stored":94568472,"data_compressed":4490616,"data_compressed_allocated":5910528,"data_compressed_original":94568448,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4399104,"data_stored":70385664,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6242304,"data_stored":99811352,"data_compressed":4739576,"data_compressed_allocated":6238208,"data_compressed_original":99811328,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":113901592,"data_compressed":5408656,"data_compressed_allocated":7118848,"data_compressed_original":113901568,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:13.450 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:13.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:13.593+0000 7fddbe6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:13.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:13.610+0000 7fddbe6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:13.976 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:13.976 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:13.998 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2024-09-16T07:54:13.010644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":124518976,"num_objects":1896,"num_object_clones":0,"num_object_copies":5688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13856,"num_write_kb":502420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13845,"ondisk_log_size":13845,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":187244,"kb_used_data":26540,"kb_used_omap":0,"kb_used_meta":160640,"kb_avail":377300116,"statfs":{"total":386547056640,"available":386355318784,"internally_reserved":0,"allocated":27176960,"data_stored":388141802,"data_compressed":18382459,"data_compressed_allocated":24199168,"data_compressed_original":386940928,"omap_allocated":0,"internal_metadata":164495360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.605783"},"pg_stats":[{"pgid":"5.f","version":"89'874","reported_seq":960,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.031938+0000","last_change":"2024-09-16T07:54:04.214969+0000","last_active":"2024-09-16T07:54:05.031938+0000","last_peered":"2024-09-16T07:54:05.031938+0000","last_clean":"2024-09-16T07:54:05.031938+0000","last_became_active":"2024-09-16T07:54:04.210072+0000","last_became_peered":"2024-09-16T07:54:04.210072+0000","last_unstale":"2024-09-16T07:54:05.031938+0000","last_undegraded":"2024-09-16T07:54:05.031938+0000","last_fullsized":"2024-09-16T07:54:05.031938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"86'959","reported_seq":1023,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.791120+0000","last_change":"2024-09-16T07:52:52.277260+0000","last_active":"2024-09-16T07:53:37.791120+0000","last_peered":"2024-09-16T07:53:37.791120+0000","last_clean":"2024-09-16T07:53:37.791120+0000","last_became_active":"2024-09-16T07:52:52.262891+0000","last_became_peered":"2024-09-16T07:52:52.262891+0000","last_unstale":"2024-09-16T07:53:37.791120+0000","last_undegraded":"2024-09-16T07:53:37.791120+0000","last_fullsized":"2024-09-16T07:53:37.791120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":957,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"86'819","reported_seq":884,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.770630+0000","last_change":"2024-09-16T07:52:52.289123+0000","last_active":"2024-09-16T07:53:37.770630+0000","last_peered":"2024-09-16T07:53:37.770630+0000","last_clean":"2024-09-16T07:53:37.770630+0000","last_became_active":"2024-09-16T07:52:52.272220+0000","last_became_peered":"2024-09-16T07:52:52.272220+0000","last_unstale":"2024-09-16T07:53:37.770630+0000","last_undegraded":"2024-09-16T07:53:37.770630+0000","last_fullsized":"2024-09-16T07:53:37.770630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946840,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":817,"num_write_kb":29505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"86'888","reported_seq":961,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:34.155416+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:34.155416+0000","last_peered":"2024-09-16T07:53:34.155416+0000","last_clean":"2024-09-16T07:53:34.155416+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:54:02.039638+0000","last_undegraded":"2024-09-16T07:53:34.155416+0000","last_fullsized":"2024-09-16T07:53:34.155416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":33728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"86'915","reported_seq":984,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.896054+0000","last_change":"2024-09-16T07:52:52.234905+0000","last_active":"2024-09-16T07:53:37.896054+0000","last_peered":"2024-09-16T07:53:37.896054+0000","last_clean":"2024-09-16T07:53:37.896054+0000","last_became_active":"2024-09-16T07:52:52.218746+0000","last_became_peered":"2024-09-16T07:52:52.218746+0000","last_unstale":"2024-09-16T07:53:37.896054+0000","last_undegraded":"2024-09-16T07:53:37.896054+0000","last_fullsized":"2024-09-16T07:53:37.896054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":913,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"86'837","reported_seq":910,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.659685+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:35.659685+0000","last_peered":"2024-09-16T07:53:35.659685+0000","last_clean":"2024-09-16T07:53:35.659685+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:35.659685+0000","last_undegraded":"2024-09-16T07:53:35.659685+0000","last_fullsized":"2024-09-16T07:53:35.659685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"86'894","reported_seq":960,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.846167+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:53:37.846167+0000","last_peered":"2024-09-16T07:53:37.846167+0000","last_clean":"2024-09-16T07:53:37.846167+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:53:37.846167+0000","last_undegraded":"2024-09-16T07:53:37.846167+0000","last_fullsized":"2024-09-16T07:53:37.846167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":894,"num_write_kb":31616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"86'817","reported_seq":886,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.581973+0000","last_change":"2024-09-16T07:52:52.200280+0000","last_active":"2024-09-16T07:53:37.581973+0000","last_peered":"2024-09-16T07:53:37.581973+0000","last_clean":"2024-09-16T07:53:37.581973+0000","last_became_active":"2024-09-16T07:52:52.189353+0000","last_became_peered":"2024-09-16T07:52:52.189353+0000","last_unstale":"2024-09-16T07:53:37.581973+0000","last_undegraded":"2024-09-16T07:53:37.581973+0000","last_fullsized":"2024-09-16T07:53:37.581973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":29312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"89'885","reported_seq":979,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.028546+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:54:05.028546+0000","last_peered":"2024-09-16T07:54:05.028546+0000","last_clean":"2024-09-16T07:54:05.028546+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:54:05.028546+0000","last_undegraded":"2024-09-16T07:54:05.028546+0000","last_fullsized":"2024-09-16T07:54:05.028546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":885,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":269,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.062548+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:07.062548+0000","last_peered":"2024-09-16T07:53:07.062548+0000","last_clean":"2024-09-16T07:53:07.062548+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:54:02.039639+0000","last_undegraded":"2024-09-16T07:53:07.062548+0000","last_fullsized":"2024-09-16T07:53:07.062548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":213,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.083910+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:53:07.083910+0000","last_peered":"2024-09-16T07:53:07.083910+0000","last_clean":"2024-09-16T07:53:07.083910+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:53:07.083910+0000","last_undegraded":"2024-09-16T07:53:07.083910+0000","last_fullsized":"2024-09-16T07:53:07.083910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"86'880","reported_seq":949,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.587837+0000","last_change":"2024-09-16T07:52:52.282162+0000","last_active":"2024-09-16T07:53:37.587837+0000","last_peered":"2024-09-16T07:53:37.587837+0000","last_clean":"2024-09-16T07:53:37.587837+0000","last_became_active":"2024-09-16T07:52:52.259966+0000","last_became_peered":"2024-09-16T07:52:52.259966+0000","last_unstale":"2024-09-16T07:53:37.587837+0000","last_undegraded":"2024-09-16T07:53:37.587837+0000","last_fullsized":"2024-09-16T07:53:37.587837+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":878,"num_write_kb":31168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.089151+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:53:07.089151+0000","last_peered":"2024-09-16T07:53:07.089151+0000","last_clean":"2024-09-16T07:53:07.089151+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:53:07.089151+0000","last_undegraded":"2024-09-16T07:53:07.089151+0000","last_fullsized":"2024-09-16T07:53:07.089151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"86'774","reported_seq":847,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.627019+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:35.627019+0000","last_peered":"2024-09-16T07:53:35.627019+0000","last_clean":"2024-09-16T07:53:35.627019+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:35.627019+0000","last_undegraded":"2024-09-16T07:53:35.627019+0000","last_fullsized":"2024-09-16T07:53:35.627019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.078278+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:53:07.078278+0000","last_peered":"2024-09-16T07:53:07.078278+0000","last_clean":"2024-09-16T07:53:07.078278+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:53:07.078278+0000","last_undegraded":"2024-09-16T07:53:07.078278+0000","last_fullsized":"2024-09-16T07:53:07.078278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"86'815","reported_seq":901,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.021553+0000","last_change":"2024-09-16T07:54:04.265645+0000","last_active":"2024-09-16T07:54:05.021553+0000","last_peered":"2024-09-16T07:54:05.021553+0000","last_clean":"2024-09-16T07:54:05.021553+0000","last_became_active":"2024-09-16T07:54:04.121359+0000","last_became_peered":"2024-09-16T07:54:04.121359+0000","last_unstale":"2024-09-16T07:54:05.021553+0000","last_undegraded":"2024-09-16T07:54:05.021553+0000","last_fullsized":"2024-09-16T07:54:05.021553+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":138,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.084006+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:53:07.084006+0000","last_peered":"2024-09-16T07:53:07.084006+0000","last_clean":"2024-09-16T07:53:07.084006+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:53:07.084006+0000","last_undegraded":"2024-09-16T07:53:07.084006+0000","last_fullsized":"2024-09-16T07:53:07.084006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"89'825","reported_seq":915,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.027941+0000","last_change":"2024-09-16T07:54:04.150160+0000","last_active":"2024-09-16T07:54:05.027941+0000","last_peered":"2024-09-16T07:54:05.027941+0000","last_clean":"2024-09-16T07:54:05.027941+0000","last_became_active":"2024-09-16T07:54:04.140385+0000","last_became_peered":"2024-09-16T07:54:04.140385+0000","last_unstale":"2024-09-16T07:54:05.027941+0000","last_undegraded":"2024-09-16T07:54:05.027941+0000","last_fullsized":"2024-09-16T07:54:05.027941+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.029835+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:05.029835+0000","last_peered":"2024-09-16T07:54:05.029835+0000","last_clean":"2024-09-16T07:54:05.029835+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:05.029835+0000","last_undegraded":"2024-09-16T07:54:05.029835+0000","last_fullsized":"2024-09-16T07:54:05.029835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"86'892","reported_seq":963,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.846279+0000","last_change":"2024-09-16T07:52:52.205171+0000","last_active":"2024-09-16T07:53:37.846279+0000","last_peered":"2024-09-16T07:53:37.846279+0000","last_clean":"2024-09-16T07:53:37.846279+0000","last_became_active":"2024-09-16T07:52:52.197079+0000","last_became_peered":"2024-09-16T07:52:52.197079+0000","last_unstale":"2024-09-16T07:53:37.846279+0000","last_undegraded":"2024-09-16T07:53:37.846279+0000","last_fullsized":"2024-09-16T07:53:37.846279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.060956+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:07.060956+0000","last_peered":"2024-09-16T07:53:07.060956+0000","last_clean":"2024-09-16T07:53:07.060956+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:54:02.039642+0000","last_undegraded":"2024-09-16T07:53:07.060956+0000","last_fullsized":"2024-09-16T07:53:07.060956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"86'840","reported_seq":908,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:34.275962+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:34.275962+0000","last_peered":"2024-09-16T07:53:34.275962+0000","last_clean":"2024-09-16T07:53:34.275962+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:54:02.039643+0000","last_undegraded":"2024-09-16T07:53:34.275962+0000","last_fullsized":"2024-09-16T07:53:34.275962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":31488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.024313+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:05.024313+0000","last_peered":"2024-09-16T07:54:05.024313+0000","last_clean":"2024-09-16T07:54:05.024313+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:05.024313+0000","last_undegraded":"2024-09-16T07:54:05.024313+0000","last_fullsized":"2024-09-16T07:54:05.024313+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"86'876","reported_seq":955,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.776804+0000","last_change":"2024-09-16T07:52:52.541645+0000","last_active":"2024-09-16T07:53:37.776804+0000","last_peered":"2024-09-16T07:53:37.776804+0000","last_clean":"2024-09-16T07:53:37.776804+0000","last_became_active":"2024-09-16T07:52:52.268878+0000","last_became_peered":"2024-09-16T07:52:52.268878+0000","last_unstale":"2024-09-16T07:53:37.776804+0000","last_undegraded":"2024-09-16T07:53:37.776804+0000","last_fullsized":"2024-09-16T07:53:37.776804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.079591+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:53:07.079591+0000","last_peered":"2024-09-16T07:53:07.079591+0000","last_clean":"2024-09-16T07:53:07.079591+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:53:07.079591+0000","last_undegraded":"2024-09-16T07:53:07.079591+0000","last_fullsized":"2024-09-16T07:53:07.079591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":123928600,"num_objects":1892,"num_object_clones":0,"num_object_copies":5676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13776,"num_write_kb":501313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23678976,"data_stored":378667080,"data_compressed":17981136,"data_compressed_allocated":23666688,"data_compressed_original":378667008,"omap_allocated":0,"internal_metadata":0},"log_size":13790,"ondisk_log_size":13790,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49464,"kb_used_data":8104,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94322376,"statfs":{"total":96636764160,"available":96586113024,"internally_reserved":0,"allocated":8298496,"data_stored":121133609,"data_compressed":5740561,"data_compressed_allocated":7557120,"data_compressed_original":120832000,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48064,"kb_used_data":6896,"kb_used_omap":0,"kb_used_meta":41152,"kb_avail":94323776,"statfs":{"total":96636764160,"available":96587546624,"internally_reserved":0,"allocated":7061504,"data_stored":100894337,"data_compressed":4778953,"data_compressed_allocated":6291456,"data_compressed_original":100581376,"omap_allocated":0,"internal_metadata":42139648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612726,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45400,"kb_used_data":5000,"kb_used_omap":0,"kb_used_meta":40384,"kb_avail":94326440,"statfs":{"total":96636764160,"available":96590274560,"internally_reserved":0,"allocated":5120000,"data_stored":70670340,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":41353216},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44316,"kb_used_data":6540,"kb_used_omap":0,"kb_used_meta":37760,"kb_avail":94327524,"statfs":{"total":96636764160,"available":96591384576,"internally_reserved":0,"allocated":6696960,"data_stored":95443516,"data_compressed":4520657,"data_compressed_allocated":5951488,"data_compressed_original":95141888,"omap_allocated":0,"internal_metadata":38666240},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5914624,"data_stored":94568472,"data_compressed":4490616,"data_compressed_allocated":5910528,"data_compressed_original":94568448,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4399104,"data_stored":70385664,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6242304,"data_stored":99811352,"data_compressed":4739576,"data_compressed_allocated":6238208,"data_compressed_original":99811328,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":113901592,"data_compressed":5408656,"data_compressed_allocated":7118848,"data_compressed_original":113901568,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:14.000 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:54:14.153 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:14.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:14.168+0000 7fe1a107d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:14.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:14.180+0000 7fe1a107d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:14.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:14.308+0000 7f2228111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:14.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:14.319+0000 7f2228111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:14.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:14.658 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":556,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":94,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473243,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":21},{"state_name":"stale+active+clean","count":4}],"num_pgs":25,"num_pools":3,"num_objects":1896,"data_bytes":124518976,"bytes_used":191737856,"bytes_avail":386355318784,"bytes_total":386547056640},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:54:14.677 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:54:14.677 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:14.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:14.851+0000 7fe1e7d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:14.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:14.863+0000 7fe1e7d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:15.193 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:15.193 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:15.212 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2024-09-16T07:54:14.406023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":124518976,"num_objects":1896,"num_object_clones":0,"num_object_copies":5688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13856,"num_write_kb":502420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13845,"ondisk_log_size":13845,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":187244,"kb_used_data":26540,"kb_used_omap":0,"kb_used_meta":160640,"kb_avail":377300116,"statfs":{"total":386547056640,"available":386355318784,"internally_reserved":0,"allocated":27176960,"data_stored":388141802,"data_compressed":18382459,"data_compressed_allocated":24199168,"data_compressed_original":386940928,"omap_allocated":0,"internal_metadata":164495360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.395027"},"pg_stats":[{"pgid":"5.f","version":"89'874","reported_seq":960,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.031938+0000","last_change":"2024-09-16T07:54:04.214969+0000","last_active":"2024-09-16T07:54:05.031938+0000","last_peered":"2024-09-16T07:54:05.031938+0000","last_clean":"2024-09-16T07:54:05.031938+0000","last_became_active":"2024-09-16T07:54:04.210072+0000","last_became_peered":"2024-09-16T07:54:04.210072+0000","last_unstale":"2024-09-16T07:54:05.031938+0000","last_undegraded":"2024-09-16T07:54:05.031938+0000","last_fullsized":"2024-09-16T07:54:05.031938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"86'959","reported_seq":1023,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.791120+0000","last_change":"2024-09-16T07:52:52.277260+0000","last_active":"2024-09-16T07:53:37.791120+0000","last_peered":"2024-09-16T07:53:37.791120+0000","last_clean":"2024-09-16T07:53:37.791120+0000","last_became_active":"2024-09-16T07:52:52.262891+0000","last_became_peered":"2024-09-16T07:52:52.262891+0000","last_unstale":"2024-09-16T07:53:37.791120+0000","last_undegraded":"2024-09-16T07:53:37.791120+0000","last_fullsized":"2024-09-16T07:53:37.791120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":957,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"86'819","reported_seq":884,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.770630+0000","last_change":"2024-09-16T07:52:52.289123+0000","last_active":"2024-09-16T07:53:37.770630+0000","last_peered":"2024-09-16T07:53:37.770630+0000","last_clean":"2024-09-16T07:53:37.770630+0000","last_became_active":"2024-09-16T07:52:52.272220+0000","last_became_peered":"2024-09-16T07:52:52.272220+0000","last_unstale":"2024-09-16T07:53:37.770630+0000","last_undegraded":"2024-09-16T07:53:37.770630+0000","last_fullsized":"2024-09-16T07:53:37.770630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946840,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":817,"num_write_kb":29505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"86'888","reported_seq":961,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:34.155416+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:34.155416+0000","last_peered":"2024-09-16T07:53:34.155416+0000","last_clean":"2024-09-16T07:53:34.155416+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:54:02.039638+0000","last_undegraded":"2024-09-16T07:53:34.155416+0000","last_fullsized":"2024-09-16T07:53:34.155416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":33728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"86'915","reported_seq":984,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.896054+0000","last_change":"2024-09-16T07:52:52.234905+0000","last_active":"2024-09-16T07:53:37.896054+0000","last_peered":"2024-09-16T07:53:37.896054+0000","last_clean":"2024-09-16T07:53:37.896054+0000","last_became_active":"2024-09-16T07:52:52.218746+0000","last_became_peered":"2024-09-16T07:52:52.218746+0000","last_unstale":"2024-09-16T07:53:37.896054+0000","last_undegraded":"2024-09-16T07:53:37.896054+0000","last_fullsized":"2024-09-16T07:53:37.896054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":913,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"86'837","reported_seq":910,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.659685+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:35.659685+0000","last_peered":"2024-09-16T07:53:35.659685+0000","last_clean":"2024-09-16T07:53:35.659685+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:35.659685+0000","last_undegraded":"2024-09-16T07:53:35.659685+0000","last_fullsized":"2024-09-16T07:53:35.659685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"86'894","reported_seq":960,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.846167+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:53:37.846167+0000","last_peered":"2024-09-16T07:53:37.846167+0000","last_clean":"2024-09-16T07:53:37.846167+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:53:37.846167+0000","last_undegraded":"2024-09-16T07:53:37.846167+0000","last_fullsized":"2024-09-16T07:53:37.846167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":894,"num_write_kb":31616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"86'817","reported_seq":886,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.581973+0000","last_change":"2024-09-16T07:52:52.200280+0000","last_active":"2024-09-16T07:53:37.581973+0000","last_peered":"2024-09-16T07:53:37.581973+0000","last_clean":"2024-09-16T07:53:37.581973+0000","last_became_active":"2024-09-16T07:52:52.189353+0000","last_became_peered":"2024-09-16T07:52:52.189353+0000","last_unstale":"2024-09-16T07:53:37.581973+0000","last_undegraded":"2024-09-16T07:53:37.581973+0000","last_fullsized":"2024-09-16T07:53:37.581973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":29312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"89'885","reported_seq":979,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.028546+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:54:05.028546+0000","last_peered":"2024-09-16T07:54:05.028546+0000","last_clean":"2024-09-16T07:54:05.028546+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:54:05.028546+0000","last_undegraded":"2024-09-16T07:54:05.028546+0000","last_fullsized":"2024-09-16T07:54:05.028546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":885,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":269,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.062548+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:07.062548+0000","last_peered":"2024-09-16T07:53:07.062548+0000","last_clean":"2024-09-16T07:53:07.062548+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:54:02.039639+0000","last_undegraded":"2024-09-16T07:53:07.062548+0000","last_fullsized":"2024-09-16T07:53:07.062548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":213,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.083910+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:53:07.083910+0000","last_peered":"2024-09-16T07:53:07.083910+0000","last_clean":"2024-09-16T07:53:07.083910+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:53:07.083910+0000","last_undegraded":"2024-09-16T07:53:07.083910+0000","last_fullsized":"2024-09-16T07:53:07.083910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"86'880","reported_seq":949,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.587837+0000","last_change":"2024-09-16T07:52:52.282162+0000","last_active":"2024-09-16T07:53:37.587837+0000","last_peered":"2024-09-16T07:53:37.587837+0000","last_clean":"2024-09-16T07:53:37.587837+0000","last_became_active":"2024-09-16T07:52:52.259966+0000","last_became_peered":"2024-09-16T07:52:52.259966+0000","last_unstale":"2024-09-16T07:53:37.587837+0000","last_undegraded":"2024-09-16T07:53:37.587837+0000","last_fullsized":"2024-09-16T07:53:37.587837+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":878,"num_write_kb":31168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.089151+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:53:07.089151+0000","last_peered":"2024-09-16T07:53:07.089151+0000","last_clean":"2024-09-16T07:53:07.089151+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:53:07.089151+0000","last_undegraded":"2024-09-16T07:53:07.089151+0000","last_fullsized":"2024-09-16T07:53:07.089151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"86'774","reported_seq":847,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.627019+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:35.627019+0000","last_peered":"2024-09-16T07:53:35.627019+0000","last_clean":"2024-09-16T07:53:35.627019+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:35.627019+0000","last_undegraded":"2024-09-16T07:53:35.627019+0000","last_fullsized":"2024-09-16T07:53:35.627019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.078278+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:53:07.078278+0000","last_peered":"2024-09-16T07:53:07.078278+0000","last_clean":"2024-09-16T07:53:07.078278+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:53:07.078278+0000","last_undegraded":"2024-09-16T07:53:07.078278+0000","last_fullsized":"2024-09-16T07:53:07.078278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"86'815","reported_seq":901,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.021553+0000","last_change":"2024-09-16T07:54:04.265645+0000","last_active":"2024-09-16T07:54:05.021553+0000","last_peered":"2024-09-16T07:54:05.021553+0000","last_clean":"2024-09-16T07:54:05.021553+0000","last_became_active":"2024-09-16T07:54:04.121359+0000","last_became_peered":"2024-09-16T07:54:04.121359+0000","last_unstale":"2024-09-16T07:54:05.021553+0000","last_undegraded":"2024-09-16T07:54:05.021553+0000","last_fullsized":"2024-09-16T07:54:05.021553+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":138,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.084006+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:53:07.084006+0000","last_peered":"2024-09-16T07:53:07.084006+0000","last_clean":"2024-09-16T07:53:07.084006+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:53:07.084006+0000","last_undegraded":"2024-09-16T07:53:07.084006+0000","last_fullsized":"2024-09-16T07:53:07.084006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"89'825","reported_seq":915,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.027941+0000","last_change":"2024-09-16T07:54:04.150160+0000","last_active":"2024-09-16T07:54:05.027941+0000","last_peered":"2024-09-16T07:54:05.027941+0000","last_clean":"2024-09-16T07:54:05.027941+0000","last_became_active":"2024-09-16T07:54:04.140385+0000","last_became_peered":"2024-09-16T07:54:04.140385+0000","last_unstale":"2024-09-16T07:54:05.027941+0000","last_undegraded":"2024-09-16T07:54:05.027941+0000","last_fullsized":"2024-09-16T07:54:05.027941+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.029835+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:05.029835+0000","last_peered":"2024-09-16T07:54:05.029835+0000","last_clean":"2024-09-16T07:54:05.029835+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:05.029835+0000","last_undegraded":"2024-09-16T07:54:05.029835+0000","last_fullsized":"2024-09-16T07:54:05.029835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"86'892","reported_seq":963,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.846279+0000","last_change":"2024-09-16T07:52:52.205171+0000","last_active":"2024-09-16T07:53:37.846279+0000","last_peered":"2024-09-16T07:53:37.846279+0000","last_clean":"2024-09-16T07:53:37.846279+0000","last_became_active":"2024-09-16T07:52:52.197079+0000","last_became_peered":"2024-09-16T07:52:52.197079+0000","last_unstale":"2024-09-16T07:53:37.846279+0000","last_undegraded":"2024-09-16T07:53:37.846279+0000","last_fullsized":"2024-09-16T07:53:37.846279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.060956+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:07.060956+0000","last_peered":"2024-09-16T07:53:07.060956+0000","last_clean":"2024-09-16T07:53:07.060956+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:54:02.039642+0000","last_undegraded":"2024-09-16T07:53:07.060956+0000","last_fullsized":"2024-09-16T07:53:07.060956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"86'840","reported_seq":908,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:34.275962+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:34.275962+0000","last_peered":"2024-09-16T07:53:34.275962+0000","last_clean":"2024-09-16T07:53:34.275962+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:54:02.039643+0000","last_undegraded":"2024-09-16T07:53:34.275962+0000","last_fullsized":"2024-09-16T07:53:34.275962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":31488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.024313+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:05.024313+0000","last_peered":"2024-09-16T07:54:05.024313+0000","last_clean":"2024-09-16T07:54:05.024313+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:05.024313+0000","last_undegraded":"2024-09-16T07:54:05.024313+0000","last_fullsized":"2024-09-16T07:54:05.024313+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"86'876","reported_seq":955,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.776804+0000","last_change":"2024-09-16T07:52:52.541645+0000","last_active":"2024-09-16T07:53:37.776804+0000","last_peered":"2024-09-16T07:53:37.776804+0000","last_clean":"2024-09-16T07:53:37.776804+0000","last_became_active":"2024-09-16T07:52:52.268878+0000","last_became_peered":"2024-09-16T07:52:52.268878+0000","last_unstale":"2024-09-16T07:53:37.776804+0000","last_undegraded":"2024-09-16T07:53:37.776804+0000","last_fullsized":"2024-09-16T07:53:37.776804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.079591+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:53:07.079591+0000","last_peered":"2024-09-16T07:53:07.079591+0000","last_clean":"2024-09-16T07:53:07.079591+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:53:07.079591+0000","last_undegraded":"2024-09-16T07:53:07.079591+0000","last_fullsized":"2024-09-16T07:53:07.079591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":123928600,"num_objects":1892,"num_object_clones":0,"num_object_copies":5676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13776,"num_write_kb":501313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23678976,"data_stored":378667080,"data_compressed":17981136,"data_compressed_allocated":23666688,"data_compressed_original":378667008,"omap_allocated":0,"internal_metadata":0},"log_size":13790,"ondisk_log_size":13790,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49464,"kb_used_data":8104,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94322376,"statfs":{"total":96636764160,"available":96586113024,"internally_reserved":0,"allocated":8298496,"data_stored":121133609,"data_compressed":5740561,"data_compressed_allocated":7557120,"data_compressed_original":120832000,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48064,"kb_used_data":6896,"kb_used_omap":0,"kb_used_meta":41152,"kb_avail":94323776,"statfs":{"total":96636764160,"available":96587546624,"internally_reserved":0,"allocated":7061504,"data_stored":100894337,"data_compressed":4778953,"data_compressed_allocated":6291456,"data_compressed_original":100581376,"omap_allocated":0,"internal_metadata":42139648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612726,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45400,"kb_used_data":5000,"kb_used_omap":0,"kb_used_meta":40384,"kb_avail":94326440,"statfs":{"total":96636764160,"available":96590274560,"internally_reserved":0,"allocated":5120000,"data_stored":70670340,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":41353216},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44316,"kb_used_data":6540,"kb_used_omap":0,"kb_used_meta":37760,"kb_avail":94327524,"statfs":{"total":96636764160,"available":96591384576,"internally_reserved":0,"allocated":6696960,"data_stored":95443516,"data_compressed":4520657,"data_compressed_allocated":5951488,"data_compressed_original":95141888,"omap_allocated":0,"internal_metadata":38666240},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5914624,"data_stored":94568472,"data_compressed":4490616,"data_compressed_allocated":5910528,"data_compressed_original":94568448,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4399104,"data_stored":70385664,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6242304,"data_stored":99811352,"data_compressed":4739576,"data_compressed_allocated":6238208,"data_compressed_original":99811328,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":113901592,"data_compressed":5408656,"data_compressed_allocated":7118848,"data_compressed_original":113901568,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:16.679 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:16.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:16.806+0000 7f46e0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:16.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:16.815+0000 7f46e0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:18.214 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:18.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:18.373+0000 7fe5fec9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:18.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:18.385+0000 7fe5fec9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:18.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:18.647 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:18.670 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":363,"stamp":"2024-09-16T07:54:18.406790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":124518976,"num_objects":1896,"num_object_clones":0,"num_object_copies":5688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13856,"num_write_kb":502420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13845,"ondisk_log_size":13845,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":187244,"kb_used_data":26540,"kb_used_omap":0,"kb_used_meta":160640,"kb_avail":377300116,"statfs":{"total":386547056640,"available":386355318784,"internally_reserved":0,"allocated":27176960,"data_stored":388141802,"data_compressed":18382459,"data_compressed_allocated":24199168,"data_compressed_original":386940928,"omap_allocated":0,"internal_metadata":164495360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.388234"},"pg_stats":[{"pgid":"5.f","version":"89'874","reported_seq":960,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.031938+0000","last_change":"2024-09-16T07:54:04.214969+0000","last_active":"2024-09-16T07:54:05.031938+0000","last_peered":"2024-09-16T07:54:05.031938+0000","last_clean":"2024-09-16T07:54:05.031938+0000","last_became_active":"2024-09-16T07:54:04.210072+0000","last_became_peered":"2024-09-16T07:54:04.210072+0000","last_unstale":"2024-09-16T07:54:05.031938+0000","last_undegraded":"2024-09-16T07:54:05.031938+0000","last_fullsized":"2024-09-16T07:54:05.031938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"86'959","reported_seq":1023,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.791120+0000","last_change":"2024-09-16T07:52:52.277260+0000","last_active":"2024-09-16T07:53:37.791120+0000","last_peered":"2024-09-16T07:53:37.791120+0000","last_clean":"2024-09-16T07:53:37.791120+0000","last_became_active":"2024-09-16T07:52:52.262891+0000","last_became_peered":"2024-09-16T07:52:52.262891+0000","last_unstale":"2024-09-16T07:53:37.791120+0000","last_undegraded":"2024-09-16T07:53:37.791120+0000","last_fullsized":"2024-09-16T07:53:37.791120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":957,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"86'819","reported_seq":884,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.770630+0000","last_change":"2024-09-16T07:52:52.289123+0000","last_active":"2024-09-16T07:53:37.770630+0000","last_peered":"2024-09-16T07:53:37.770630+0000","last_clean":"2024-09-16T07:53:37.770630+0000","last_became_active":"2024-09-16T07:52:52.272220+0000","last_became_peered":"2024-09-16T07:52:52.272220+0000","last_unstale":"2024-09-16T07:53:37.770630+0000","last_undegraded":"2024-09-16T07:53:37.770630+0000","last_fullsized":"2024-09-16T07:53:37.770630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946840,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":817,"num_write_kb":29505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"86'888","reported_seq":961,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:34.155416+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:34.155416+0000","last_peered":"2024-09-16T07:53:34.155416+0000","last_clean":"2024-09-16T07:53:34.155416+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:54:02.039638+0000","last_undegraded":"2024-09-16T07:53:34.155416+0000","last_fullsized":"2024-09-16T07:53:34.155416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":33728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"86'915","reported_seq":984,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.896054+0000","last_change":"2024-09-16T07:52:52.234905+0000","last_active":"2024-09-16T07:53:37.896054+0000","last_peered":"2024-09-16T07:53:37.896054+0000","last_clean":"2024-09-16T07:53:37.896054+0000","last_became_active":"2024-09-16T07:52:52.218746+0000","last_became_peered":"2024-09-16T07:52:52.218746+0000","last_unstale":"2024-09-16T07:53:37.896054+0000","last_undegraded":"2024-09-16T07:53:37.896054+0000","last_fullsized":"2024-09-16T07:53:37.896054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":913,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"86'837","reported_seq":910,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.659685+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:35.659685+0000","last_peered":"2024-09-16T07:53:35.659685+0000","last_clean":"2024-09-16T07:53:35.659685+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:35.659685+0000","last_undegraded":"2024-09-16T07:53:35.659685+0000","last_fullsized":"2024-09-16T07:53:35.659685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"86'894","reported_seq":960,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.846167+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:53:37.846167+0000","last_peered":"2024-09-16T07:53:37.846167+0000","last_clean":"2024-09-16T07:53:37.846167+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:53:37.846167+0000","last_undegraded":"2024-09-16T07:53:37.846167+0000","last_fullsized":"2024-09-16T07:53:37.846167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":894,"num_write_kb":31616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"86'817","reported_seq":886,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.581973+0000","last_change":"2024-09-16T07:52:52.200280+0000","last_active":"2024-09-16T07:53:37.581973+0000","last_peered":"2024-09-16T07:53:37.581973+0000","last_clean":"2024-09-16T07:53:37.581973+0000","last_became_active":"2024-09-16T07:52:52.189353+0000","last_became_peered":"2024-09-16T07:52:52.189353+0000","last_unstale":"2024-09-16T07:53:37.581973+0000","last_undegraded":"2024-09-16T07:53:37.581973+0000","last_fullsized":"2024-09-16T07:53:37.581973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":29312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"89'885","reported_seq":979,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.028546+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:54:05.028546+0000","last_peered":"2024-09-16T07:54:05.028546+0000","last_clean":"2024-09-16T07:54:05.028546+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:54:05.028546+0000","last_undegraded":"2024-09-16T07:54:05.028546+0000","last_fullsized":"2024-09-16T07:54:05.028546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":885,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":269,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.062548+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:07.062548+0000","last_peered":"2024-09-16T07:53:07.062548+0000","last_clean":"2024-09-16T07:53:07.062548+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:54:02.039639+0000","last_undegraded":"2024-09-16T07:53:07.062548+0000","last_fullsized":"2024-09-16T07:53:07.062548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":213,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.083910+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:53:07.083910+0000","last_peered":"2024-09-16T07:53:07.083910+0000","last_clean":"2024-09-16T07:53:07.083910+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:53:07.083910+0000","last_undegraded":"2024-09-16T07:53:07.083910+0000","last_fullsized":"2024-09-16T07:53:07.083910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"86'880","reported_seq":949,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.587837+0000","last_change":"2024-09-16T07:52:52.282162+0000","last_active":"2024-09-16T07:53:37.587837+0000","last_peered":"2024-09-16T07:53:37.587837+0000","last_clean":"2024-09-16T07:53:37.587837+0000","last_became_active":"2024-09-16T07:52:52.259966+0000","last_became_peered":"2024-09-16T07:52:52.259966+0000","last_unstale":"2024-09-16T07:53:37.587837+0000","last_undegraded":"2024-09-16T07:53:37.587837+0000","last_fullsized":"2024-09-16T07:53:37.587837+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":878,"num_write_kb":31168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.089151+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:53:07.089151+0000","last_peered":"2024-09-16T07:53:07.089151+0000","last_clean":"2024-09-16T07:53:07.089151+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:53:07.089151+0000","last_undegraded":"2024-09-16T07:53:07.089151+0000","last_fullsized":"2024-09-16T07:53:07.089151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"86'774","reported_seq":847,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.627019+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:35.627019+0000","last_peered":"2024-09-16T07:53:35.627019+0000","last_clean":"2024-09-16T07:53:35.627019+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:35.627019+0000","last_undegraded":"2024-09-16T07:53:35.627019+0000","last_fullsized":"2024-09-16T07:53:35.627019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.078278+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:53:07.078278+0000","last_peered":"2024-09-16T07:53:07.078278+0000","last_clean":"2024-09-16T07:53:07.078278+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:53:07.078278+0000","last_undegraded":"2024-09-16T07:53:07.078278+0000","last_fullsized":"2024-09-16T07:53:07.078278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"86'815","reported_seq":901,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.021553+0000","last_change":"2024-09-16T07:54:04.265645+0000","last_active":"2024-09-16T07:54:05.021553+0000","last_peered":"2024-09-16T07:54:05.021553+0000","last_clean":"2024-09-16T07:54:05.021553+0000","last_became_active":"2024-09-16T07:54:04.121359+0000","last_became_peered":"2024-09-16T07:54:04.121359+0000","last_unstale":"2024-09-16T07:54:05.021553+0000","last_undegraded":"2024-09-16T07:54:05.021553+0000","last_fullsized":"2024-09-16T07:54:05.021553+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":138,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.084006+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:53:07.084006+0000","last_peered":"2024-09-16T07:53:07.084006+0000","last_clean":"2024-09-16T07:53:07.084006+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:53:07.084006+0000","last_undegraded":"2024-09-16T07:53:07.084006+0000","last_fullsized":"2024-09-16T07:53:07.084006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"89'825","reported_seq":915,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.027941+0000","last_change":"2024-09-16T07:54:04.150160+0000","last_active":"2024-09-16T07:54:05.027941+0000","last_peered":"2024-09-16T07:54:05.027941+0000","last_clean":"2024-09-16T07:54:05.027941+0000","last_became_active":"2024-09-16T07:54:04.140385+0000","last_became_peered":"2024-09-16T07:54:04.140385+0000","last_unstale":"2024-09-16T07:54:05.027941+0000","last_undegraded":"2024-09-16T07:54:05.027941+0000","last_fullsized":"2024-09-16T07:54:05.027941+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.029835+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:05.029835+0000","last_peered":"2024-09-16T07:54:05.029835+0000","last_clean":"2024-09-16T07:54:05.029835+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:05.029835+0000","last_undegraded":"2024-09-16T07:54:05.029835+0000","last_fullsized":"2024-09-16T07:54:05.029835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"86'892","reported_seq":963,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.846279+0000","last_change":"2024-09-16T07:52:52.205171+0000","last_active":"2024-09-16T07:53:37.846279+0000","last_peered":"2024-09-16T07:53:37.846279+0000","last_clean":"2024-09-16T07:53:37.846279+0000","last_became_active":"2024-09-16T07:52:52.197079+0000","last_became_peered":"2024-09-16T07:52:52.197079+0000","last_unstale":"2024-09-16T07:53:37.846279+0000","last_undegraded":"2024-09-16T07:53:37.846279+0000","last_fullsized":"2024-09-16T07:53:37.846279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.060956+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:07.060956+0000","last_peered":"2024-09-16T07:53:07.060956+0000","last_clean":"2024-09-16T07:53:07.060956+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:54:02.039642+0000","last_undegraded":"2024-09-16T07:53:07.060956+0000","last_fullsized":"2024-09-16T07:53:07.060956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"86'840","reported_seq":908,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:34.275962+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:34.275962+0000","last_peered":"2024-09-16T07:53:34.275962+0000","last_clean":"2024-09-16T07:53:34.275962+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:54:02.039643+0000","last_undegraded":"2024-09-16T07:53:34.275962+0000","last_fullsized":"2024-09-16T07:53:34.275962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":31488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.024313+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:05.024313+0000","last_peered":"2024-09-16T07:54:05.024313+0000","last_clean":"2024-09-16T07:54:05.024313+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:05.024313+0000","last_undegraded":"2024-09-16T07:54:05.024313+0000","last_fullsized":"2024-09-16T07:54:05.024313+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"86'876","reported_seq":955,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.776804+0000","last_change":"2024-09-16T07:52:52.541645+0000","last_active":"2024-09-16T07:53:37.776804+0000","last_peered":"2024-09-16T07:53:37.776804+0000","last_clean":"2024-09-16T07:53:37.776804+0000","last_became_active":"2024-09-16T07:52:52.268878+0000","last_became_peered":"2024-09-16T07:52:52.268878+0000","last_unstale":"2024-09-16T07:53:37.776804+0000","last_undegraded":"2024-09-16T07:53:37.776804+0000","last_fullsized":"2024-09-16T07:53:37.776804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.079591+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:53:07.079591+0000","last_peered":"2024-09-16T07:53:07.079591+0000","last_clean":"2024-09-16T07:53:07.079591+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:53:07.079591+0000","last_undegraded":"2024-09-16T07:53:07.079591+0000","last_fullsized":"2024-09-16T07:53:07.079591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":123928600,"num_objects":1892,"num_object_clones":0,"num_object_copies":5676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13776,"num_write_kb":501313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23678976,"data_stored":378667080,"data_compressed":17981136,"data_compressed_allocated":23666688,"data_compressed_original":378667008,"omap_allocated":0,"internal_metadata":0},"log_size":13790,"ondisk_log_size":13790,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49464,"kb_used_data":8104,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94322376,"statfs":{"total":96636764160,"available":96586113024,"internally_reserved":0,"allocated":8298496,"data_stored":121133609,"data_compressed":5740561,"data_compressed_allocated":7557120,"data_compressed_original":120832000,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48064,"kb_used_data":6896,"kb_used_omap":0,"kb_used_meta":41152,"kb_avail":94323776,"statfs":{"total":96636764160,"available":96587546624,"internally_reserved":0,"allocated":7061504,"data_stored":100894337,"data_compressed":4778953,"data_compressed_allocated":6291456,"data_compressed_original":100581376,"omap_allocated":0,"internal_metadata":42139648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612726,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45400,"kb_used_data":5000,"kb_used_omap":0,"kb_used_meta":40384,"kb_avail":94326440,"statfs":{"total":96636764160,"available":96590274560,"internally_reserved":0,"allocated":5120000,"data_stored":70670340,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":41353216},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44316,"kb_used_data":6540,"kb_used_omap":0,"kb_used_meta":37760,"kb_avail":94327524,"statfs":{"total":96636764160,"available":96591384576,"internally_reserved":0,"allocated":6696960,"data_stored":95443516,"data_compressed":4520657,"data_compressed_allocated":5951488,"data_compressed_original":95141888,"omap_allocated":0,"internal_metadata":38666240},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5914624,"data_stored":94568472,"data_compressed":4490616,"data_compressed_allocated":5910528,"data_compressed_original":94568448,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4399104,"data_stored":70385664,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6242304,"data_stored":99811352,"data_compressed":4739576,"data_compressed_allocated":6238208,"data_compressed_original":99811328,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":113901592,"data_compressed":5408656,"data_compressed_allocated":7118848,"data_compressed_original":113901568,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:18.671 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:54:18.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:18.825+0000 7fa9e0afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:18.840+0000 7fa9e0afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:19.059 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Removed 7847 objects 2024-09-16T07:54:19.059 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Clean up completed and total clean up time :68.9523 2024-09-16T07:54:19.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:19.161 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":561,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":94,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473243,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":21},{"state_name":"stale+active+clean","count":4}],"num_pgs":25,"num_pools":3,"num_objects":1896,"data_bytes":124518976,"bytes_used":191737856,"bytes_avail":386355318784,"bytes_total":386547056640},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:54:19.176 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:54:19.176 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:19.184 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:19.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:19.301+0000 7fc89bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:19.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:19.311+0000 7fc89bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:19.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:19.360+0000 7f00f5591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:19.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:19.369+0000 7f00f5591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:19.525 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:19.526 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:19.540 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":363,"stamp":"2024-09-16T07:54:18.406790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":124518976,"num_objects":1896,"num_object_clones":0,"num_object_copies":5688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13856,"num_write_kb":502420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13845,"ondisk_log_size":13845,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":187244,"kb_used_data":26540,"kb_used_omap":0,"kb_used_meta":160640,"kb_avail":377300116,"statfs":{"total":386547056640,"available":386355318784,"internally_reserved":0,"allocated":27176960,"data_stored":388141802,"data_compressed":18382459,"data_compressed_allocated":24199168,"data_compressed_original":386940928,"omap_allocated":0,"internal_metadata":164495360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.388234"},"pg_stats":[{"pgid":"5.f","version":"89'874","reported_seq":960,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.031938+0000","last_change":"2024-09-16T07:54:04.214969+0000","last_active":"2024-09-16T07:54:05.031938+0000","last_peered":"2024-09-16T07:54:05.031938+0000","last_clean":"2024-09-16T07:54:05.031938+0000","last_became_active":"2024-09-16T07:54:04.210072+0000","last_became_peered":"2024-09-16T07:54:04.210072+0000","last_unstale":"2024-09-16T07:54:05.031938+0000","last_undegraded":"2024-09-16T07:54:05.031938+0000","last_fullsized":"2024-09-16T07:54:05.031938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"86'959","reported_seq":1023,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.791120+0000","last_change":"2024-09-16T07:52:52.277260+0000","last_active":"2024-09-16T07:53:37.791120+0000","last_peered":"2024-09-16T07:53:37.791120+0000","last_clean":"2024-09-16T07:53:37.791120+0000","last_became_active":"2024-09-16T07:52:52.262891+0000","last_became_peered":"2024-09-16T07:52:52.262891+0000","last_unstale":"2024-09-16T07:53:37.791120+0000","last_undegraded":"2024-09-16T07:53:37.791120+0000","last_fullsized":"2024-09-16T07:53:37.791120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":957,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"86'819","reported_seq":884,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.770630+0000","last_change":"2024-09-16T07:52:52.289123+0000","last_active":"2024-09-16T07:53:37.770630+0000","last_peered":"2024-09-16T07:53:37.770630+0000","last_clean":"2024-09-16T07:53:37.770630+0000","last_became_active":"2024-09-16T07:52:52.272220+0000","last_became_peered":"2024-09-16T07:52:52.272220+0000","last_unstale":"2024-09-16T07:53:37.770630+0000","last_undegraded":"2024-09-16T07:53:37.770630+0000","last_fullsized":"2024-09-16T07:53:37.770630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946840,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":817,"num_write_kb":29505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"86'888","reported_seq":961,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:34.155416+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:34.155416+0000","last_peered":"2024-09-16T07:53:34.155416+0000","last_clean":"2024-09-16T07:53:34.155416+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:54:02.039638+0000","last_undegraded":"2024-09-16T07:53:34.155416+0000","last_fullsized":"2024-09-16T07:53:34.155416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":33728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"86'915","reported_seq":984,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.896054+0000","last_change":"2024-09-16T07:52:52.234905+0000","last_active":"2024-09-16T07:53:37.896054+0000","last_peered":"2024-09-16T07:53:37.896054+0000","last_clean":"2024-09-16T07:53:37.896054+0000","last_became_active":"2024-09-16T07:52:52.218746+0000","last_became_peered":"2024-09-16T07:52:52.218746+0000","last_unstale":"2024-09-16T07:53:37.896054+0000","last_undegraded":"2024-09-16T07:53:37.896054+0000","last_fullsized":"2024-09-16T07:53:37.896054+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":913,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"86'837","reported_seq":910,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.659685+0000","last_change":"2024-09-16T07:52:52.404571+0000","last_active":"2024-09-16T07:53:35.659685+0000","last_peered":"2024-09-16T07:53:35.659685+0000","last_clean":"2024-09-16T07:53:35.659685+0000","last_became_active":"2024-09-16T07:52:52.173596+0000","last_became_peered":"2024-09-16T07:52:52.173596+0000","last_unstale":"2024-09-16T07:53:35.659685+0000","last_undegraded":"2024-09-16T07:53:35.659685+0000","last_fullsized":"2024-09-16T07:53:35.659685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"86'894","reported_seq":960,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.846167+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:53:37.846167+0000","last_peered":"2024-09-16T07:53:37.846167+0000","last_clean":"2024-09-16T07:53:37.846167+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:53:37.846167+0000","last_undegraded":"2024-09-16T07:53:37.846167+0000","last_fullsized":"2024-09-16T07:53:37.846167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":894,"num_write_kb":31616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"86'817","reported_seq":886,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.581973+0000","last_change":"2024-09-16T07:52:52.200280+0000","last_active":"2024-09-16T07:53:37.581973+0000","last_peered":"2024-09-16T07:53:37.581973+0000","last_clean":"2024-09-16T07:53:37.581973+0000","last_became_active":"2024-09-16T07:52:52.189353+0000","last_became_peered":"2024-09-16T07:52:52.189353+0000","last_unstale":"2024-09-16T07:53:37.581973+0000","last_undegraded":"2024-09-16T07:53:37.581973+0000","last_fullsized":"2024-09-16T07:53:37.581973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":29312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"89'885","reported_seq":979,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.028546+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:54:05.028546+0000","last_peered":"2024-09-16T07:54:05.028546+0000","last_clean":"2024-09-16T07:54:05.028546+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:54:05.028546+0000","last_undegraded":"2024-09-16T07:54:05.028546+0000","last_fullsized":"2024-09-16T07:54:05.028546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":885,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":269,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.062548+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:07.062548+0000","last_peered":"2024-09-16T07:53:07.062548+0000","last_clean":"2024-09-16T07:53:07.062548+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:54:02.039639+0000","last_undegraded":"2024-09-16T07:53:07.062548+0000","last_fullsized":"2024-09-16T07:53:07.062548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":213,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.083910+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:53:07.083910+0000","last_peered":"2024-09-16T07:53:07.083910+0000","last_clean":"2024-09-16T07:53:07.083910+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:53:07.083910+0000","last_undegraded":"2024-09-16T07:53:07.083910+0000","last_fullsized":"2024-09-16T07:53:07.083910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"86'880","reported_seq":949,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.587837+0000","last_change":"2024-09-16T07:52:52.282162+0000","last_active":"2024-09-16T07:53:37.587837+0000","last_peered":"2024-09-16T07:53:37.587837+0000","last_clean":"2024-09-16T07:53:37.587837+0000","last_became_active":"2024-09-16T07:52:52.259966+0000","last_became_peered":"2024-09-16T07:52:52.259966+0000","last_unstale":"2024-09-16T07:53:37.587837+0000","last_undegraded":"2024-09-16T07:53:37.587837+0000","last_fullsized":"2024-09-16T07:53:37.587837+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":878,"num_write_kb":31168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.089151+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:53:07.089151+0000","last_peered":"2024-09-16T07:53:07.089151+0000","last_clean":"2024-09-16T07:53:07.089151+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:53:07.089151+0000","last_undegraded":"2024-09-16T07:53:07.089151+0000","last_fullsized":"2024-09-16T07:53:07.089151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"86'774","reported_seq":847,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:35.627019+0000","last_change":"2024-09-16T07:52:52.202956+0000","last_active":"2024-09-16T07:53:35.627019+0000","last_peered":"2024-09-16T07:53:35.627019+0000","last_clean":"2024-09-16T07:53:35.627019+0000","last_became_active":"2024-09-16T07:52:52.192731+0000","last_became_peered":"2024-09-16T07:52:52.192731+0000","last_unstale":"2024-09-16T07:53:35.627019+0000","last_undegraded":"2024-09-16T07:53:35.627019+0000","last_fullsized":"2024-09-16T07:53:35.627019+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650752,"num_objects":132,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.078278+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:53:07.078278+0000","last_peered":"2024-09-16T07:53:07.078278+0000","last_clean":"2024-09-16T07:53:07.078278+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:53:07.078278+0000","last_undegraded":"2024-09-16T07:53:07.078278+0000","last_fullsized":"2024-09-16T07:53:07.078278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"86'815","reported_seq":901,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.021553+0000","last_change":"2024-09-16T07:54:04.265645+0000","last_active":"2024-09-16T07:54:05.021553+0000","last_peered":"2024-09-16T07:54:05.021553+0000","last_clean":"2024-09-16T07:54:05.021553+0000","last_became_active":"2024-09-16T07:54:04.121359+0000","last_became_peered":"2024-09-16T07:54:04.121359+0000","last_unstale":"2024-09-16T07:54:05.021553+0000","last_undegraded":"2024-09-16T07:54:05.021553+0000","last_fullsized":"2024-09-16T07:54:05.021553+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":138,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.084006+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:53:07.084006+0000","last_peered":"2024-09-16T07:53:07.084006+0000","last_clean":"2024-09-16T07:53:07.084006+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:53:07.084006+0000","last_undegraded":"2024-09-16T07:53:07.084006+0000","last_fullsized":"2024-09-16T07:53:07.084006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"89'825","reported_seq":915,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.027941+0000","last_change":"2024-09-16T07:54:04.150160+0000","last_active":"2024-09-16T07:54:05.027941+0000","last_peered":"2024-09-16T07:54:05.027941+0000","last_clean":"2024-09-16T07:54:05.027941+0000","last_became_active":"2024-09-16T07:54:04.140385+0000","last_became_peered":"2024-09-16T07:54:04.140385+0000","last_unstale":"2024-09-16T07:54:05.027941+0000","last_undegraded":"2024-09-16T07:54:05.027941+0000","last_fullsized":"2024-09-16T07:54:05.027941+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.029835+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:05.029835+0000","last_peered":"2024-09-16T07:54:05.029835+0000","last_clean":"2024-09-16T07:54:05.029835+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:05.029835+0000","last_undegraded":"2024-09-16T07:54:05.029835+0000","last_fullsized":"2024-09-16T07:54:05.029835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"86'892","reported_seq":963,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.846279+0000","last_change":"2024-09-16T07:52:52.205171+0000","last_active":"2024-09-16T07:53:37.846279+0000","last_peered":"2024-09-16T07:53:37.846279+0000","last_clean":"2024-09-16T07:53:37.846279+0000","last_became_active":"2024-09-16T07:52:52.197079+0000","last_became_peered":"2024-09-16T07:52:52.197079+0000","last_unstale":"2024-09-16T07:53:37.846279+0000","last_undegraded":"2024-09-16T07:53:37.846279+0000","last_fullsized":"2024-09-16T07:53:37.846279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.060956+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:07.060956+0000","last_peered":"2024-09-16T07:53:07.060956+0000","last_clean":"2024-09-16T07:53:07.060956+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:54:02.039642+0000","last_undegraded":"2024-09-16T07:53:07.060956+0000","last_fullsized":"2024-09-16T07:53:07.060956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"86'840","reported_seq":908,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:34.275962+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:34.275962+0000","last_peered":"2024-09-16T07:53:34.275962+0000","last_clean":"2024-09-16T07:53:34.275962+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:54:02.039643+0000","last_undegraded":"2024-09-16T07:53:34.275962+0000","last_fullsized":"2024-09-16T07:53:34.275962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":31488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.024313+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:05.024313+0000","last_peered":"2024-09-16T07:54:05.024313+0000","last_clean":"2024-09-16T07:54:05.024313+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:05.024313+0000","last_undegraded":"2024-09-16T07:54:05.024313+0000","last_fullsized":"2024-09-16T07:54:05.024313+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"86'876","reported_seq":955,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.776804+0000","last_change":"2024-09-16T07:52:52.541645+0000","last_active":"2024-09-16T07:53:37.776804+0000","last_peered":"2024-09-16T07:53:37.776804+0000","last_clean":"2024-09-16T07:53:37.776804+0000","last_became_active":"2024-09-16T07:52:52.268878+0000","last_became_peered":"2024-09-16T07:52:52.268878+0000","last_unstale":"2024-09-16T07:53:37.776804+0000","last_undegraded":"2024-09-16T07:53:37.776804+0000","last_fullsized":"2024-09-16T07:53:37.776804+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.079591+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:53:07.079591+0000","last_peered":"2024-09-16T07:53:07.079591+0000","last_clean":"2024-09-16T07:53:07.079591+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:53:07.079591+0000","last_undegraded":"2024-09-16T07:53:07.079591+0000","last_fullsized":"2024-09-16T07:53:07.079591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":123928600,"num_objects":1892,"num_object_clones":0,"num_object_copies":5676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13776,"num_write_kb":501313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23678976,"data_stored":378667080,"data_compressed":17981136,"data_compressed_allocated":23666688,"data_compressed_original":378667008,"omap_allocated":0,"internal_metadata":0},"log_size":13790,"ondisk_log_size":13790,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49464,"kb_used_data":8104,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94322376,"statfs":{"total":96636764160,"available":96586113024,"internally_reserved":0,"allocated":8298496,"data_stored":121133609,"data_compressed":5740561,"data_compressed_allocated":7557120,"data_compressed_original":120832000,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48064,"kb_used_data":6896,"kb_used_omap":0,"kb_used_meta":41152,"kb_avail":94323776,"statfs":{"total":96636764160,"available":96587546624,"internally_reserved":0,"allocated":7061504,"data_stored":100894337,"data_compressed":4778953,"data_compressed_allocated":6291456,"data_compressed_original":100581376,"omap_allocated":0,"internal_metadata":42139648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612726,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45400,"kb_used_data":5000,"kb_used_omap":0,"kb_used_meta":40384,"kb_avail":94326440,"statfs":{"total":96636764160,"available":96590274560,"internally_reserved":0,"allocated":5120000,"data_stored":70670340,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":41353216},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44316,"kb_used_data":6540,"kb_used_omap":0,"kb_used_meta":37760,"kb_avail":94327524,"statfs":{"total":96636764160,"available":96591384576,"internally_reserved":0,"allocated":6696960,"data_stored":95443516,"data_compressed":4520657,"data_compressed_allocated":5951488,"data_compressed_original":95141888,"omap_allocated":0,"internal_metadata":38666240},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5914624,"data_stored":94568472,"data_compressed":4490616,"data_compressed_allocated":5910528,"data_compressed_original":94568448,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4399104,"data_stored":70385664,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6242304,"data_stored":99811352,"data_compressed":4739576,"data_compressed_allocated":6238208,"data_compressed_original":99811328,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":113901592,"data_compressed":5408656,"data_compressed_allocated":7118848,"data_compressed_original":113901568,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:21.511 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:21.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:21.627+0000 7f3b4bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:21.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:21.634+0000 7f3b4bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:22.543 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:22.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:22.659+0000 7fdcd9f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:22.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:22.668+0000 7fdcd9f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:22.866 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:22.867 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:22.880 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2024-09-16T07:54:22.407861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":55050792,"num_objects":835,"num_object_clones":0,"num_object_copies":2505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":14931,"num_write_kb":502420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":454,"num_bytes_recovered":17956864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14922,"ondisk_log_size":14922,"up":75,"acting":73,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":186076,"kb_used_data":21212,"kb_used_omap":0,"kb_used_meta":164800,"kb_avail":377301284,"statfs":{"total":386547056640,"available":386356514816,"internally_reserved":0,"allocated":21721088,"data_stored":299765903,"data_compressed":14184371,"data_compressed_allocated":18673664,"data_compressed_original":298532864,"omap_allocated":0,"internal_metadata":168755200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-69468184,"num_objects":-1061,"num_object_clones":0,"num_object_copies":-3183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1075,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":430,"num_bytes_recovered":16384000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001837"},"pg_stats":[{"pgid":"5.f","version":"89'874","reported_seq":960,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.031938+0000","last_change":"2024-09-16T07:54:04.214969+0000","last_active":"2024-09-16T07:54:05.031938+0000","last_peered":"2024-09-16T07:54:05.031938+0000","last_clean":"2024-09-16T07:54:05.031938+0000","last_became_active":"2024-09-16T07:54:04.210072+0000","last_became_peered":"2024-09-16T07:54:04.210072+0000","last_unstale":"2024-09-16T07:54:05.031938+0000","last_undegraded":"2024-09-16T07:54:05.031938+0000","last_fullsized":"2024-09-16T07:54:05.031938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'1076","reported_seq":1174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.077089+0000","last_change":"2024-09-16T07:54:04.454804+0000","last_active":"2024-09-16T07:54:20.077089+0000","last_peered":"2024-09-16T07:54:20.077089+0000","last_clean":"2024-09-16T07:54:20.077089+0000","last_became_active":"2024-09-16T07:54:04.217534+0000","last_became_peered":"2024-09-16T07:54:04.217534+0000","last_unstale":"2024-09-16T07:54:20.077089+0000","last_undegraded":"2024-09-16T07:54:20.077089+0000","last_fullsized":"2024-09-16T07:54:20.077089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1076,"log_dups_size":0,"ondisk_log_size":1076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1074,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"94'928","reported_seq":1027,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.073920+0000","last_change":"2024-09-16T07:54:04.428034+0000","last_active":"2024-09-16T07:54:20.073920+0000","last_peered":"2024-09-16T07:54:20.073920+0000","last_clean":"2024-09-16T07:54:20.073920+0000","last_became_active":"2024-09-16T07:54:04.216064+0000","last_became_peered":"2024-09-16T07:54:04.216064+0000","last_unstale":"2024-09-16T07:54:20.073920+0000","last_undegraded":"2024-09-16T07:54:20.073920+0000","last_fullsized":"2024-09-16T07:54:20.073920+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":926,"num_write_kb":29505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"86'888","reported_seq":961,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:34.155416+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:34.155416+0000","last_peered":"2024-09-16T07:53:34.155416+0000","last_clean":"2024-09-16T07:53:34.155416+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:54:02.039638+0000","last_undegraded":"2024-09-16T07:53:34.155416+0000","last_fullsized":"2024-09-16T07:53:34.155416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":33728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"94'1016","reported_seq":1128,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.075518+0000","last_change":"2024-09-16T07:54:04.451679+0000","last_active":"2024-09-16T07:54:20.075518+0000","last_peered":"2024-09-16T07:54:20.075518+0000","last_clean":"2024-09-16T07:54:20.075518+0000","last_became_active":"2024-09-16T07:54:04.239320+0000","last_became_peered":"2024-09-16T07:54:04.239320+0000","last_unstale":"2024-09-16T07:54:20.075518+0000","last_undegraded":"2024-09-16T07:54:20.075518+0000","last_fullsized":"2024-09-16T07:54:20.075518+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1014,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'1016","reported_seq":1584,"reported_epoch":95,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T07:54:20.570446+0000","last_change":"2024-09-16T07:54:06.021525+0000","last_active":"2024-09-16T07:54:20.570446+0000","last_peered":"2024-09-16T07:54:20.570446+0000","last_clean":"2024-09-16T07:53:37.808948+0000","last_became_active":"2024-09-16T07:54:05.805726+0000","last_became_peered":"2024-09-16T07:54:05.805726+0000","last_unstale":"2024-09-16T07:54:20.570446+0000","last_undegraded":"2024-09-16T07:54:20.570446+0000","last_fullsized":"2024-09-16T07:54:05.194278+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":9568256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[0,3],"avail_no_missing":["0","2","3"],"object_location_counts":[{"shards":"0,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"86'894","reported_seq":960,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.846167+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:53:37.846167+0000","last_peered":"2024-09-16T07:53:37.846167+0000","last_clean":"2024-09-16T07:53:37.846167+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:53:37.846167+0000","last_undegraded":"2024-09-16T07:53:37.846167+0000","last_fullsized":"2024-09-16T07:53:37.846167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":894,"num_write_kb":31616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"94'920","reported_seq":1016,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.065173+0000","last_change":"2024-09-16T07:52:52.200280+0000","last_active":"2024-09-16T07:54:20.065173+0000","last_peered":"2024-09-16T07:54:20.065173+0000","last_clean":"2024-09-16T07:54:20.065173+0000","last_became_active":"2024-09-16T07:52:52.189353+0000","last_became_peered":"2024-09-16T07:52:52.189353+0000","last_unstale":"2024-09-16T07:54:20.065173+0000","last_undegraded":"2024-09-16T07:54:20.065173+0000","last_fullsized":"2024-09-16T07:54:20.065173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":920,"log_dups_size":0,"ondisk_log_size":920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":918,"num_write_kb":29312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"89'885","reported_seq":979,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.028546+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:54:05.028546+0000","last_peered":"2024-09-16T07:54:05.028546+0000","last_clean":"2024-09-16T07:54:05.028546+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:54:05.028546+0000","last_undegraded":"2024-09-16T07:54:05.028546+0000","last_fullsized":"2024-09-16T07:54:05.028546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":885,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":269,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.062548+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:07.062548+0000","last_peered":"2024-09-16T07:53:07.062548+0000","last_clean":"2024-09-16T07:53:07.062548+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:54:02.039639+0000","last_undegraded":"2024-09-16T07:53:07.062548+0000","last_fullsized":"2024-09-16T07:53:07.062548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":213,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.083910+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:53:07.083910+0000","last_peered":"2024-09-16T07:53:07.083910+0000","last_clean":"2024-09-16T07:53:07.083910+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:53:07.083910+0000","last_undegraded":"2024-09-16T07:53:07.083910+0000","last_fullsized":"2024-09-16T07:53:07.083910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"94'978","reported_seq":1074,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.071690+0000","last_change":"2024-09-16T07:52:52.282162+0000","last_active":"2024-09-16T07:54:20.071690+0000","last_peered":"2024-09-16T07:54:20.071690+0000","last_clean":"2024-09-16T07:54:20.071690+0000","last_became_active":"2024-09-16T07:52:52.259966+0000","last_became_peered":"2024-09-16T07:52:52.259966+0000","last_unstale":"2024-09-16T07:54:20.071690+0000","last_undegraded":"2024-09-16T07:54:20.071690+0000","last_fullsized":"2024-09-16T07:54:20.071690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":978,"log_dups_size":0,"ondisk_log_size":978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":31168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.069932+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:20.069932+0000","last_peered":"2024-09-16T07:54:20.069932+0000","last_clean":"2024-09-16T07:54:20.069932+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:20.069932+0000","last_undegraded":"2024-09-16T07:54:20.069932+0000","last_fullsized":"2024-09-16T07:54:20.069932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"94'906","reported_seq":1394,"reported_epoch":95,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T07:54:20.573968+0000","last_change":"2024-09-16T07:54:05.642434+0000","last_active":"2024-09-16T07:54:20.573968+0000","last_peered":"2024-09-16T07:54:20.573968+0000","last_clean":"2024-09-16T07:53:37.788897+0000","last_became_active":"2024-09-16T07:54:05.570179+0000","last_became_peered":"2024-09-16T07:54:05.570179+0000","last_unstale":"2024-09-16T07:54:20.573968+0000","last_undegraded":"2024-09-16T07:54:20.573968+0000","last_fullsized":"2024-09-16T07:54:05.025777+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":906,"log_dups_size":0,"ondisk_log_size":906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":905,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":6946816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[0,3],"avail_no_missing":["0","2","3"],"object_location_counts":[{"shards":"0,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.078278+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:53:07.078278+0000","last_peered":"2024-09-16T07:53:07.078278+0000","last_clean":"2024-09-16T07:53:07.078278+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:53:07.078278+0000","last_undegraded":"2024-09-16T07:53:07.078278+0000","last_fullsized":"2024-09-16T07:53:07.078278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"86'815","reported_seq":901,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.021553+0000","last_change":"2024-09-16T07:54:04.265645+0000","last_active":"2024-09-16T07:54:05.021553+0000","last_peered":"2024-09-16T07:54:05.021553+0000","last_clean":"2024-09-16T07:54:05.021553+0000","last_became_active":"2024-09-16T07:54:04.121359+0000","last_became_peered":"2024-09-16T07:54:04.121359+0000","last_unstale":"2024-09-16T07:54:05.021553+0000","last_undegraded":"2024-09-16T07:54:05.021553+0000","last_fullsized":"2024-09-16T07:54:05.021553+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.060224+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:20.060224+0000","last_peered":"2024-09-16T07:54:20.060224+0000","last_clean":"2024-09-16T07:54:20.060224+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:20.060224+0000","last_undegraded":"2024-09-16T07:54:20.060224+0000","last_fullsized":"2024-09-16T07:54:20.060224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"89'825","reported_seq":915,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.027941+0000","last_change":"2024-09-16T07:54:04.150160+0000","last_active":"2024-09-16T07:54:05.027941+0000","last_peered":"2024-09-16T07:54:05.027941+0000","last_clean":"2024-09-16T07:54:05.027941+0000","last_became_active":"2024-09-16T07:54:04.140385+0000","last_became_peered":"2024-09-16T07:54:04.140385+0000","last_unstale":"2024-09-16T07:54:05.027941+0000","last_undegraded":"2024-09-16T07:54:05.027941+0000","last_fullsized":"2024-09-16T07:54:05.027941+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.029835+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:05.029835+0000","last_peered":"2024-09-16T07:54:05.029835+0000","last_clean":"2024-09-16T07:54:05.029835+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:05.029835+0000","last_undegraded":"2024-09-16T07:54:05.029835+0000","last_fullsized":"2024-09-16T07:54:05.029835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"94'1006","reported_seq":1117,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.074753+0000","last_change":"2024-09-16T07:54:04.497804+0000","last_active":"2024-09-16T07:54:20.074753+0000","last_peered":"2024-09-16T07:54:20.074753+0000","last_clean":"2024-09-16T07:54:20.074753+0000","last_became_active":"2024-09-16T07:54:04.257424+0000","last_became_peered":"2024-09-16T07:54:04.257424+0000","last_unstale":"2024-09-16T07:54:20.074753+0000","last_undegraded":"2024-09-16T07:54:20.074753+0000","last_fullsized":"2024-09-16T07:54:20.074753+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1006,"log_dups_size":0,"ondisk_log_size":1006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1004,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.060956+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:07.060956+0000","last_peered":"2024-09-16T07:53:07.060956+0000","last_clean":"2024-09-16T07:53:07.060956+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:54:02.039642+0000","last_undegraded":"2024-09-16T07:53:07.060956+0000","last_fullsized":"2024-09-16T07:53:07.060956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"86'840","reported_seq":908,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:34.275962+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:34.275962+0000","last_peered":"2024-09-16T07:53:34.275962+0000","last_clean":"2024-09-16T07:53:34.275962+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:54:02.039643+0000","last_undegraded":"2024-09-16T07:53:34.275962+0000","last_fullsized":"2024-09-16T07:53:34.275962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":31488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.024313+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:05.024313+0000","last_peered":"2024-09-16T07:54:05.024313+0000","last_clean":"2024-09-16T07:54:05.024313+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:05.024313+0000","last_undegraded":"2024-09-16T07:54:05.024313+0000","last_fullsized":"2024-09-16T07:54:05.024313+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"94'1000","reported_seq":1106,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.076272+0000","last_change":"2024-09-16T07:52:52.541645+0000","last_active":"2024-09-16T07:54:20.076272+0000","last_peered":"2024-09-16T07:54:20.076272+0000","last_clean":"2024-09-16T07:54:20.076272+0000","last_became_active":"2024-09-16T07:52:52.268878+0000","last_became_peered":"2024-09-16T07:52:52.268878+0000","last_unstale":"2024-09-16T07:54:20.076272+0000","last_undegraded":"2024-09-16T07:54:20.076272+0000","last_fullsized":"2024-09-16T07:54:20.076272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1000,"log_dups_size":0,"ondisk_log_size":1000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":998,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.079591+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:53:07.079591+0000","last_peered":"2024-09-16T07:53:07.079591+0000","last_clean":"2024-09-16T07:53:07.079591+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:53:07.079591+0000","last_undegraded":"2024-09-16T07:53:07.079591+0000","last_fullsized":"2024-09-16T07:53:07.079591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":54460416,"num_objects":831,"num_object_clones":0,"num_object_copies":2493,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14851,"num_write_kb":501313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":454,"num_bytes_recovered":17956864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18149376,"data_stored":290258992,"data_compressed":13783048,"data_compressed_allocated":18141184,"data_compressed_original":290258944,"omap_allocated":0,"internal_metadata":0},"log_size":14867,"ondisk_log_size":14867,"up":48,"acting":46,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49464,"kb_used_data":8104,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94322376,"statfs":{"total":96636764160,"available":96586113024,"internally_reserved":0,"allocated":8298496,"data_stored":121133609,"data_compressed":5740561,"data_compressed_allocated":7557120,"data_compressed_original":120832000,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48064,"kb_used_data":6896,"kb_used_omap":0,"kb_used_meta":41152,"kb_avail":94323776,"statfs":{"total":96636764160,"available":96587546624,"internally_reserved":0,"allocated":7061504,"data_stored":100894337,"data_compressed":4778953,"data_compressed_allocated":6291456,"data_compressed_original":100581376,"omap_allocated":0,"internal_metadata":42139648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612726,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45400,"kb_used_data":5000,"kb_used_omap":0,"kb_used_meta":40384,"kb_avail":94326440,"statfs":{"total":96636764160,"available":96590274560,"internally_reserved":0,"allocated":5120000,"data_stored":70670340,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":41353216},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43148,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94328692,"statfs":{"total":96636764160,"available":96592580608,"internally_reserved":0,"allocated":1241088,"data_stored":7067617,"data_compressed":322569,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":385024,"data_stored":6160384,"data_compressed":292528,"data_compressed_allocated":385024,"data_compressed_original":6160384,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4399104,"data_stored":70385664,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6242304,"data_stored":99811352,"data_compressed":4739576,"data_compressed_allocated":6238208,"data_compressed_original":99811328,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":113901592,"data_compressed":5408656,"data_compressed_allocated":7118848,"data_compressed_original":113901568,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:22.881 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:54:23.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:22.997+0000 7fd85e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:23.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:23.006+0000 7fd85e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:23.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:23.303 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":565,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":96,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473243,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":2},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":19},{"state_name":"stale+active+clean","count":4},{"state_name":"active+recovering+undersized+remapped","count":2}],"num_pgs":25,"num_pools":3,"num_objects":835,"data_bytes":55050792,"bytes_used":190541824,"bytes_avail":386356514816,"bytes_total":386547056640,"recovering_objects_per_sec":53,"recovering_bytes_per_sec":2047529,"recovering_keys_per_sec":0,"num_objects_recovered":430,"num_bytes_recovered":16384000,"num_keys_recovered":0,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":134},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:54:23.317 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:54:23.318 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:23.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:23.433+0000 7ff13e711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:23.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:23.442+0000 7ff13e711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:23.641 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:23.641 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:23.655 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2024-09-16T07:54:22.407861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":55050792,"num_objects":835,"num_object_clones":0,"num_object_copies":2505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":14931,"num_write_kb":502420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":454,"num_bytes_recovered":17956864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14922,"ondisk_log_size":14922,"up":75,"acting":73,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":186076,"kb_used_data":21212,"kb_used_omap":0,"kb_used_meta":164800,"kb_avail":377301284,"statfs":{"total":386547056640,"available":386356514816,"internally_reserved":0,"allocated":21721088,"data_stored":299765903,"data_compressed":14184371,"data_compressed_allocated":18673664,"data_compressed_original":298532864,"omap_allocated":0,"internal_metadata":168755200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-69468184,"num_objects":-1061,"num_object_clones":0,"num_object_copies":-3183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1075,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":430,"num_bytes_recovered":16384000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001837"},"pg_stats":[{"pgid":"5.f","version":"89'874","reported_seq":960,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.031938+0000","last_change":"2024-09-16T07:54:04.214969+0000","last_active":"2024-09-16T07:54:05.031938+0000","last_peered":"2024-09-16T07:54:05.031938+0000","last_clean":"2024-09-16T07:54:05.031938+0000","last_became_active":"2024-09-16T07:54:04.210072+0000","last_became_peered":"2024-09-16T07:54:04.210072+0000","last_unstale":"2024-09-16T07:54:05.031938+0000","last_undegraded":"2024-09-16T07:54:05.031938+0000","last_fullsized":"2024-09-16T07:54:05.031938+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"94'1076","reported_seq":1174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.077089+0000","last_change":"2024-09-16T07:54:04.454804+0000","last_active":"2024-09-16T07:54:20.077089+0000","last_peered":"2024-09-16T07:54:20.077089+0000","last_clean":"2024-09-16T07:54:20.077089+0000","last_became_active":"2024-09-16T07:54:04.217534+0000","last_became_peered":"2024-09-16T07:54:04.217534+0000","last_unstale":"2024-09-16T07:54:20.077089+0000","last_undegraded":"2024-09-16T07:54:20.077089+0000","last_fullsized":"2024-09-16T07:54:20.077089+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1076,"log_dups_size":0,"ondisk_log_size":1076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1074,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"94'928","reported_seq":1027,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.073920+0000","last_change":"2024-09-16T07:54:04.428034+0000","last_active":"2024-09-16T07:54:20.073920+0000","last_peered":"2024-09-16T07:54:20.073920+0000","last_clean":"2024-09-16T07:54:20.073920+0000","last_became_active":"2024-09-16T07:54:04.216064+0000","last_became_peered":"2024-09-16T07:54:04.216064+0000","last_unstale":"2024-09-16T07:54:20.073920+0000","last_undegraded":"2024-09-16T07:54:20.073920+0000","last_fullsized":"2024-09-16T07:54:20.073920+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":926,"num_write_kb":29505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"86'888","reported_seq":961,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:34.155416+0000","last_change":"2024-09-16T07:51:59.183482+0000","last_active":"2024-09-16T07:53:34.155416+0000","last_peered":"2024-09-16T07:53:34.155416+0000","last_clean":"2024-09-16T07:53:34.155416+0000","last_became_active":"2024-09-16T07:51:59.078098+0000","last_became_peered":"2024-09-16T07:51:59.078098+0000","last_unstale":"2024-09-16T07:54:02.039638+0000","last_undegraded":"2024-09-16T07:53:34.155416+0000","last_fullsized":"2024-09-16T07:53:34.155416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10878976,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":33728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"94'1016","reported_seq":1128,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.075518+0000","last_change":"2024-09-16T07:54:04.451679+0000","last_active":"2024-09-16T07:54:20.075518+0000","last_peered":"2024-09-16T07:54:20.075518+0000","last_clean":"2024-09-16T07:54:20.075518+0000","last_became_active":"2024-09-16T07:54:04.239320+0000","last_became_peered":"2024-09-16T07:54:04.239320+0000","last_unstale":"2024-09-16T07:54:20.075518+0000","last_undegraded":"2024-09-16T07:54:20.075518+0000","last_fullsized":"2024-09-16T07:54:20.075518+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1014,"num_write_kb":32384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"94'1016","reported_seq":1584,"reported_epoch":95,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T07:54:20.570446+0000","last_change":"2024-09-16T07:54:06.021525+0000","last_active":"2024-09-16T07:54:20.570446+0000","last_peered":"2024-09-16T07:54:20.570446+0000","last_clean":"2024-09-16T07:53:37.808948+0000","last_became_active":"2024-09-16T07:54:05.805726+0000","last_became_peered":"2024-09-16T07:54:05.805726+0000","last_unstale":"2024-09-16T07:54:20.570446+0000","last_undegraded":"2024-09-16T07:54:20.570446+0000","last_fullsized":"2024-09-16T07:54:05.194278+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1015,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":9568256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[0,3],"avail_no_missing":["0","2","3"],"object_location_counts":[{"shards":"0,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"86'894","reported_seq":960,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:37.846167+0000","last_change":"2024-09-16T07:52:52.347745+0000","last_active":"2024-09-16T07:53:37.846167+0000","last_peered":"2024-09-16T07:53:37.846167+0000","last_clean":"2024-09-16T07:53:37.846167+0000","last_became_active":"2024-09-16T07:52:52.183052+0000","last_became_peered":"2024-09-16T07:52:52.183052+0000","last_unstale":"2024-09-16T07:53:37.846167+0000","last_undegraded":"2024-09-16T07:53:37.846167+0000","last_fullsized":"2024-09-16T07:53:37.846167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":894,"num_write_kb":31616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"94'920","reported_seq":1016,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.065173+0000","last_change":"2024-09-16T07:52:52.200280+0000","last_active":"2024-09-16T07:54:20.065173+0000","last_peered":"2024-09-16T07:54:20.065173+0000","last_clean":"2024-09-16T07:54:20.065173+0000","last_became_active":"2024-09-16T07:52:52.189353+0000","last_became_peered":"2024-09-16T07:52:52.189353+0000","last_unstale":"2024-09-16T07:54:20.065173+0000","last_undegraded":"2024-09-16T07:54:20.065173+0000","last_fullsized":"2024-09-16T07:54:20.065173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":920,"log_dups_size":0,"ondisk_log_size":920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":918,"num_write_kb":29312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"89'885","reported_seq":979,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.028546+0000","last_change":"2024-09-16T07:52:52.396428+0000","last_active":"2024-09-16T07:54:05.028546+0000","last_peered":"2024-09-16T07:54:05.028546+0000","last_clean":"2024-09-16T07:54:05.028546+0000","last_became_active":"2024-09-16T07:52:52.158295+0000","last_became_peered":"2024-09-16T07:52:52.158295+0000","last_unstale":"2024-09-16T07:54:05.028546+0000","last_undegraded":"2024-09-16T07:54:05.028546+0000","last_fullsized":"2024-09-16T07:54:05.028546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":885,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":269,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.062548+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:07.062548+0000","last_peered":"2024-09-16T07:53:07.062548+0000","last_clean":"2024-09-16T07:53:07.062548+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:54:02.039639+0000","last_undegraded":"2024-09-16T07:53:07.062548+0000","last_fullsized":"2024-09-16T07:53:07.062548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":213,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.083910+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:53:07.083910+0000","last_peered":"2024-09-16T07:53:07.083910+0000","last_clean":"2024-09-16T07:53:07.083910+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:53:07.083910+0000","last_undegraded":"2024-09-16T07:53:07.083910+0000","last_fullsized":"2024-09-16T07:53:07.083910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"94'978","reported_seq":1074,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.071690+0000","last_change":"2024-09-16T07:52:52.282162+0000","last_active":"2024-09-16T07:54:20.071690+0000","last_peered":"2024-09-16T07:54:20.071690+0000","last_clean":"2024-09-16T07:54:20.071690+0000","last_became_active":"2024-09-16T07:52:52.259966+0000","last_became_peered":"2024-09-16T07:52:52.259966+0000","last_unstale":"2024-09-16T07:54:20.071690+0000","last_undegraded":"2024-09-16T07:54:20.071690+0000","last_fullsized":"2024-09-16T07:54:20.071690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":978,"log_dups_size":0,"ondisk_log_size":978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":31168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.069932+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:20.069932+0000","last_peered":"2024-09-16T07:54:20.069932+0000","last_clean":"2024-09-16T07:54:20.069932+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:20.069932+0000","last_undegraded":"2024-09-16T07:54:20.069932+0000","last_fullsized":"2024-09-16T07:54:20.069932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"94'906","reported_seq":1394,"reported_epoch":95,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T07:54:20.573968+0000","last_change":"2024-09-16T07:54:05.642434+0000","last_active":"2024-09-16T07:54:20.573968+0000","last_peered":"2024-09-16T07:54:20.573968+0000","last_clean":"2024-09-16T07:53:37.788897+0000","last_became_active":"2024-09-16T07:54:05.570179+0000","last_became_peered":"2024-09-16T07:54:05.570179+0000","last_unstale":"2024-09-16T07:54:20.573968+0000","last_undegraded":"2024-09-16T07:54:20.573968+0000","last_fullsized":"2024-09-16T07:54:05.025777+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":906,"log_dups_size":0,"ondisk_log_size":906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":905,"num_write_kb":28992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":6946816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[0,3],"avail_no_missing":["0","2","3"],"object_location_counts":[{"shards":"0,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.078278+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:53:07.078278+0000","last_peered":"2024-09-16T07:53:07.078278+0000","last_clean":"2024-09-16T07:53:07.078278+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:53:07.078278+0000","last_undegraded":"2024-09-16T07:53:07.078278+0000","last_fullsized":"2024-09-16T07:53:07.078278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"86'815","reported_seq":901,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.021553+0000","last_change":"2024-09-16T07:54:04.265645+0000","last_active":"2024-09-16T07:54:05.021553+0000","last_peered":"2024-09-16T07:54:05.021553+0000","last_clean":"2024-09-16T07:54:05.021553+0000","last_became_active":"2024-09-16T07:54:04.121359+0000","last_became_peered":"2024-09-16T07:54:04.121359+0000","last_unstale":"2024-09-16T07:54:05.021553+0000","last_undegraded":"2024-09-16T07:54:05.021553+0000","last_fullsized":"2024-09-16T07:54:05.021553+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.060224+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:20.060224+0000","last_peered":"2024-09-16T07:54:20.060224+0000","last_clean":"2024-09-16T07:54:20.060224+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:20.060224+0000","last_undegraded":"2024-09-16T07:54:20.060224+0000","last_fullsized":"2024-09-16T07:54:20.060224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"89'825","reported_seq":915,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.027941+0000","last_change":"2024-09-16T07:54:04.150160+0000","last_active":"2024-09-16T07:54:05.027941+0000","last_peered":"2024-09-16T07:54:05.027941+0000","last_clean":"2024-09-16T07:54:05.027941+0000","last_became_active":"2024-09-16T07:54:04.140385+0000","last_became_peered":"2024-09-16T07:54:04.140385+0000","last_unstale":"2024-09-16T07:54:05.027941+0000","last_undegraded":"2024-09-16T07:54:05.027941+0000","last_fullsized":"2024-09-16T07:54:05.027941+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":825,"num_write_kb":29248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.029835+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:05.029835+0000","last_peered":"2024-09-16T07:54:05.029835+0000","last_clean":"2024-09-16T07:54:05.029835+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:05.029835+0000","last_undegraded":"2024-09-16T07:54:05.029835+0000","last_fullsized":"2024-09-16T07:54:05.029835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"94'1006","reported_seq":1117,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.074753+0000","last_change":"2024-09-16T07:54:04.497804+0000","last_active":"2024-09-16T07:54:20.074753+0000","last_peered":"2024-09-16T07:54:20.074753+0000","last_clean":"2024-09-16T07:54:20.074753+0000","last_became_active":"2024-09-16T07:54:04.257424+0000","last_became_peered":"2024-09-16T07:54:04.257424+0000","last_unstale":"2024-09-16T07:54:20.074753+0000","last_undegraded":"2024-09-16T07:54:20.074753+0000","last_fullsized":"2024-09-16T07:54:20.074753+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1006,"log_dups_size":0,"ondisk_log_size":1006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1004,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.060956+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:07.060956+0000","last_peered":"2024-09-16T07:53:07.060956+0000","last_clean":"2024-09-16T07:53:07.060956+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:54:02.039642+0000","last_undegraded":"2024-09-16T07:53:07.060956+0000","last_fullsized":"2024-09-16T07:53:07.060956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"86'840","reported_seq":908,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:34.275962+0000","last_change":"2024-09-16T07:52:52.151211+0000","last_active":"2024-09-16T07:53:34.275962+0000","last_peered":"2024-09-16T07:53:34.275962+0000","last_clean":"2024-09-16T07:53:34.275962+0000","last_became_active":"2024-09-16T07:52:52.143236+0000","last_became_peered":"2024-09-16T07:52:52.143236+0000","last_unstale":"2024-09-16T07:54:02.039643+0000","last_undegraded":"2024-09-16T07:53:34.275962+0000","last_fullsized":"2024-09-16T07:53:34.275962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":31488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.024313+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:05.024313+0000","last_peered":"2024-09-16T07:54:05.024313+0000","last_clean":"2024-09-16T07:54:05.024313+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:05.024313+0000","last_undegraded":"2024-09-16T07:54:05.024313+0000","last_fullsized":"2024-09-16T07:54:05.024313+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"94'1000","reported_seq":1106,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.076272+0000","last_change":"2024-09-16T07:52:52.541645+0000","last_active":"2024-09-16T07:54:20.076272+0000","last_peered":"2024-09-16T07:54:20.076272+0000","last_clean":"2024-09-16T07:54:20.076272+0000","last_became_active":"2024-09-16T07:52:52.268878+0000","last_became_peered":"2024-09-16T07:52:52.268878+0000","last_unstale":"2024-09-16T07:54:20.076272+0000","last_undegraded":"2024-09-16T07:54:20.076272+0000","last_fullsized":"2024-09-16T07:54:20.076272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:51:37.483608+0000","last_clean_scrub_stamp":"2024-09-16T07:51:37.483608+0000","objects_scrubbed":0,"log_size":1000,"log_dups_size":0,"ondisk_log_size":1000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":998,"num_write_kb":31872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":262144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.079591+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:53:07.079591+0000","last_peered":"2024-09-16T07:53:07.079591+0000","last_clean":"2024-09-16T07:53:07.079591+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:53:07.079591+0000","last_undegraded":"2024-09-16T07:53:07.079591+0000","last_fullsized":"2024-09-16T07:53:07.079591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":54460416,"num_objects":831,"num_object_clones":0,"num_object_copies":2493,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14851,"num_write_kb":501313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":454,"num_bytes_recovered":17956864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18149376,"data_stored":290258992,"data_compressed":13783048,"data_compressed_allocated":18141184,"data_compressed_original":290258944,"omap_allocated":0,"internal_metadata":0},"log_size":14867,"ondisk_log_size":14867,"up":48,"acting":46,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49464,"kb_used_data":8104,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94322376,"statfs":{"total":96636764160,"available":96586113024,"internally_reserved":0,"allocated":8298496,"data_stored":121133609,"data_compressed":5740561,"data_compressed_allocated":7557120,"data_compressed_original":120832000,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48064,"kb_used_data":6896,"kb_used_omap":0,"kb_used_meta":41152,"kb_avail":94323776,"statfs":{"total":96636764160,"available":96587546624,"internally_reserved":0,"allocated":7061504,"data_stored":100894337,"data_compressed":4778953,"data_compressed_allocated":6291456,"data_compressed_original":100581376,"omap_allocated":0,"internal_metadata":42139648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612726,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45400,"kb_used_data":5000,"kb_used_omap":0,"kb_used_meta":40384,"kb_avail":94326440,"statfs":{"total":96636764160,"available":96590274560,"internally_reserved":0,"allocated":5120000,"data_stored":70670340,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":41353216},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43148,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94328692,"statfs":{"total":96636764160,"available":96592580608,"internally_reserved":0,"allocated":1241088,"data_stored":7067617,"data_compressed":322569,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":385024,"data_stored":6160384,"data_compressed":292528,"data_compressed_allocated":385024,"data_compressed_original":6160384,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4399104,"data_stored":70385664,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6242304,"data_stored":99811352,"data_compressed":4739576,"data_compressed_allocated":6238208,"data_compressed_original":99811328,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":113901592,"data_compressed":5408656,"data_compressed_allocated":7118848,"data_compressed_original":113901568,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:23.740 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_2 2024-09-16T07:54:23.740 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2024-09-16T07:54:23.755 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:23.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:23.865+0000 7f1d2b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:23.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:23.882+0000 7f1d2b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:23.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:23.904+0000 7fefcca4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:23.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:23.911+0000 7fefcca4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:25.063 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'unique_pool_2' removed 2024-09-16T07:54:25.082 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T07:54:25.083 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T07:54:25.084 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_3 2024-09-16T07:54:25.084 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_3 16 2024-09-16T07:54:25.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:25.243+0000 7fdee5b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:25.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:25.262+0000 7fdee5b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:26.069 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'unique_pool_3' created 2024-09-16T07:54:26.073 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:26.090 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2024-09-16T07:54:26.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:26.218+0000 7f56b246c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:26.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:26.225+0000 7f56b246c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:26.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:26.265+0000 7ffb29f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:26.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:26.281+0000 7ffb29f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:26.657 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:26.769+0000 7f17f187d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:26.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:26.777+0000 7f17f187d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:26.973 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:26.973 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:26.985 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":371,"stamp":"2024-09-16T07:54:26.408884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":186076,"kb_used_data":21212,"kb_used_omap":0,"kb_used_meta":164800,"kb_avail":377301284,"statfs":{"total":386547056640,"available":386356514816,"internally_reserved":0,"allocated":21721088,"data_stored":299765903,"data_compressed":14184371,"data_compressed_allocated":18673664,"data_compressed_original":298532864,"omap_allocated":0,"internal_metadata":168755200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-123928600,"num_objects":-1892,"num_object_clones":0,"num_object_copies":-5676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-13776,"num_write_kb":-501313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-24,"num_bytes_recovered":-1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001613"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":269,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.062548+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:07.062548+0000","last_peered":"2024-09-16T07:53:07.062548+0000","last_clean":"2024-09-16T07:53:07.062548+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:54:02.039639+0000","last_undegraded":"2024-09-16T07:53:07.062548+0000","last_fullsized":"2024-09-16T07:53:07.062548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":213,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.083910+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:53:07.083910+0000","last_peered":"2024-09-16T07:53:07.083910+0000","last_clean":"2024-09-16T07:53:07.083910+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:53:07.083910+0000","last_undegraded":"2024-09-16T07:53:07.083910+0000","last_fullsized":"2024-09-16T07:53:07.083910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.069932+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:20.069932+0000","last_peered":"2024-09-16T07:54:20.069932+0000","last_clean":"2024-09-16T07:54:20.069932+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:20.069932+0000","last_undegraded":"2024-09-16T07:54:20.069932+0000","last_fullsized":"2024-09-16T07:54:20.069932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.078278+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:53:07.078278+0000","last_peered":"2024-09-16T07:53:07.078278+0000","last_clean":"2024-09-16T07:53:07.078278+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:53:07.078278+0000","last_undegraded":"2024-09-16T07:53:07.078278+0000","last_fullsized":"2024-09-16T07:53:07.078278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.060224+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:20.060224+0000","last_peered":"2024-09-16T07:54:20.060224+0000","last_clean":"2024-09-16T07:54:20.060224+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:20.060224+0000","last_undegraded":"2024-09-16T07:54:20.060224+0000","last_fullsized":"2024-09-16T07:54:20.060224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.029835+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:05.029835+0000","last_peered":"2024-09-16T07:54:05.029835+0000","last_clean":"2024-09-16T07:54:05.029835+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:05.029835+0000","last_undegraded":"2024-09-16T07:54:05.029835+0000","last_fullsized":"2024-09-16T07:54:05.029835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.060956+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:07.060956+0000","last_peered":"2024-09-16T07:53:07.060956+0000","last_clean":"2024-09-16T07:53:07.060956+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:54:02.039642+0000","last_undegraded":"2024-09-16T07:53:07.060956+0000","last_fullsized":"2024-09-16T07:53:07.060956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.024313+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:05.024313+0000","last_peered":"2024-09-16T07:54:05.024313+0000","last_clean":"2024-09-16T07:54:05.024313+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:05.024313+0000","last_undegraded":"2024-09-16T07:54:05.024313+0000","last_fullsized":"2024-09-16T07:54:05.024313+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.079591+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:53:07.079591+0000","last_peered":"2024-09-16T07:53:07.079591+0000","last_clean":"2024-09-16T07:53:07.079591+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:53:07.079591+0000","last_undegraded":"2024-09-16T07:53:07.079591+0000","last_fullsized":"2024-09-16T07:53:07.079591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49464,"kb_used_data":8104,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94322376,"statfs":{"total":96636764160,"available":96586113024,"internally_reserved":0,"allocated":8298496,"data_stored":121133609,"data_compressed":5740561,"data_compressed_allocated":7557120,"data_compressed_original":120832000,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48064,"kb_used_data":6896,"kb_used_omap":0,"kb_used_meta":41152,"kb_avail":94323776,"statfs":{"total":96636764160,"available":96587546624,"internally_reserved":0,"allocated":7061504,"data_stored":100894337,"data_compressed":4778953,"data_compressed_allocated":6291456,"data_compressed_original":100581376,"omap_allocated":0,"internal_metadata":42139648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612726,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45400,"kb_used_data":5000,"kb_used_omap":0,"kb_used_meta":40384,"kb_avail":94326440,"statfs":{"total":96636764160,"available":96590274560,"internally_reserved":0,"allocated":5120000,"data_stored":70670340,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":41353216},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43148,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94328692,"statfs":{"total":96636764160,"available":96592580608,"internally_reserved":0,"allocated":1241088,"data_stored":7067617,"data_compressed":322569,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:26.987 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:54:27.073 INFO:teuthology.orchestra.run.smithi003.stderr:enabled application 'rados' on pool 'unique_pool_3' 2024-09-16T07:54:27.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:27.113+0000 7fab38cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:27.123+0000 7fab38cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.461 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:27.462 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_WARN","checks":{"POOL_APP_NOT_ENABLED":{"severity":"HEALTH_WARN","summary":{"message":"1 pool(s) do not have an application enabled","count":1},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":569,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":99,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473243,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":7},{"state_name":"stale+active+clean","count":2}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590376,"bytes_used":190541824,"bytes_avail":386356514816,"bytes_total":386547056640,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:54:27.475 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:54:27.475 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:27.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:27.627+0000 7fb11ca4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:27.635+0000 7fb11ca4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:27.832 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:27.844 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":372,"stamp":"2024-09-16T07:54:27.075826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":186076,"kb_used_data":21212,"kb_used_omap":0,"kb_used_meta":164800,"kb_avail":377301284,"statfs":{"total":386547056640,"available":386356514816,"internally_reserved":0,"allocated":21721088,"data_stored":299765903,"data_compressed":14184371,"data_compressed_allocated":18673664,"data_compressed_original":298532864,"omap_allocated":0,"internal_metadata":168755200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-54460416,"num_objects":-831,"num_object_clones":0,"num_object_copies":-2493,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-14851,"num_write_kb":-501313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-454,"num_bytes_recovered":-17956864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.024361"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":269,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.062548+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:07.062548+0000","last_peered":"2024-09-16T07:53:07.062548+0000","last_clean":"2024-09-16T07:53:07.062548+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:54:02.039639+0000","last_undegraded":"2024-09-16T07:53:07.062548+0000","last_fullsized":"2024-09-16T07:53:07.062548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":213,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.083910+0000","last_change":"2024-09-16T07:52:53.037777+0000","last_active":"2024-09-16T07:53:07.083910+0000","last_peered":"2024-09-16T07:53:07.083910+0000","last_clean":"2024-09-16T07:53:07.083910+0000","last_became_active":"2024-09-16T07:52:52.160926+0000","last_became_peered":"2024-09-16T07:52:52.160926+0000","last_unstale":"2024-09-16T07:53:07.083910+0000","last_undegraded":"2024-09-16T07:53:07.083910+0000","last_fullsized":"2024-09-16T07:53:07.083910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.069932+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:20.069932+0000","last_peered":"2024-09-16T07:54:20.069932+0000","last_clean":"2024-09-16T07:54:20.069932+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:20.069932+0000","last_undegraded":"2024-09-16T07:54:20.069932+0000","last_fullsized":"2024-09-16T07:54:20.069932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.078278+0000","last_change":"2024-09-16T07:52:29.053436+0000","last_active":"2024-09-16T07:53:07.078278+0000","last_peered":"2024-09-16T07:53:07.078278+0000","last_clean":"2024-09-16T07:53:07.078278+0000","last_became_active":"2024-09-16T07:51:59.134314+0000","last_became_peered":"2024-09-16T07:51:59.134314+0000","last_unstale":"2024-09-16T07:53:07.078278+0000","last_undegraded":"2024-09-16T07:53:07.078278+0000","last_fullsized":"2024-09-16T07:53:07.078278+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.060224+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:20.060224+0000","last_peered":"2024-09-16T07:54:20.060224+0000","last_clean":"2024-09-16T07:54:20.060224+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:20.060224+0000","last_undegraded":"2024-09-16T07:54:20.060224+0000","last_fullsized":"2024-09-16T07:54:20.060224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.029835+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:05.029835+0000","last_peered":"2024-09-16T07:54:05.029835+0000","last_clean":"2024-09-16T07:54:05.029835+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:05.029835+0000","last_undegraded":"2024-09-16T07:54:05.029835+0000","last_fullsized":"2024-09-16T07:54:05.029835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.060956+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:07.060956+0000","last_peered":"2024-09-16T07:53:07.060956+0000","last_clean":"2024-09-16T07:53:07.060956+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:54:02.039642+0000","last_undegraded":"2024-09-16T07:53:07.060956+0000","last_fullsized":"2024-09-16T07:53:07.060956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.024313+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:05.024313+0000","last_peered":"2024-09-16T07:54:05.024313+0000","last_clean":"2024-09-16T07:54:05.024313+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:05.024313+0000","last_undegraded":"2024-09-16T07:54:05.024313+0000","last_fullsized":"2024-09-16T07:54:05.024313+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":212,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-16T07:53:07.079591+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:53:07.079591+0000","last_peered":"2024-09-16T07:53:07.079591+0000","last_clean":"2024-09-16T07:53:07.079591+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:53:07.079591+0000","last_undegraded":"2024-09-16T07:53:07.079591+0000","last_fullsized":"2024-09-16T07:53:07.079591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49464,"kb_used_data":8104,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94322376,"statfs":{"total":96636764160,"available":96586113024,"internally_reserved":0,"allocated":8298496,"data_stored":121133609,"data_compressed":5740561,"data_compressed_allocated":7557120,"data_compressed_original":120832000,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48064,"kb_used_data":6896,"kb_used_omap":0,"kb_used_meta":41152,"kb_avail":94323776,"statfs":{"total":96636764160,"available":96587546624,"internally_reserved":0,"allocated":7061504,"data_stored":100894337,"data_compressed":4778953,"data_compressed_allocated":6291456,"data_compressed_original":100581376,"omap_allocated":0,"internal_metadata":42139648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612726,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45400,"kb_used_data":5000,"kb_used_omap":0,"kb_used_meta":40384,"kb_avail":94326440,"statfs":{"total":96636764160,"available":96590274560,"internally_reserved":0,"allocated":5120000,"data_stored":70670340,"data_compressed":3342288,"data_compressed_allocated":4399104,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":41353216},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43148,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94328692,"statfs":{"total":96636764160,"available":96592580608,"internally_reserved":0,"allocated":1241088,"data_stored":7067617,"data_compressed":322569,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:28.091 DEBUG:teuthology.orchestra.run.smithi003:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_3 bench 90 write' 2024-09-16T07:54:28.094 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T07:54:28.094 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T07:54:28.160 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:hints = 1 2024-09-16T07:54:28.160 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T07:54:28.160 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Object prefix: benchmark_data_smithi003_44775 2024-09-16T07:54:28.160 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:54:28.160 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 0 0 0 0 0 0 - 0 2024-09-16T07:54:28.328 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:28.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:28.482+0000 7f5bc8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:28.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:28.492+0000 7f5bc8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:29.160 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 1 16 195 179 11.1868 11.1875 0.0650721 0.0854292 2024-09-16T07:54:30.160 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 2 16 390 374 11.6866 12.1875 0.0453837 0.0834587 2024-09-16T07:54:30.731 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:30.847 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:30.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:30.874+0000 7f7da1afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:30.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:30.886+0000 7f7da1afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:31.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:31.036+0000 7f34f4046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:31.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:31.053+0000 7f34f4046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:31.161 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 3 16 584 568 11.8323 12.125 0.0861821 0.0823467 2024-09-16T07:54:31.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:31.370 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:31.385 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2024-09-16T07:54:30.409618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":39,"acting":39,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":177720,"kb_used_data":17016,"kb_used_omap":0,"kb_used_meta":160640,"kb_avail":377309640,"statfs":{"total":386547056640,"available":386365071360,"internally_reserved":0,"allocated":17424384,"data_stored":229422899,"data_compressed":10842083,"data_compressed_allocated":14274560,"data_compressed_original":228147200,"omap_allocated":0,"internal_metadata":164495360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.341550"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092377+0000","last_change":"2024-09-16T07:54:27.093935+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092377+0000","last_undegraded":"2024-09-16T07:54:27.092377+0000","last_fullsized":"2024-09-16T07:54:27.092377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.097446+0000","last_change":"2024-09-16T07:54:27.100163+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.097446+0000","last_undegraded":"2024-09-16T07:54:27.097446+0000","last_fullsized":"2024-09-16T07:54:27.097446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":["1","0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.095323+0000","last_change":"2024-09-16T07:54:27.096790+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.095323+0000","last_undegraded":"2024-09-16T07:54:27.095323+0000","last_fullsized":"2024-09-16T07:54:27.095323+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":["1","2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":269,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.062548+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:07.062548+0000","last_peered":"2024-09-16T07:53:07.062548+0000","last_clean":"2024-09-16T07:53:07.062548+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:54:02.039639+0000","last_undegraded":"2024-09-16T07:53:07.062548+0000","last_fullsized":"2024-09-16T07:53:07.062548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.096663+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:54:27.096663+0000","last_peered":"2024-09-16T07:54:27.096663+0000","last_clean":"2024-09-16T07:54:27.096663+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:54:27.096663+0000","last_undegraded":"2024-09-16T07:54:27.096663+0000","last_fullsized":"2024-09-16T07:54:27.096663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.069932+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:20.069932+0000","last_peered":"2024-09-16T07:54:20.069932+0000","last_clean":"2024-09-16T07:54:20.069932+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:20.069932+0000","last_undegraded":"2024-09-16T07:54:20.069932+0000","last_fullsized":"2024-09-16T07:54:20.069932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087985+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:54:27.087985+0000","last_peered":"2024-09-16T07:54:27.087985+0000","last_clean":"2024-09-16T07:54:27.087985+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:54:27.087985+0000","last_undegraded":"2024-09-16T07:54:27.087985+0000","last_fullsized":"2024-09-16T07:54:27.087985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.060224+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:20.060224+0000","last_peered":"2024-09-16T07:54:20.060224+0000","last_clean":"2024-09-16T07:54:20.060224+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:20.060224+0000","last_undegraded":"2024-09-16T07:54:20.060224+0000","last_fullsized":"2024-09-16T07:54:20.060224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.029835+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:05.029835+0000","last_peered":"2024-09-16T07:54:05.029835+0000","last_clean":"2024-09-16T07:54:05.029835+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:05.029835+0000","last_undegraded":"2024-09-16T07:54:05.029835+0000","last_fullsized":"2024-09-16T07:54:05.029835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.060956+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:07.060956+0000","last_peered":"2024-09-16T07:53:07.060956+0000","last_clean":"2024-09-16T07:53:07.060956+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:54:02.039642+0000","last_undegraded":"2024-09-16T07:53:07.060956+0000","last_fullsized":"2024-09-16T07:53:07.060956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092003+0000","last_change":"2024-09-16T07:54:27.094682+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092003+0000","last_undegraded":"2024-09-16T07:54:27.092003+0000","last_fullsized":"2024-09-16T07:54:27.092003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.024313+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:05.024313+0000","last_peered":"2024-09-16T07:54:05.024313+0000","last_clean":"2024-09-16T07:54:05.024313+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:05.024313+0000","last_undegraded":"2024-09-16T07:54:05.024313+0000","last_fullsized":"2024-09-16T07:54:05.024313+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087522+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:54:27.087522+0000","last_peered":"2024-09-16T07:54:27.087522+0000","last_clean":"2024-09-16T07:54:27.087522+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:54:27.087522+0000","last_undegraded":"2024-09-16T07:54:27.087522+0000","last_fullsized":"2024-09-16T07:54:27.087522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49464,"kb_used_data":8104,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94322376,"statfs":{"total":96636764160,"available":96586113024,"internally_reserved":0,"allocated":8298496,"data_stored":121133609,"data_compressed":5740561,"data_compressed_allocated":7557120,"data_compressed_original":120832000,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48064,"kb_used_data":6896,"kb_used_omap":0,"kb_used_meta":41152,"kb_avail":94323776,"statfs":{"total":96636764160,"available":96587546624,"internally_reserved":0,"allocated":7061504,"data_stored":100894337,"data_compressed":4778953,"data_compressed_allocated":6291456,"data_compressed_original":100581376,"omap_allocated":0,"internal_metadata":42139648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37044,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":823296,"data_stored":327336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43148,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94328692,"statfs":{"total":96636764160,"available":96592580608,"internally_reserved":0,"allocated":1241088,"data_stored":7067617,"data_compressed":322569,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:31.387 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:54:31.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:31.535+0000 7fc663f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:31.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:31.546+0000 7fc663f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:31.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:31.979 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":574,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":100,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473243,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":12},{"state_name":"active+clean","count":7},{"state_name":"creating+activating","count":4},{"state_name":"stale+active+clean","count":2}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590376,"bytes_used":181985280,"bytes_avail":386365071360,"bytes_total":386547056640,"unknown_pgs_ratio":0.47999998927116394,"inactive_pgs_ratio":0.15999999642372131,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:54:32.003 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:54:32.003 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:32.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:32.147+0000 7efe3af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:32.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:32.160+0000 7efe3af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:32.160 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 4 16 778 762 11.9052 12.125 0.188965 0.0825294 2024-09-16T07:54:32.508 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:32.508 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:32.532 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":376,"stamp":"2024-09-16T07:54:32.409972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":39,"acting":39,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":177720,"kb_used_data":17016,"kb_used_omap":0,"kb_used_meta":160640,"kb_avail":377309640,"statfs":{"total":386547056640,"available":386365071360,"internally_reserved":0,"allocated":17424384,"data_stored":229422899,"data_compressed":10842083,"data_compressed_allocated":14274560,"data_compressed_original":228147200,"omap_allocated":0,"internal_metadata":164495360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.338174"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092377+0000","last_change":"2024-09-16T07:54:27.093935+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092377+0000","last_undegraded":"2024-09-16T07:54:27.092377+0000","last_fullsized":"2024-09-16T07:54:27.092377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.097446+0000","last_change":"2024-09-16T07:54:27.100163+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.097446+0000","last_undegraded":"2024-09-16T07:54:27.097446+0000","last_fullsized":"2024-09-16T07:54:27.097446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":["1","0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.095323+0000","last_change":"2024-09-16T07:54:27.096790+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.095323+0000","last_undegraded":"2024-09-16T07:54:27.095323+0000","last_fullsized":"2024-09-16T07:54:27.095323+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":["1","2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":269,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.062548+0000","last_change":"2024-09-16T07:52:52.163601+0000","last_active":"2024-09-16T07:53:07.062548+0000","last_peered":"2024-09-16T07:53:07.062548+0000","last_clean":"2024-09-16T07:53:07.062548+0000","last_became_active":"2024-09-16T07:52:52.157659+0000","last_became_peered":"2024-09-16T07:52:52.157659+0000","last_unstale":"2024-09-16T07:54:02.039639+0000","last_undegraded":"2024-09-16T07:53:07.062548+0000","last_fullsized":"2024-09-16T07:53:07.062548+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.096663+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:54:27.096663+0000","last_peered":"2024-09-16T07:54:27.096663+0000","last_clean":"2024-09-16T07:54:27.096663+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:54:27.096663+0000","last_undegraded":"2024-09-16T07:54:27.096663+0000","last_fullsized":"2024-09-16T07:54:27.096663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.069932+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:20.069932+0000","last_peered":"2024-09-16T07:54:20.069932+0000","last_clean":"2024-09-16T07:54:20.069932+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:20.069932+0000","last_undegraded":"2024-09-16T07:54:20.069932+0000","last_fullsized":"2024-09-16T07:54:20.069932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087985+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:54:27.087985+0000","last_peered":"2024-09-16T07:54:27.087985+0000","last_clean":"2024-09-16T07:54:27.087985+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:54:27.087985+0000","last_undegraded":"2024-09-16T07:54:27.087985+0000","last_fullsized":"2024-09-16T07:54:27.087985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.060224+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:20.060224+0000","last_peered":"2024-09-16T07:54:20.060224+0000","last_clean":"2024-09-16T07:54:20.060224+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:20.060224+0000","last_undegraded":"2024-09-16T07:54:20.060224+0000","last_fullsized":"2024-09-16T07:54:20.060224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.029835+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:05.029835+0000","last_peered":"2024-09-16T07:54:05.029835+0000","last_clean":"2024-09-16T07:54:05.029835+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:05.029835+0000","last_undegraded":"2024-09-16T07:54:05.029835+0000","last_fullsized":"2024-09-16T07:54:05.029835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":86,"state":"stale+active+clean","last_fresh":"2024-09-16T07:53:07.060956+0000","last_change":"2024-09-16T07:52:53.025625+0000","last_active":"2024-09-16T07:53:07.060956+0000","last_peered":"2024-09-16T07:53:07.060956+0000","last_clean":"2024-09-16T07:53:07.060956+0000","last_became_active":"2024-09-16T07:52:52.176425+0000","last_became_peered":"2024-09-16T07:52:52.176425+0000","last_unstale":"2024-09-16T07:54:02.039642+0000","last_undegraded":"2024-09-16T07:53:07.060956+0000","last_fullsized":"2024-09-16T07:53:07.060956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092003+0000","last_change":"2024-09-16T07:54:27.094682+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092003+0000","last_undegraded":"2024-09-16T07:54:27.092003+0000","last_fullsized":"2024-09-16T07:54:27.092003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.024313+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:05.024313+0000","last_peered":"2024-09-16T07:54:05.024313+0000","last_clean":"2024-09-16T07:54:05.024313+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:05.024313+0000","last_undegraded":"2024-09-16T07:54:05.024313+0000","last_fullsized":"2024-09-16T07:54:05.024313+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087522+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:54:27.087522+0000","last_peered":"2024-09-16T07:54:27.087522+0000","last_clean":"2024-09-16T07:54:27.087522+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:54:27.087522+0000","last_undegraded":"2024-09-16T07:54:27.087522+0000","last_fullsized":"2024-09-16T07:54:27.087522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":55,"seq":236223201459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49464,"kb_used_data":8104,"kb_used_omap":0,"kb_used_meta":41344,"kb_avail":94322376,"statfs":{"total":96636764160,"available":96586113024,"internally_reserved":0,"allocated":8298496,"data_stored":121133609,"data_compressed":5740561,"data_compressed_allocated":7557120,"data_compressed_original":120832000,"omap_allocated":0,"internal_metadata":42336256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48064,"kb_used_data":6896,"kb_used_omap":0,"kb_used_meta":41152,"kb_avail":94323776,"statfs":{"total":96636764160,"available":96587546624,"internally_reserved":0,"allocated":7061504,"data_stored":100894337,"data_compressed":4778953,"data_compressed_allocated":6291456,"data_compressed_original":100581376,"omap_allocated":0,"internal_metadata":42139648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37044,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":823296,"data_stored":327336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43148,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94328692,"statfs":{"total":96636764160,"available":96592580608,"internally_reserved":0,"allocated":1241088,"data_stored":7067617,"data_compressed":322569,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:33.161 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 5 16 976 960 11.999 12.375 0.0341976 0.0824515 2024-09-16T07:54:33.172 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:33.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:33.333+0000 7f091c308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:33.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:33.344+0000 7f091c308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:34.161 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 6 16 1175 1159 12.0719 12.4375 0.119361 0.082135 2024-09-16T07:54:35.161 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 7 16 1373 1357 12.1151 12.375 0.0480162 0.0819997 2024-09-16T07:54:35.535 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:35.664 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:35.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:35.697+0000 7f61468fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:35.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:35.714+0000 7f61468fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:35.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:35.833+0000 7fadc36bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:35.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:35.853+0000 7fadc36bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:35.999 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:36.000 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:36.020 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":377,"stamp":"2024-09-16T07:54:34.410302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16581160,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":324,"num_write_kb":16723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":169844,"kb_used_data":12532,"kb_used_omap":0,"kb_used_meta":157248,"kb_avail":377317516,"statfs":{"total":386547056640,"available":386373136384,"internally_reserved":0,"allocated":12832768,"data_stored":154171971,"data_compressed":7265627,"data_compressed_allocated":9568256,"data_compressed_original":152846336,"omap_allocated":0,"internal_metadata":161021952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15990784,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":15616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001418"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092377+0000","last_change":"2024-09-16T07:54:27.093935+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092377+0000","last_undegraded":"2024-09-16T07:54:27.092377+0000","last_fullsized":"2024-09-16T07:54:27.092377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.097446+0000","last_change":"2024-09-16T07:54:27.100163+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.097446+0000","last_undegraded":"2024-09-16T07:54:27.097446+0000","last_fullsized":"2024-09-16T07:54:27.097446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":["1","0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.825541+0000","last_change":"2024-09-16T07:54:27.197656+0000","last_active":"2024-09-16T07:54:32.825541+0000","last_peered":"2024-09-16T07:54:32.825541+0000","last_clean":"2024-09-16T07:54:32.825541+0000","last_became_active":"2024-09-16T07:54:27.186041+0000","last_became_peered":"2024-09-16T07:54:27.186041+0000","last_unstale":"2024-09-16T07:54:32.825541+0000","last_undegraded":"2024-09-16T07:54:32.825541+0000","last_fullsized":"2024-09-16T07:54:32.825541+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.095323+0000","last_change":"2024-09-16T07:54:27.096790+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.095323+0000","last_undegraded":"2024-09-16T07:54:27.095323+0000","last_fullsized":"2024-09-16T07:54:27.095323+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":["1","2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.047740+0000","last_change":"2024-09-16T07:54:27.210146+0000","last_active":"2024-09-16T07:54:33.047740+0000","last_peered":"2024-09-16T07:54:33.047740+0000","last_clean":"2024-09-16T07:54:33.047740+0000","last_became_active":"2024-09-16T07:54:27.202101+0000","last_became_peered":"2024-09-16T07:54:27.202101+0000","last_unstale":"2024-09-16T07:54:33.047740+0000","last_undegraded":"2024-09-16T07:54:33.047740+0000","last_fullsized":"2024-09-16T07:54:33.047740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.021677+0000","last_change":"2024-09-16T07:54:04.226137+0000","last_active":"2024-09-16T07:54:28.021677+0000","last_peered":"2024-09-16T07:54:28.021677+0000","last_clean":"2024-09-16T07:54:28.021677+0000","last_became_active":"2024-09-16T07:54:04.213409+0000","last_became_peered":"2024-09-16T07:54:04.213409+0000","last_unstale":"2024-09-16T07:54:28.021677+0000","last_undegraded":"2024-09-16T07:54:28.021677+0000","last_fullsized":"2024-09-16T07:54:28.021677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.096663+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:54:27.096663+0000","last_peered":"2024-09-16T07:54:27.096663+0000","last_clean":"2024-09-16T07:54:27.096663+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:54:27.096663+0000","last_undegraded":"2024-09-16T07:54:27.096663+0000","last_fullsized":"2024-09-16T07:54:27.096663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"100'67","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.114964+0000","last_change":"2024-09-16T07:54:27.267114+0000","last_active":"2024-09-16T07:54:33.114964+0000","last_peered":"2024-09-16T07:54:33.114964+0000","last_clean":"2024-09-16T07:54:33.114964+0000","last_became_active":"2024-09-16T07:54:27.258014+0000","last_became_peered":"2024-09-16T07:54:27.258014+0000","last_unstale":"2024-09-16T07:54:33.114964+0000","last_undegraded":"2024-09-16T07:54:33.114964+0000","last_fullsized":"2024-09-16T07:54:33.114964+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.069932+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:20.069932+0000","last_peered":"2024-09-16T07:54:20.069932+0000","last_clean":"2024-09-16T07:54:20.069932+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:20.069932+0000","last_undegraded":"2024-09-16T07:54:20.069932+0000","last_fullsized":"2024-09-16T07:54:20.069932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087985+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:54:27.087985+0000","last_peered":"2024-09-16T07:54:27.087985+0000","last_clean":"2024-09-16T07:54:27.087985+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:54:27.087985+0000","last_undegraded":"2024-09-16T07:54:27.087985+0000","last_fullsized":"2024-09-16T07:54:27.087985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"100'51","reported_seq":63,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.936929+0000","last_change":"2024-09-16T07:54:27.230732+0000","last_active":"2024-09-16T07:54:32.936929+0000","last_peered":"2024-09-16T07:54:32.936929+0000","last_clean":"2024-09-16T07:54:32.936929+0000","last_became_active":"2024-09-16T07:54:27.224955+0000","last_became_peered":"2024-09-16T07:54:27.224955+0000","last_unstale":"2024-09-16T07:54:32.936929+0000","last_undegraded":"2024-09-16T07:54:32.936929+0000","last_fullsized":"2024-09-16T07:54:32.936929+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.060224+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:20.060224+0000","last_peered":"2024-09-16T07:54:20.060224+0000","last_clean":"2024-09-16T07:54:20.060224+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:20.060224+0000","last_undegraded":"2024-09-16T07:54:20.060224+0000","last_fullsized":"2024-09-16T07:54:20.060224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.029835+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:05.029835+0000","last_peered":"2024-09-16T07:54:05.029835+0000","last_clean":"2024-09-16T07:54:05.029835+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:05.029835+0000","last_undegraded":"2024-09-16T07:54:05.029835+0000","last_fullsized":"2024-09-16T07:54:05.029835+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.024640+0000","last_change":"2024-09-16T07:54:05.026553+0000","last_active":"2024-09-16T07:54:28.024640+0000","last_peered":"2024-09-16T07:54:28.024640+0000","last_clean":"2024-09-16T07:54:28.024640+0000","last_became_active":"2024-09-16T07:54:04.222017+0000","last_became_peered":"2024-09-16T07:54:04.222017+0000","last_unstale":"2024-09-16T07:54:28.024640+0000","last_undegraded":"2024-09-16T07:54:28.024640+0000","last_fullsized":"2024-09-16T07:54:28.024640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092003+0000","last_change":"2024-09-16T07:54:27.094682+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092003+0000","last_undegraded":"2024-09-16T07:54:27.092003+0000","last_fullsized":"2024-09-16T07:54:27.092003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-16T07:54:05.024313+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:05.024313+0000","last_peered":"2024-09-16T07:54:05.024313+0000","last_clean":"2024-09-16T07:54:05.024313+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:05.024313+0000","last_undegraded":"2024-09-16T07:54:05.024313+0000","last_fullsized":"2024-09-16T07:54:05.024313+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087522+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:54:27.087522+0000","last_peered":"2024-09-16T07:54:27.087522+0000","last_clean":"2024-09-16T07:54:27.087522+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:54:27.087522+0000","last_undegraded":"2024-09-16T07:54:27.087522+0000","last_fullsized":"2024-09-16T07:54:27.087522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":15990784,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":244,"num_write_kb":15616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2871296,"data_stored":45940736,"data_compressed":2180729,"data_compressed_allocated":2871296,"data_compressed_original":45940736,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41588,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94330252,"statfs":{"total":96636764160,"available":96594178048,"internally_reserved":0,"allocated":3706880,"data_stored":45882681,"data_compressed":2164105,"data_compressed_allocated":2850816,"data_compressed_original":45531136,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48064,"kb_used_data":6896,"kb_used_omap":0,"kb_used_meta":41152,"kb_avail":94323776,"statfs":{"total":96636764160,"available":96587546624,"internally_reserved":0,"allocated":7061504,"data_stored":100894337,"data_compressed":4778953,"data_compressed_allocated":6291456,"data_compressed_original":100581376,"omap_allocated":0,"internal_metadata":42139648},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37044,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":823296,"data_stored":327336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43148,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94328692,"statfs":{"total":96636764160,"available":96592580608,"internally_reserved":0,"allocated":1241088,"data_stored":7067617,"data_compressed":322569,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2871296,"data_stored":45940736,"data_compressed":2180729,"data_compressed_allocated":2871296,"data_compressed_original":45940736,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:36.022 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:54:36.161 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 8 16 1540 1524 11.9053 10.4375 0.0913882 0.0831741 2024-09-16T07:54:36.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:36.212+0000 7f9851791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:36.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:36.222+0000 7f9851791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:36.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:36.657 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":578,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":100,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473243,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":13},{"state_name":"unknown","count":8},{"state_name":"creating+activating","count":4}],"num_pgs":25,"num_pools":3,"num_objects":248,"data_bytes":16581160,"bytes_used":173920256,"bytes_avail":386373136384,"bytes_total":386547056640,"unknown_pgs_ratio":0.31999999284744263,"inactive_pgs_ratio":0.15999999642372131,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"write_bytes_sec":1998493,"read_op_per_sec":0,"write_op_per_sec":30},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:54:36.676 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:54:36.676 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:36.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:36.825+0000 7f9cfe991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:36.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:36.840+0000 7f9cfe991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:37.150 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:37.150 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:37.161 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 9 16 1725 1709 11.867 11.5625 0.114904 0.0837468 2024-09-16T07:54:37.171 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":378,"stamp":"2024-09-16T07:54:36.410676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47841832,"num_objects":725,"num_object_clones":0,"num_object_copies":2175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":801,"num_write_kb":47251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":163176,"kb_used_data":10024,"kb_used_omap":0,"kb_used_meta":153088,"kb_avail":377324184,"statfs":{"total":386547056640,"available":386379964416,"internally_reserved":0,"allocated":10264576,"data_stored":111677710,"data_compressed":5245195,"data_compressed_allocated":6909952,"data_compressed_original":110313472,"omap_allocated":0,"internal_metadata":156762112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.334850"},"pg_stats":[{"pgid":"6.f","version":"100'113","reported_seq":125,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.600732+0000","last_change":"2024-09-16T07:54:27.190851+0000","last_active":"2024-09-16T07:54:35.600732+0000","last_peered":"2024-09-16T07:54:35.600732+0000","last_clean":"2024-09-16T07:54:35.600732+0000","last_became_active":"2024-09-16T07:54:27.182196+0000","last_became_peered":"2024-09-16T07:54:27.182196+0000","last_unstale":"2024-09-16T07:54:35.600732+0000","last_undegraded":"2024-09-16T07:54:35.600732+0000","last_fullsized":"2024-09-16T07:54:35.600732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092377+0000","last_change":"2024-09-16T07:54:27.093935+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092377+0000","last_undegraded":"2024-09-16T07:54:27.092377+0000","last_fullsized":"2024-09-16T07:54:27.092377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.097446+0000","last_change":"2024-09-16T07:54:27.100163+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.097446+0000","last_undegraded":"2024-09-16T07:54:27.097446+0000","last_fullsized":"2024-09-16T07:54:27.097446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":["1","0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.825541+0000","last_change":"2024-09-16T07:54:27.197656+0000","last_active":"2024-09-16T07:54:32.825541+0000","last_peered":"2024-09-16T07:54:32.825541+0000","last_clean":"2024-09-16T07:54:32.825541+0000","last_became_active":"2024-09-16T07:54:27.186041+0000","last_became_peered":"2024-09-16T07:54:27.186041+0000","last_unstale":"2024-09-16T07:54:32.825541+0000","last_undegraded":"2024-09-16T07:54:32.825541+0000","last_fullsized":"2024-09-16T07:54:32.825541+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.095323+0000","last_change":"2024-09-16T07:54:27.096790+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.095323+0000","last_undegraded":"2024-09-16T07:54:27.095323+0000","last_fullsized":"2024-09-16T07:54:27.095323+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":["1","2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"100'87","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.747482+0000","last_change":"2024-09-16T07:54:27.286418+0000","last_active":"2024-09-16T07:54:35.747482+0000","last_peered":"2024-09-16T07:54:35.747482+0000","last_clean":"2024-09-16T07:54:35.747482+0000","last_became_active":"2024-09-16T07:54:27.270873+0000","last_became_peered":"2024-09-16T07:54:27.270873+0000","last_unstale":"2024-09-16T07:54:35.747482+0000","last_undegraded":"2024-09-16T07:54:35.747482+0000","last_fullsized":"2024-09-16T07:54:35.747482+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.047740+0000","last_change":"2024-09-16T07:54:27.210146+0000","last_active":"2024-09-16T07:54:33.047740+0000","last_peered":"2024-09-16T07:54:33.047740+0000","last_clean":"2024-09-16T07:54:33.047740+0000","last_became_active":"2024-09-16T07:54:27.202101+0000","last_became_peered":"2024-09-16T07:54:27.202101+0000","last_unstale":"2024-09-16T07:54:33.047740+0000","last_undegraded":"2024-09-16T07:54:33.047740+0000","last_fullsized":"2024-09-16T07:54:33.047740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.021677+0000","last_change":"2024-09-16T07:54:04.226137+0000","last_active":"2024-09-16T07:54:28.021677+0000","last_peered":"2024-09-16T07:54:28.021677+0000","last_clean":"2024-09-16T07:54:28.021677+0000","last_became_active":"2024-09-16T07:54:04.213409+0000","last_became_peered":"2024-09-16T07:54:04.213409+0000","last_unstale":"2024-09-16T07:54:28.021677+0000","last_undegraded":"2024-09-16T07:54:28.021677+0000","last_fullsized":"2024-09-16T07:54:28.021677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.096663+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:54:27.096663+0000","last_peered":"2024-09-16T07:54:27.096663+0000","last_clean":"2024-09-16T07:54:27.096663+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:54:27.096663+0000","last_undegraded":"2024-09-16T07:54:27.096663+0000","last_fullsized":"2024-09-16T07:54:27.096663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"100'67","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.114964+0000","last_change":"2024-09-16T07:54:27.267114+0000","last_active":"2024-09-16T07:54:33.114964+0000","last_peered":"2024-09-16T07:54:33.114964+0000","last_clean":"2024-09-16T07:54:33.114964+0000","last_became_active":"2024-09-16T07:54:27.258014+0000","last_became_peered":"2024-09-16T07:54:27.258014+0000","last_unstale":"2024-09-16T07:54:33.114964+0000","last_undegraded":"2024-09-16T07:54:33.114964+0000","last_fullsized":"2024-09-16T07:54:33.114964+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.069932+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:20.069932+0000","last_peered":"2024-09-16T07:54:20.069932+0000","last_clean":"2024-09-16T07:54:20.069932+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:20.069932+0000","last_undegraded":"2024-09-16T07:54:20.069932+0000","last_fullsized":"2024-09-16T07:54:20.069932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"100'92","reported_seq":104,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.646788+0000","last_change":"2024-09-16T07:54:27.222094+0000","last_active":"2024-09-16T07:54:35.646788+0000","last_peered":"2024-09-16T07:54:35.646788+0000","last_clean":"2024-09-16T07:54:35.646788+0000","last_became_active":"2024-09-16T07:54:27.217304+0000","last_became_peered":"2024-09-16T07:54:27.217304+0000","last_unstale":"2024-09-16T07:54:35.646788+0000","last_undegraded":"2024-09-16T07:54:35.646788+0000","last_fullsized":"2024-09-16T07:54:35.646788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087985+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:54:27.087985+0000","last_peered":"2024-09-16T07:54:27.087985+0000","last_clean":"2024-09-16T07:54:27.087985+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:54:27.087985+0000","last_undegraded":"2024-09-16T07:54:27.087985+0000","last_fullsized":"2024-09-16T07:54:27.087985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"100'51","reported_seq":63,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.936929+0000","last_change":"2024-09-16T07:54:27.230732+0000","last_active":"2024-09-16T07:54:32.936929+0000","last_peered":"2024-09-16T07:54:32.936929+0000","last_clean":"2024-09-16T07:54:32.936929+0000","last_became_active":"2024-09-16T07:54:27.224955+0000","last_became_peered":"2024-09-16T07:54:27.224955+0000","last_unstale":"2024-09-16T07:54:32.936929+0000","last_undegraded":"2024-09-16T07:54:32.936929+0000","last_fullsized":"2024-09-16T07:54:32.936929+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.060224+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:20.060224+0000","last_peered":"2024-09-16T07:54:20.060224+0000","last_clean":"2024-09-16T07:54:20.060224+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:20.060224+0000","last_undegraded":"2024-09-16T07:54:20.060224+0000","last_fullsized":"2024-09-16T07:54:20.060224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"100'101","reported_seq":113,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.724678+0000","last_change":"2024-09-16T07:54:27.288961+0000","last_active":"2024-09-16T07:54:35.724678+0000","last_peered":"2024-09-16T07:54:35.724678+0000","last_clean":"2024-09-16T07:54:35.724678+0000","last_became_active":"2024-09-16T07:54:27.264185+0000","last_became_peered":"2024-09-16T07:54:27.264185+0000","last_unstale":"2024-09-16T07:54:35.724678+0000","last_undegraded":"2024-09-16T07:54:35.724678+0000","last_fullsized":"2024-09-16T07:54:35.724678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.031002+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:28.031002+0000","last_peered":"2024-09-16T07:54:28.031002+0000","last_clean":"2024-09-16T07:54:28.031002+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:28.031002+0000","last_undegraded":"2024-09-16T07:54:28.031002+0000","last_fullsized":"2024-09-16T07:54:28.031002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"100'84","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.648824+0000","last_change":"2024-09-16T07:54:27.244832+0000","last_active":"2024-09-16T07:54:35.648824+0000","last_peered":"2024-09-16T07:54:35.648824+0000","last_clean":"2024-09-16T07:54:35.648824+0000","last_became_active":"2024-09-16T07:54:27.237065+0000","last_became_peered":"2024-09-16T07:54:27.237065+0000","last_unstale":"2024-09-16T07:54:35.648824+0000","last_undegraded":"2024-09-16T07:54:35.648824+0000","last_fullsized":"2024-09-16T07:54:35.648824+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.024640+0000","last_change":"2024-09-16T07:54:05.026553+0000","last_active":"2024-09-16T07:54:28.024640+0000","last_peered":"2024-09-16T07:54:28.024640+0000","last_clean":"2024-09-16T07:54:28.024640+0000","last_became_active":"2024-09-16T07:54:04.222017+0000","last_became_peered":"2024-09-16T07:54:04.222017+0000","last_unstale":"2024-09-16T07:54:28.024640+0000","last_undegraded":"2024-09-16T07:54:28.024640+0000","last_fullsized":"2024-09-16T07:54:28.024640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092003+0000","last_change":"2024-09-16T07:54:27.094682+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092003+0000","last_undegraded":"2024-09-16T07:54:27.092003+0000","last_fullsized":"2024-09-16T07:54:27.092003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.023386+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:28.023386+0000","last_peered":"2024-09-16T07:54:28.023386+0000","last_clean":"2024-09-16T07:54:28.023386+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:28.023386+0000","last_undegraded":"2024-09-16T07:54:28.023386+0000","last_fullsized":"2024-09-16T07:54:28.023386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087522+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:54:27.087522+0000","last_peered":"2024-09-16T07:54:27.087522+0000","last_clean":"2024-09-16T07:54:27.087522+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:54:27.087522+0000","last_undegraded":"2024-09-16T07:54:27.087522+0000","last_fullsized":"2024-09-16T07:54:27.087522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6975488,"data_stored":111607808,"data_compressed":5298209,"data_compressed_allocated":6975488,"data_compressed_original":111607808,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":39,"acting":39,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41588,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94330252,"statfs":{"total":96636764160,"available":96594178048,"internally_reserved":0,"allocated":3706880,"data_stored":45882681,"data_compressed":2164105,"data_compressed_allocated":2850816,"data_compressed_original":45531136,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41396,"kb_used_data":4388,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94330444,"statfs":{"total":96636764160,"available":96594374656,"internally_reserved":0,"allocated":4493312,"data_stored":58400076,"data_compressed":2758521,"data_compressed_allocated":3633152,"data_compressed_original":58048512,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37044,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":823296,"data_stored":327336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43148,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94328692,"statfs":{"total":96636764160,"available":96592580608,"internally_reserved":0,"allocated":1241088,"data_stored":7067617,"data_compressed":322569,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4104192,"data_stored":65667072,"data_compressed":3117480,"data_compressed_allocated":4104192,"data_compressed_original":65667072,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2871296,"data_stored":45940736,"data_compressed":2180729,"data_compressed_allocated":2871296,"data_compressed_original":45940736,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:38.107 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:38.161 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 10 16 1916 1900 11.874 11.9375 0.0700508 0.0836777 2024-09-16T07:54:38.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:38.281+0000 7fd52cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:38.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:38.290+0000 7fd52cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:39.161 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 11 16 2107 2091 11.8797 11.9375 0.0290746 0.0836225 2024-09-16T07:54:40.161 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 12 16 2313 2297 11.9625 12.875 0.0584382 0.0833824 2024-09-16T07:54:40.174 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:40.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:40.332+0000 7f555cca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:40.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:40.351+0000 7f555cca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:40.571 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:40.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:40.658 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:40.678 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-09-16T07:54:40.411564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47841832,"num_objects":725,"num_object_clones":0,"num_object_copies":2175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":801,"num_write_kb":47251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":163176,"kb_used_data":10024,"kb_used_omap":0,"kb_used_meta":153088,"kb_avail":377324184,"statfs":{"total":386547056640,"available":386379964416,"internally_reserved":0,"allocated":10264576,"data_stored":111677710,"data_compressed":5245195,"data_compressed_allocated":6909952,"data_compressed_original":110313472,"omap_allocated":0,"internal_metadata":156762112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002311"},"pg_stats":[{"pgid":"6.f","version":"100'113","reported_seq":125,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.600732+0000","last_change":"2024-09-16T07:54:27.190851+0000","last_active":"2024-09-16T07:54:35.600732+0000","last_peered":"2024-09-16T07:54:35.600732+0000","last_clean":"2024-09-16T07:54:35.600732+0000","last_became_active":"2024-09-16T07:54:27.182196+0000","last_became_peered":"2024-09-16T07:54:27.182196+0000","last_unstale":"2024-09-16T07:54:35.600732+0000","last_undegraded":"2024-09-16T07:54:35.600732+0000","last_fullsized":"2024-09-16T07:54:35.600732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092377+0000","last_change":"2024-09-16T07:54:27.093935+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092377+0000","last_undegraded":"2024-09-16T07:54:27.092377+0000","last_fullsized":"2024-09-16T07:54:27.092377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.097446+0000","last_change":"2024-09-16T07:54:27.100163+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.097446+0000","last_undegraded":"2024-09-16T07:54:27.097446+0000","last_fullsized":"2024-09-16T07:54:27.097446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":["1","0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.825541+0000","last_change":"2024-09-16T07:54:27.197656+0000","last_active":"2024-09-16T07:54:32.825541+0000","last_peered":"2024-09-16T07:54:32.825541+0000","last_clean":"2024-09-16T07:54:32.825541+0000","last_became_active":"2024-09-16T07:54:27.186041+0000","last_became_peered":"2024-09-16T07:54:27.186041+0000","last_unstale":"2024-09-16T07:54:32.825541+0000","last_undegraded":"2024-09-16T07:54:32.825541+0000","last_fullsized":"2024-09-16T07:54:32.825541+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.095323+0000","last_change":"2024-09-16T07:54:27.096790+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.095323+0000","last_undegraded":"2024-09-16T07:54:27.095323+0000","last_fullsized":"2024-09-16T07:54:27.095323+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":["1","2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"100'87","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.747482+0000","last_change":"2024-09-16T07:54:27.286418+0000","last_active":"2024-09-16T07:54:35.747482+0000","last_peered":"2024-09-16T07:54:35.747482+0000","last_clean":"2024-09-16T07:54:35.747482+0000","last_became_active":"2024-09-16T07:54:27.270873+0000","last_became_peered":"2024-09-16T07:54:27.270873+0000","last_unstale":"2024-09-16T07:54:35.747482+0000","last_undegraded":"2024-09-16T07:54:35.747482+0000","last_fullsized":"2024-09-16T07:54:35.747482+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.047740+0000","last_change":"2024-09-16T07:54:27.210146+0000","last_active":"2024-09-16T07:54:33.047740+0000","last_peered":"2024-09-16T07:54:33.047740+0000","last_clean":"2024-09-16T07:54:33.047740+0000","last_became_active":"2024-09-16T07:54:27.202101+0000","last_became_peered":"2024-09-16T07:54:27.202101+0000","last_unstale":"2024-09-16T07:54:33.047740+0000","last_undegraded":"2024-09-16T07:54:33.047740+0000","last_fullsized":"2024-09-16T07:54:33.047740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.021677+0000","last_change":"2024-09-16T07:54:04.226137+0000","last_active":"2024-09-16T07:54:28.021677+0000","last_peered":"2024-09-16T07:54:28.021677+0000","last_clean":"2024-09-16T07:54:28.021677+0000","last_became_active":"2024-09-16T07:54:04.213409+0000","last_became_peered":"2024-09-16T07:54:04.213409+0000","last_unstale":"2024-09-16T07:54:28.021677+0000","last_undegraded":"2024-09-16T07:54:28.021677+0000","last_fullsized":"2024-09-16T07:54:28.021677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.096663+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:54:27.096663+0000","last_peered":"2024-09-16T07:54:27.096663+0000","last_clean":"2024-09-16T07:54:27.096663+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:54:27.096663+0000","last_undegraded":"2024-09-16T07:54:27.096663+0000","last_fullsized":"2024-09-16T07:54:27.096663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"100'67","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.114964+0000","last_change":"2024-09-16T07:54:27.267114+0000","last_active":"2024-09-16T07:54:33.114964+0000","last_peered":"2024-09-16T07:54:33.114964+0000","last_clean":"2024-09-16T07:54:33.114964+0000","last_became_active":"2024-09-16T07:54:27.258014+0000","last_became_peered":"2024-09-16T07:54:27.258014+0000","last_unstale":"2024-09-16T07:54:33.114964+0000","last_undegraded":"2024-09-16T07:54:33.114964+0000","last_fullsized":"2024-09-16T07:54:33.114964+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.069932+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:20.069932+0000","last_peered":"2024-09-16T07:54:20.069932+0000","last_clean":"2024-09-16T07:54:20.069932+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:20.069932+0000","last_undegraded":"2024-09-16T07:54:20.069932+0000","last_fullsized":"2024-09-16T07:54:20.069932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"100'92","reported_seq":104,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.646788+0000","last_change":"2024-09-16T07:54:27.222094+0000","last_active":"2024-09-16T07:54:35.646788+0000","last_peered":"2024-09-16T07:54:35.646788+0000","last_clean":"2024-09-16T07:54:35.646788+0000","last_became_active":"2024-09-16T07:54:27.217304+0000","last_became_peered":"2024-09-16T07:54:27.217304+0000","last_unstale":"2024-09-16T07:54:35.646788+0000","last_undegraded":"2024-09-16T07:54:35.646788+0000","last_fullsized":"2024-09-16T07:54:35.646788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087985+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:54:27.087985+0000","last_peered":"2024-09-16T07:54:27.087985+0000","last_clean":"2024-09-16T07:54:27.087985+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:54:27.087985+0000","last_undegraded":"2024-09-16T07:54:27.087985+0000","last_fullsized":"2024-09-16T07:54:27.087985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"100'51","reported_seq":63,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.936929+0000","last_change":"2024-09-16T07:54:27.230732+0000","last_active":"2024-09-16T07:54:32.936929+0000","last_peered":"2024-09-16T07:54:32.936929+0000","last_clean":"2024-09-16T07:54:32.936929+0000","last_became_active":"2024-09-16T07:54:27.224955+0000","last_became_peered":"2024-09-16T07:54:27.224955+0000","last_unstale":"2024-09-16T07:54:32.936929+0000","last_undegraded":"2024-09-16T07:54:32.936929+0000","last_fullsized":"2024-09-16T07:54:32.936929+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.060224+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:20.060224+0000","last_peered":"2024-09-16T07:54:20.060224+0000","last_clean":"2024-09-16T07:54:20.060224+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:20.060224+0000","last_undegraded":"2024-09-16T07:54:20.060224+0000","last_fullsized":"2024-09-16T07:54:20.060224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"100'101","reported_seq":113,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.724678+0000","last_change":"2024-09-16T07:54:27.288961+0000","last_active":"2024-09-16T07:54:35.724678+0000","last_peered":"2024-09-16T07:54:35.724678+0000","last_clean":"2024-09-16T07:54:35.724678+0000","last_became_active":"2024-09-16T07:54:27.264185+0000","last_became_peered":"2024-09-16T07:54:27.264185+0000","last_unstale":"2024-09-16T07:54:35.724678+0000","last_undegraded":"2024-09-16T07:54:35.724678+0000","last_fullsized":"2024-09-16T07:54:35.724678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.031002+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:28.031002+0000","last_peered":"2024-09-16T07:54:28.031002+0000","last_clean":"2024-09-16T07:54:28.031002+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:28.031002+0000","last_undegraded":"2024-09-16T07:54:28.031002+0000","last_fullsized":"2024-09-16T07:54:28.031002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"100'84","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.648824+0000","last_change":"2024-09-16T07:54:27.244832+0000","last_active":"2024-09-16T07:54:35.648824+0000","last_peered":"2024-09-16T07:54:35.648824+0000","last_clean":"2024-09-16T07:54:35.648824+0000","last_became_active":"2024-09-16T07:54:27.237065+0000","last_became_peered":"2024-09-16T07:54:27.237065+0000","last_unstale":"2024-09-16T07:54:35.648824+0000","last_undegraded":"2024-09-16T07:54:35.648824+0000","last_fullsized":"2024-09-16T07:54:35.648824+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.024640+0000","last_change":"2024-09-16T07:54:05.026553+0000","last_active":"2024-09-16T07:54:28.024640+0000","last_peered":"2024-09-16T07:54:28.024640+0000","last_clean":"2024-09-16T07:54:28.024640+0000","last_became_active":"2024-09-16T07:54:04.222017+0000","last_became_peered":"2024-09-16T07:54:04.222017+0000","last_unstale":"2024-09-16T07:54:28.024640+0000","last_undegraded":"2024-09-16T07:54:28.024640+0000","last_fullsized":"2024-09-16T07:54:28.024640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092003+0000","last_change":"2024-09-16T07:54:27.094682+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092003+0000","last_undegraded":"2024-09-16T07:54:27.092003+0000","last_fullsized":"2024-09-16T07:54:27.092003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.023386+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:28.023386+0000","last_peered":"2024-09-16T07:54:28.023386+0000","last_clean":"2024-09-16T07:54:28.023386+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:28.023386+0000","last_undegraded":"2024-09-16T07:54:28.023386+0000","last_fullsized":"2024-09-16T07:54:28.023386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087522+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:54:27.087522+0000","last_peered":"2024-09-16T07:54:27.087522+0000","last_clean":"2024-09-16T07:54:27.087522+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:54:27.087522+0000","last_undegraded":"2024-09-16T07:54:27.087522+0000","last_fullsized":"2024-09-16T07:54:27.087522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6975488,"data_stored":111607808,"data_compressed":5298209,"data_compressed_allocated":6975488,"data_compressed_original":111607808,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":39,"acting":39,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41588,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94330252,"statfs":{"total":96636764160,"available":96594178048,"internally_reserved":0,"allocated":3706880,"data_stored":45882681,"data_compressed":2164105,"data_compressed_allocated":2850816,"data_compressed_original":45531136,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41396,"kb_used_data":4388,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94330444,"statfs":{"total":96636764160,"available":96594374656,"internally_reserved":0,"allocated":4493312,"data_stored":58400076,"data_compressed":2758521,"data_compressed_allocated":3633152,"data_compressed_original":58048512,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37044,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":823296,"data_stored":327336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43148,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94328692,"statfs":{"total":96636764160,"available":96592580608,"internally_reserved":0,"allocated":1241088,"data_stored":7067617,"data_compressed":322569,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4104192,"data_stored":65667072,"data_compressed":3117480,"data_compressed_allocated":4104192,"data_compressed_original":65667072,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2871296,"data_stored":45940736,"data_compressed":2180729,"data_compressed_allocated":2871296,"data_compressed_original":45940736,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:40.680 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:54:40.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:40.737+0000 7fa043508640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:40.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:40.751+0000 7fa0422a6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:40.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:40.841+0000 7f1a88f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:40.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:40.854+0000 7f1a88f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:41.161 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 13 16 2497 2481 11.9268 11.5 0.0782435 0.0834168 2024-09-16T07:54:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:41.278 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":583,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":100,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473243,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":18},{"state_name":"creating+activating","count":4},{"state_name":"unknown","count":3}],"num_pgs":25,"num_pools":3,"num_objects":725,"data_bytes":47841832,"bytes_used":167092224,"bytes_avail":386379964416,"bytes_total":386547056640,"unknown_pgs_ratio":0.11999999731779099,"inactive_pgs_ratio":0.15999999642372131,"write_bytes_sec":3936863,"read_op_per_sec":0,"write_op_per_sec":60},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:54:41.300 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:54:41.301 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:41.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:41.448+0000 7f1246951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:41.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:41.460+0000 7f1246951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:41.733 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:41.753 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-09-16T07:54:40.411564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47841832,"num_objects":725,"num_object_clones":0,"num_object_copies":2175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":801,"num_write_kb":47251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":163176,"kb_used_data":10024,"kb_used_omap":0,"kb_used_meta":153088,"kb_avail":377324184,"statfs":{"total":386547056640,"available":386379964416,"internally_reserved":0,"allocated":10264576,"data_stored":111677710,"data_compressed":5245195,"data_compressed_allocated":6909952,"data_compressed_original":110313472,"omap_allocated":0,"internal_metadata":156762112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002311"},"pg_stats":[{"pgid":"6.f","version":"100'113","reported_seq":125,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.600732+0000","last_change":"2024-09-16T07:54:27.190851+0000","last_active":"2024-09-16T07:54:35.600732+0000","last_peered":"2024-09-16T07:54:35.600732+0000","last_clean":"2024-09-16T07:54:35.600732+0000","last_became_active":"2024-09-16T07:54:27.182196+0000","last_became_peered":"2024-09-16T07:54:27.182196+0000","last_unstale":"2024-09-16T07:54:35.600732+0000","last_undegraded":"2024-09-16T07:54:35.600732+0000","last_fullsized":"2024-09-16T07:54:35.600732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092377+0000","last_change":"2024-09-16T07:54:27.093935+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092377+0000","last_undegraded":"2024-09-16T07:54:27.092377+0000","last_fullsized":"2024-09-16T07:54:27.092377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.097446+0000","last_change":"2024-09-16T07:54:27.100163+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.097446+0000","last_undegraded":"2024-09-16T07:54:27.097446+0000","last_fullsized":"2024-09-16T07:54:27.097446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":["1","0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.825541+0000","last_change":"2024-09-16T07:54:27.197656+0000","last_active":"2024-09-16T07:54:32.825541+0000","last_peered":"2024-09-16T07:54:32.825541+0000","last_clean":"2024-09-16T07:54:32.825541+0000","last_became_active":"2024-09-16T07:54:27.186041+0000","last_became_peered":"2024-09-16T07:54:27.186041+0000","last_unstale":"2024-09-16T07:54:32.825541+0000","last_undegraded":"2024-09-16T07:54:32.825541+0000","last_fullsized":"2024-09-16T07:54:32.825541+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.095323+0000","last_change":"2024-09-16T07:54:27.096790+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.095323+0000","last_undegraded":"2024-09-16T07:54:27.095323+0000","last_fullsized":"2024-09-16T07:54:27.095323+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":["1","2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"100'87","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.747482+0000","last_change":"2024-09-16T07:54:27.286418+0000","last_active":"2024-09-16T07:54:35.747482+0000","last_peered":"2024-09-16T07:54:35.747482+0000","last_clean":"2024-09-16T07:54:35.747482+0000","last_became_active":"2024-09-16T07:54:27.270873+0000","last_became_peered":"2024-09-16T07:54:27.270873+0000","last_unstale":"2024-09-16T07:54:35.747482+0000","last_undegraded":"2024-09-16T07:54:35.747482+0000","last_fullsized":"2024-09-16T07:54:35.747482+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.047740+0000","last_change":"2024-09-16T07:54:27.210146+0000","last_active":"2024-09-16T07:54:33.047740+0000","last_peered":"2024-09-16T07:54:33.047740+0000","last_clean":"2024-09-16T07:54:33.047740+0000","last_became_active":"2024-09-16T07:54:27.202101+0000","last_became_peered":"2024-09-16T07:54:27.202101+0000","last_unstale":"2024-09-16T07:54:33.047740+0000","last_undegraded":"2024-09-16T07:54:33.047740+0000","last_fullsized":"2024-09-16T07:54:33.047740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.021677+0000","last_change":"2024-09-16T07:54:04.226137+0000","last_active":"2024-09-16T07:54:28.021677+0000","last_peered":"2024-09-16T07:54:28.021677+0000","last_clean":"2024-09-16T07:54:28.021677+0000","last_became_active":"2024-09-16T07:54:04.213409+0000","last_became_peered":"2024-09-16T07:54:04.213409+0000","last_unstale":"2024-09-16T07:54:28.021677+0000","last_undegraded":"2024-09-16T07:54:28.021677+0000","last_fullsized":"2024-09-16T07:54:28.021677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.096663+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:54:27.096663+0000","last_peered":"2024-09-16T07:54:27.096663+0000","last_clean":"2024-09-16T07:54:27.096663+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:54:27.096663+0000","last_undegraded":"2024-09-16T07:54:27.096663+0000","last_fullsized":"2024-09-16T07:54:27.096663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"100'67","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.114964+0000","last_change":"2024-09-16T07:54:27.267114+0000","last_active":"2024-09-16T07:54:33.114964+0000","last_peered":"2024-09-16T07:54:33.114964+0000","last_clean":"2024-09-16T07:54:33.114964+0000","last_became_active":"2024-09-16T07:54:27.258014+0000","last_became_peered":"2024-09-16T07:54:27.258014+0000","last_unstale":"2024-09-16T07:54:33.114964+0000","last_undegraded":"2024-09-16T07:54:33.114964+0000","last_fullsized":"2024-09-16T07:54:33.114964+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.069932+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:20.069932+0000","last_peered":"2024-09-16T07:54:20.069932+0000","last_clean":"2024-09-16T07:54:20.069932+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:20.069932+0000","last_undegraded":"2024-09-16T07:54:20.069932+0000","last_fullsized":"2024-09-16T07:54:20.069932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"100'92","reported_seq":104,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.646788+0000","last_change":"2024-09-16T07:54:27.222094+0000","last_active":"2024-09-16T07:54:35.646788+0000","last_peered":"2024-09-16T07:54:35.646788+0000","last_clean":"2024-09-16T07:54:35.646788+0000","last_became_active":"2024-09-16T07:54:27.217304+0000","last_became_peered":"2024-09-16T07:54:27.217304+0000","last_unstale":"2024-09-16T07:54:35.646788+0000","last_undegraded":"2024-09-16T07:54:35.646788+0000","last_fullsized":"2024-09-16T07:54:35.646788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087985+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:54:27.087985+0000","last_peered":"2024-09-16T07:54:27.087985+0000","last_clean":"2024-09-16T07:54:27.087985+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:54:27.087985+0000","last_undegraded":"2024-09-16T07:54:27.087985+0000","last_fullsized":"2024-09-16T07:54:27.087985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"100'51","reported_seq":63,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.936929+0000","last_change":"2024-09-16T07:54:27.230732+0000","last_active":"2024-09-16T07:54:32.936929+0000","last_peered":"2024-09-16T07:54:32.936929+0000","last_clean":"2024-09-16T07:54:32.936929+0000","last_became_active":"2024-09-16T07:54:27.224955+0000","last_became_peered":"2024-09-16T07:54:27.224955+0000","last_unstale":"2024-09-16T07:54:32.936929+0000","last_undegraded":"2024-09-16T07:54:32.936929+0000","last_fullsized":"2024-09-16T07:54:32.936929+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.060224+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:20.060224+0000","last_peered":"2024-09-16T07:54:20.060224+0000","last_clean":"2024-09-16T07:54:20.060224+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:20.060224+0000","last_undegraded":"2024-09-16T07:54:20.060224+0000","last_fullsized":"2024-09-16T07:54:20.060224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"100'101","reported_seq":113,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.724678+0000","last_change":"2024-09-16T07:54:27.288961+0000","last_active":"2024-09-16T07:54:35.724678+0000","last_peered":"2024-09-16T07:54:35.724678+0000","last_clean":"2024-09-16T07:54:35.724678+0000","last_became_active":"2024-09-16T07:54:27.264185+0000","last_became_peered":"2024-09-16T07:54:27.264185+0000","last_unstale":"2024-09-16T07:54:35.724678+0000","last_undegraded":"2024-09-16T07:54:35.724678+0000","last_fullsized":"2024-09-16T07:54:35.724678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.031002+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:28.031002+0000","last_peered":"2024-09-16T07:54:28.031002+0000","last_clean":"2024-09-16T07:54:28.031002+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:28.031002+0000","last_undegraded":"2024-09-16T07:54:28.031002+0000","last_fullsized":"2024-09-16T07:54:28.031002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"100'84","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.648824+0000","last_change":"2024-09-16T07:54:27.244832+0000","last_active":"2024-09-16T07:54:35.648824+0000","last_peered":"2024-09-16T07:54:35.648824+0000","last_clean":"2024-09-16T07:54:35.648824+0000","last_became_active":"2024-09-16T07:54:27.237065+0000","last_became_peered":"2024-09-16T07:54:27.237065+0000","last_unstale":"2024-09-16T07:54:35.648824+0000","last_undegraded":"2024-09-16T07:54:35.648824+0000","last_fullsized":"2024-09-16T07:54:35.648824+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.024640+0000","last_change":"2024-09-16T07:54:05.026553+0000","last_active":"2024-09-16T07:54:28.024640+0000","last_peered":"2024-09-16T07:54:28.024640+0000","last_clean":"2024-09-16T07:54:28.024640+0000","last_became_active":"2024-09-16T07:54:04.222017+0000","last_became_peered":"2024-09-16T07:54:04.222017+0000","last_unstale":"2024-09-16T07:54:28.024640+0000","last_undegraded":"2024-09-16T07:54:28.024640+0000","last_fullsized":"2024-09-16T07:54:28.024640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092003+0000","last_change":"2024-09-16T07:54:27.094682+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092003+0000","last_undegraded":"2024-09-16T07:54:27.092003+0000","last_fullsized":"2024-09-16T07:54:27.092003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.023386+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:28.023386+0000","last_peered":"2024-09-16T07:54:28.023386+0000","last_clean":"2024-09-16T07:54:28.023386+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:28.023386+0000","last_undegraded":"2024-09-16T07:54:28.023386+0000","last_fullsized":"2024-09-16T07:54:28.023386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087522+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:54:27.087522+0000","last_peered":"2024-09-16T07:54:27.087522+0000","last_clean":"2024-09-16T07:54:27.087522+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:54:27.087522+0000","last_undegraded":"2024-09-16T07:54:27.087522+0000","last_fullsized":"2024-09-16T07:54:27.087522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6975488,"data_stored":111607808,"data_compressed":5298209,"data_compressed_allocated":6975488,"data_compressed_original":111607808,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":39,"acting":39,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41588,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94330252,"statfs":{"total":96636764160,"available":96594178048,"internally_reserved":0,"allocated":3706880,"data_stored":45882681,"data_compressed":2164105,"data_compressed_allocated":2850816,"data_compressed_original":45531136,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41396,"kb_used_data":4388,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94330444,"statfs":{"total":96636764160,"available":96594374656,"internally_reserved":0,"allocated":4493312,"data_stored":58400076,"data_compressed":2758521,"data_compressed_allocated":3633152,"data_compressed_original":58048512,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37044,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":823296,"data_stored":327336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43148,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94328692,"statfs":{"total":96636764160,"available":96592580608,"internally_reserved":0,"allocated":1241088,"data_stored":7067617,"data_compressed":322569,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4104192,"data_stored":65667072,"data_compressed":3117480,"data_compressed_allocated":4104192,"data_compressed_original":65667072,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2871296,"data_stored":45940736,"data_compressed":2180729,"data_compressed_allocated":2871296,"data_compressed_original":45940736,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:42.161 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 14 16 2688 2672 11.9275 11.9375 0.0167241 0.0835259 2024-09-16T07:54:43.075 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:43.162 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 15 16 2881 2865 11.9365 12.0625 0.065757 0.0835576 2024-09-16T07:54:43.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:43.241+0000 7f3943551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:43.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:43.249+0000 7f3943551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:44.162 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 16 16 3072 3056 11.9365 11.9375 0.0708653 0.0835785 2024-09-16T07:54:44.756 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:44.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:44.939+0000 7fb148d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:44.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:44.954+0000 7fb148d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:45.162 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 17 16 3269 3253 11.9585 12.3125 0.0647278 0.0833621 2024-09-16T07:54:45.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:45.248 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:45.272 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":382,"stamp":"2024-09-16T07:54:44.412458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47841832,"num_objects":725,"num_object_clones":0,"num_object_copies":2175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":801,"num_write_kb":47251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":163176,"kb_used_data":10024,"kb_used_omap":0,"kb_used_meta":153088,"kb_avail":377324184,"statfs":{"total":386547056640,"available":386379964416,"internally_reserved":0,"allocated":10264576,"data_stored":111677710,"data_compressed":5245195,"data_compressed_allocated":6909952,"data_compressed_original":110313472,"omap_allocated":0,"internal_metadata":156762112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002485"},"pg_stats":[{"pgid":"6.f","version":"100'113","reported_seq":125,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.600732+0000","last_change":"2024-09-16T07:54:27.190851+0000","last_active":"2024-09-16T07:54:35.600732+0000","last_peered":"2024-09-16T07:54:35.600732+0000","last_clean":"2024-09-16T07:54:35.600732+0000","last_became_active":"2024-09-16T07:54:27.182196+0000","last_became_peered":"2024-09-16T07:54:27.182196+0000","last_unstale":"2024-09-16T07:54:35.600732+0000","last_undegraded":"2024-09-16T07:54:35.600732+0000","last_fullsized":"2024-09-16T07:54:35.600732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092377+0000","last_change":"2024-09-16T07:54:27.093935+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092377+0000","last_undegraded":"2024-09-16T07:54:27.092377+0000","last_fullsized":"2024-09-16T07:54:27.092377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.097446+0000","last_change":"2024-09-16T07:54:27.100163+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.097446+0000","last_undegraded":"2024-09-16T07:54:27.097446+0000","last_fullsized":"2024-09-16T07:54:27.097446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":["1","0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.825541+0000","last_change":"2024-09-16T07:54:27.197656+0000","last_active":"2024-09-16T07:54:32.825541+0000","last_peered":"2024-09-16T07:54:32.825541+0000","last_clean":"2024-09-16T07:54:32.825541+0000","last_became_active":"2024-09-16T07:54:27.186041+0000","last_became_peered":"2024-09-16T07:54:27.186041+0000","last_unstale":"2024-09-16T07:54:32.825541+0000","last_undegraded":"2024-09-16T07:54:32.825541+0000","last_fullsized":"2024-09-16T07:54:32.825541+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.095323+0000","last_change":"2024-09-16T07:54:27.096790+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.095323+0000","last_undegraded":"2024-09-16T07:54:27.095323+0000","last_fullsized":"2024-09-16T07:54:27.095323+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":["1","2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"100'87","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.747482+0000","last_change":"2024-09-16T07:54:27.286418+0000","last_active":"2024-09-16T07:54:35.747482+0000","last_peered":"2024-09-16T07:54:35.747482+0000","last_clean":"2024-09-16T07:54:35.747482+0000","last_became_active":"2024-09-16T07:54:27.270873+0000","last_became_peered":"2024-09-16T07:54:27.270873+0000","last_unstale":"2024-09-16T07:54:35.747482+0000","last_undegraded":"2024-09-16T07:54:35.747482+0000","last_fullsized":"2024-09-16T07:54:35.747482+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.047740+0000","last_change":"2024-09-16T07:54:27.210146+0000","last_active":"2024-09-16T07:54:33.047740+0000","last_peered":"2024-09-16T07:54:33.047740+0000","last_clean":"2024-09-16T07:54:33.047740+0000","last_became_active":"2024-09-16T07:54:27.202101+0000","last_became_peered":"2024-09-16T07:54:27.202101+0000","last_unstale":"2024-09-16T07:54:33.047740+0000","last_undegraded":"2024-09-16T07:54:33.047740+0000","last_fullsized":"2024-09-16T07:54:33.047740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.021677+0000","last_change":"2024-09-16T07:54:04.226137+0000","last_active":"2024-09-16T07:54:28.021677+0000","last_peered":"2024-09-16T07:54:28.021677+0000","last_clean":"2024-09-16T07:54:28.021677+0000","last_became_active":"2024-09-16T07:54:04.213409+0000","last_became_peered":"2024-09-16T07:54:04.213409+0000","last_unstale":"2024-09-16T07:54:28.021677+0000","last_undegraded":"2024-09-16T07:54:28.021677+0000","last_fullsized":"2024-09-16T07:54:28.021677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.096663+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:54:27.096663+0000","last_peered":"2024-09-16T07:54:27.096663+0000","last_clean":"2024-09-16T07:54:27.096663+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:54:27.096663+0000","last_undegraded":"2024-09-16T07:54:27.096663+0000","last_fullsized":"2024-09-16T07:54:27.096663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"100'67","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.114964+0000","last_change":"2024-09-16T07:54:27.267114+0000","last_active":"2024-09-16T07:54:33.114964+0000","last_peered":"2024-09-16T07:54:33.114964+0000","last_clean":"2024-09-16T07:54:33.114964+0000","last_became_active":"2024-09-16T07:54:27.258014+0000","last_became_peered":"2024-09-16T07:54:27.258014+0000","last_unstale":"2024-09-16T07:54:33.114964+0000","last_undegraded":"2024-09-16T07:54:33.114964+0000","last_fullsized":"2024-09-16T07:54:33.114964+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.069932+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:20.069932+0000","last_peered":"2024-09-16T07:54:20.069932+0000","last_clean":"2024-09-16T07:54:20.069932+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:20.069932+0000","last_undegraded":"2024-09-16T07:54:20.069932+0000","last_fullsized":"2024-09-16T07:54:20.069932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"100'92","reported_seq":104,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.646788+0000","last_change":"2024-09-16T07:54:27.222094+0000","last_active":"2024-09-16T07:54:35.646788+0000","last_peered":"2024-09-16T07:54:35.646788+0000","last_clean":"2024-09-16T07:54:35.646788+0000","last_became_active":"2024-09-16T07:54:27.217304+0000","last_became_peered":"2024-09-16T07:54:27.217304+0000","last_unstale":"2024-09-16T07:54:35.646788+0000","last_undegraded":"2024-09-16T07:54:35.646788+0000","last_fullsized":"2024-09-16T07:54:35.646788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087985+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:54:27.087985+0000","last_peered":"2024-09-16T07:54:27.087985+0000","last_clean":"2024-09-16T07:54:27.087985+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:54:27.087985+0000","last_undegraded":"2024-09-16T07:54:27.087985+0000","last_fullsized":"2024-09-16T07:54:27.087985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"100'51","reported_seq":63,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.936929+0000","last_change":"2024-09-16T07:54:27.230732+0000","last_active":"2024-09-16T07:54:32.936929+0000","last_peered":"2024-09-16T07:54:32.936929+0000","last_clean":"2024-09-16T07:54:32.936929+0000","last_became_active":"2024-09-16T07:54:27.224955+0000","last_became_peered":"2024-09-16T07:54:27.224955+0000","last_unstale":"2024-09-16T07:54:32.936929+0000","last_undegraded":"2024-09-16T07:54:32.936929+0000","last_fullsized":"2024-09-16T07:54:32.936929+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.060224+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:20.060224+0000","last_peered":"2024-09-16T07:54:20.060224+0000","last_clean":"2024-09-16T07:54:20.060224+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:20.060224+0000","last_undegraded":"2024-09-16T07:54:20.060224+0000","last_fullsized":"2024-09-16T07:54:20.060224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"100'101","reported_seq":113,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.724678+0000","last_change":"2024-09-16T07:54:27.288961+0000","last_active":"2024-09-16T07:54:35.724678+0000","last_peered":"2024-09-16T07:54:35.724678+0000","last_clean":"2024-09-16T07:54:35.724678+0000","last_became_active":"2024-09-16T07:54:27.264185+0000","last_became_peered":"2024-09-16T07:54:27.264185+0000","last_unstale":"2024-09-16T07:54:35.724678+0000","last_undegraded":"2024-09-16T07:54:35.724678+0000","last_fullsized":"2024-09-16T07:54:35.724678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.031002+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:28.031002+0000","last_peered":"2024-09-16T07:54:28.031002+0000","last_clean":"2024-09-16T07:54:28.031002+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:28.031002+0000","last_undegraded":"2024-09-16T07:54:28.031002+0000","last_fullsized":"2024-09-16T07:54:28.031002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"100'84","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.648824+0000","last_change":"2024-09-16T07:54:27.244832+0000","last_active":"2024-09-16T07:54:35.648824+0000","last_peered":"2024-09-16T07:54:35.648824+0000","last_clean":"2024-09-16T07:54:35.648824+0000","last_became_active":"2024-09-16T07:54:27.237065+0000","last_became_peered":"2024-09-16T07:54:27.237065+0000","last_unstale":"2024-09-16T07:54:35.648824+0000","last_undegraded":"2024-09-16T07:54:35.648824+0000","last_fullsized":"2024-09-16T07:54:35.648824+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.024640+0000","last_change":"2024-09-16T07:54:05.026553+0000","last_active":"2024-09-16T07:54:28.024640+0000","last_peered":"2024-09-16T07:54:28.024640+0000","last_clean":"2024-09-16T07:54:28.024640+0000","last_became_active":"2024-09-16T07:54:04.222017+0000","last_became_peered":"2024-09-16T07:54:04.222017+0000","last_unstale":"2024-09-16T07:54:28.024640+0000","last_undegraded":"2024-09-16T07:54:28.024640+0000","last_fullsized":"2024-09-16T07:54:28.024640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092003+0000","last_change":"2024-09-16T07:54:27.094682+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092003+0000","last_undegraded":"2024-09-16T07:54:27.092003+0000","last_fullsized":"2024-09-16T07:54:27.092003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.023386+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:28.023386+0000","last_peered":"2024-09-16T07:54:28.023386+0000","last_clean":"2024-09-16T07:54:28.023386+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:28.023386+0000","last_undegraded":"2024-09-16T07:54:28.023386+0000","last_fullsized":"2024-09-16T07:54:28.023386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087522+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:54:27.087522+0000","last_peered":"2024-09-16T07:54:27.087522+0000","last_clean":"2024-09-16T07:54:27.087522+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:54:27.087522+0000","last_undegraded":"2024-09-16T07:54:27.087522+0000","last_fullsized":"2024-09-16T07:54:27.087522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6975488,"data_stored":111607808,"data_compressed":5298209,"data_compressed_allocated":6975488,"data_compressed_original":111607808,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":39,"acting":39,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41588,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94330252,"statfs":{"total":96636764160,"available":96594178048,"internally_reserved":0,"allocated":3706880,"data_stored":45882681,"data_compressed":2164105,"data_compressed_allocated":2850816,"data_compressed_original":45531136,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41396,"kb_used_data":4388,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94330444,"statfs":{"total":96636764160,"available":96594374656,"internally_reserved":0,"allocated":4493312,"data_stored":58400076,"data_compressed":2758521,"data_compressed_allocated":3633152,"data_compressed_original":58048512,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37044,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":823296,"data_stored":327336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43148,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94328692,"statfs":{"total":96636764160,"available":96592580608,"internally_reserved":0,"allocated":1241088,"data_stored":7067617,"data_compressed":322569,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4104192,"data_stored":65667072,"data_compressed":3117480,"data_compressed_allocated":4104192,"data_compressed_original":65667072,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2871296,"data_stored":45940736,"data_compressed":2180729,"data_compressed_allocated":2871296,"data_compressed_original":45940736,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:45.274 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:54:45.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:45.424+0000 7fd0d5846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:45.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:45.434+0000 7fd0d5846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:45.538 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:45.690+0000 7f2c9e4fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:45.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:45.700+0000 7f2c9e4fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:45.832 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:45.832 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":587,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":100,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473243,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":18},{"state_name":"creating+activating","count":4},{"state_name":"unknown","count":3}],"num_pgs":25,"num_pools":3,"num_objects":725,"data_bytes":47841832,"bytes_used":167092224,"bytes_avail":386379964416,"bytes_total":386547056640,"unknown_pgs_ratio":0.11999999731779099,"inactive_pgs_ratio":0.15999999642372131,"write_bytes_sec":3936805,"read_op_per_sec":0,"write_op_per_sec":60},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:54:45.847 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:54:45.847 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:46.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:46.006+0000 7f1fcf87f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:46.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:46.022+0000 7f1fcf87f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:46.162 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 18 16 3446 3430 11.9087 11.0625 0.124302 0.0836855 2024-09-16T07:54:46.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:46.319 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:46.337 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":382,"stamp":"2024-09-16T07:54:44.412458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47841832,"num_objects":725,"num_object_clones":0,"num_object_copies":2175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":801,"num_write_kb":47251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":163176,"kb_used_data":10024,"kb_used_omap":0,"kb_used_meta":153088,"kb_avail":377324184,"statfs":{"total":386547056640,"available":386379964416,"internally_reserved":0,"allocated":10264576,"data_stored":111677710,"data_compressed":5245195,"data_compressed_allocated":6909952,"data_compressed_original":110313472,"omap_allocated":0,"internal_metadata":156762112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002485"},"pg_stats":[{"pgid":"6.f","version":"100'113","reported_seq":125,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.600732+0000","last_change":"2024-09-16T07:54:27.190851+0000","last_active":"2024-09-16T07:54:35.600732+0000","last_peered":"2024-09-16T07:54:35.600732+0000","last_clean":"2024-09-16T07:54:35.600732+0000","last_became_active":"2024-09-16T07:54:27.182196+0000","last_became_peered":"2024-09-16T07:54:27.182196+0000","last_unstale":"2024-09-16T07:54:35.600732+0000","last_undegraded":"2024-09-16T07:54:35.600732+0000","last_fullsized":"2024-09-16T07:54:35.600732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092377+0000","last_change":"2024-09-16T07:54:27.093935+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092377+0000","last_undegraded":"2024-09-16T07:54:27.092377+0000","last_fullsized":"2024-09-16T07:54:27.092377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.097446+0000","last_change":"2024-09-16T07:54:27.100163+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.097446+0000","last_undegraded":"2024-09-16T07:54:27.097446+0000","last_fullsized":"2024-09-16T07:54:27.097446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":["1","0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.825541+0000","last_change":"2024-09-16T07:54:27.197656+0000","last_active":"2024-09-16T07:54:32.825541+0000","last_peered":"2024-09-16T07:54:32.825541+0000","last_clean":"2024-09-16T07:54:32.825541+0000","last_became_active":"2024-09-16T07:54:27.186041+0000","last_became_peered":"2024-09-16T07:54:27.186041+0000","last_unstale":"2024-09-16T07:54:32.825541+0000","last_undegraded":"2024-09-16T07:54:32.825541+0000","last_fullsized":"2024-09-16T07:54:32.825541+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.095323+0000","last_change":"2024-09-16T07:54:27.096790+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.095323+0000","last_undegraded":"2024-09-16T07:54:27.095323+0000","last_fullsized":"2024-09-16T07:54:27.095323+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":["1","2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"100'87","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.747482+0000","last_change":"2024-09-16T07:54:27.286418+0000","last_active":"2024-09-16T07:54:35.747482+0000","last_peered":"2024-09-16T07:54:35.747482+0000","last_clean":"2024-09-16T07:54:35.747482+0000","last_became_active":"2024-09-16T07:54:27.270873+0000","last_became_peered":"2024-09-16T07:54:27.270873+0000","last_unstale":"2024-09-16T07:54:35.747482+0000","last_undegraded":"2024-09-16T07:54:35.747482+0000","last_fullsized":"2024-09-16T07:54:35.747482+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.047740+0000","last_change":"2024-09-16T07:54:27.210146+0000","last_active":"2024-09-16T07:54:33.047740+0000","last_peered":"2024-09-16T07:54:33.047740+0000","last_clean":"2024-09-16T07:54:33.047740+0000","last_became_active":"2024-09-16T07:54:27.202101+0000","last_became_peered":"2024-09-16T07:54:27.202101+0000","last_unstale":"2024-09-16T07:54:33.047740+0000","last_undegraded":"2024-09-16T07:54:33.047740+0000","last_fullsized":"2024-09-16T07:54:33.047740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.021677+0000","last_change":"2024-09-16T07:54:04.226137+0000","last_active":"2024-09-16T07:54:28.021677+0000","last_peered":"2024-09-16T07:54:28.021677+0000","last_clean":"2024-09-16T07:54:28.021677+0000","last_became_active":"2024-09-16T07:54:04.213409+0000","last_became_peered":"2024-09-16T07:54:04.213409+0000","last_unstale":"2024-09-16T07:54:28.021677+0000","last_undegraded":"2024-09-16T07:54:28.021677+0000","last_fullsized":"2024-09-16T07:54:28.021677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.096663+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:54:27.096663+0000","last_peered":"2024-09-16T07:54:27.096663+0000","last_clean":"2024-09-16T07:54:27.096663+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:54:27.096663+0000","last_undegraded":"2024-09-16T07:54:27.096663+0000","last_fullsized":"2024-09-16T07:54:27.096663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"100'67","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.114964+0000","last_change":"2024-09-16T07:54:27.267114+0000","last_active":"2024-09-16T07:54:33.114964+0000","last_peered":"2024-09-16T07:54:33.114964+0000","last_clean":"2024-09-16T07:54:33.114964+0000","last_became_active":"2024-09-16T07:54:27.258014+0000","last_became_peered":"2024-09-16T07:54:27.258014+0000","last_unstale":"2024-09-16T07:54:33.114964+0000","last_undegraded":"2024-09-16T07:54:33.114964+0000","last_fullsized":"2024-09-16T07:54:33.114964+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.069932+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:20.069932+0000","last_peered":"2024-09-16T07:54:20.069932+0000","last_clean":"2024-09-16T07:54:20.069932+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:20.069932+0000","last_undegraded":"2024-09-16T07:54:20.069932+0000","last_fullsized":"2024-09-16T07:54:20.069932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"100'92","reported_seq":104,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.646788+0000","last_change":"2024-09-16T07:54:27.222094+0000","last_active":"2024-09-16T07:54:35.646788+0000","last_peered":"2024-09-16T07:54:35.646788+0000","last_clean":"2024-09-16T07:54:35.646788+0000","last_became_active":"2024-09-16T07:54:27.217304+0000","last_became_peered":"2024-09-16T07:54:27.217304+0000","last_unstale":"2024-09-16T07:54:35.646788+0000","last_undegraded":"2024-09-16T07:54:35.646788+0000","last_fullsized":"2024-09-16T07:54:35.646788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087985+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:54:27.087985+0000","last_peered":"2024-09-16T07:54:27.087985+0000","last_clean":"2024-09-16T07:54:27.087985+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:54:27.087985+0000","last_undegraded":"2024-09-16T07:54:27.087985+0000","last_fullsized":"2024-09-16T07:54:27.087985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"100'51","reported_seq":63,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.936929+0000","last_change":"2024-09-16T07:54:27.230732+0000","last_active":"2024-09-16T07:54:32.936929+0000","last_peered":"2024-09-16T07:54:32.936929+0000","last_clean":"2024-09-16T07:54:32.936929+0000","last_became_active":"2024-09-16T07:54:27.224955+0000","last_became_peered":"2024-09-16T07:54:27.224955+0000","last_unstale":"2024-09-16T07:54:32.936929+0000","last_undegraded":"2024-09-16T07:54:32.936929+0000","last_fullsized":"2024-09-16T07:54:32.936929+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.060224+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:20.060224+0000","last_peered":"2024-09-16T07:54:20.060224+0000","last_clean":"2024-09-16T07:54:20.060224+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:20.060224+0000","last_undegraded":"2024-09-16T07:54:20.060224+0000","last_fullsized":"2024-09-16T07:54:20.060224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"100'101","reported_seq":113,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.724678+0000","last_change":"2024-09-16T07:54:27.288961+0000","last_active":"2024-09-16T07:54:35.724678+0000","last_peered":"2024-09-16T07:54:35.724678+0000","last_clean":"2024-09-16T07:54:35.724678+0000","last_became_active":"2024-09-16T07:54:27.264185+0000","last_became_peered":"2024-09-16T07:54:27.264185+0000","last_unstale":"2024-09-16T07:54:35.724678+0000","last_undegraded":"2024-09-16T07:54:35.724678+0000","last_fullsized":"2024-09-16T07:54:35.724678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.031002+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:28.031002+0000","last_peered":"2024-09-16T07:54:28.031002+0000","last_clean":"2024-09-16T07:54:28.031002+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:28.031002+0000","last_undegraded":"2024-09-16T07:54:28.031002+0000","last_fullsized":"2024-09-16T07:54:28.031002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"100'84","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.648824+0000","last_change":"2024-09-16T07:54:27.244832+0000","last_active":"2024-09-16T07:54:35.648824+0000","last_peered":"2024-09-16T07:54:35.648824+0000","last_clean":"2024-09-16T07:54:35.648824+0000","last_became_active":"2024-09-16T07:54:27.237065+0000","last_became_peered":"2024-09-16T07:54:27.237065+0000","last_unstale":"2024-09-16T07:54:35.648824+0000","last_undegraded":"2024-09-16T07:54:35.648824+0000","last_fullsized":"2024-09-16T07:54:35.648824+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.024640+0000","last_change":"2024-09-16T07:54:05.026553+0000","last_active":"2024-09-16T07:54:28.024640+0000","last_peered":"2024-09-16T07:54:28.024640+0000","last_clean":"2024-09-16T07:54:28.024640+0000","last_became_active":"2024-09-16T07:54:04.222017+0000","last_became_peered":"2024-09-16T07:54:04.222017+0000","last_unstale":"2024-09-16T07:54:28.024640+0000","last_undegraded":"2024-09-16T07:54:28.024640+0000","last_fullsized":"2024-09-16T07:54:28.024640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092003+0000","last_change":"2024-09-16T07:54:27.094682+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092003+0000","last_undegraded":"2024-09-16T07:54:27.092003+0000","last_fullsized":"2024-09-16T07:54:27.092003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.023386+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:28.023386+0000","last_peered":"2024-09-16T07:54:28.023386+0000","last_clean":"2024-09-16T07:54:28.023386+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:28.023386+0000","last_undegraded":"2024-09-16T07:54:28.023386+0000","last_fullsized":"2024-09-16T07:54:28.023386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087522+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:54:27.087522+0000","last_peered":"2024-09-16T07:54:27.087522+0000","last_clean":"2024-09-16T07:54:27.087522+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:54:27.087522+0000","last_undegraded":"2024-09-16T07:54:27.087522+0000","last_fullsized":"2024-09-16T07:54:27.087522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6975488,"data_stored":111607808,"data_compressed":5298209,"data_compressed_allocated":6975488,"data_compressed_original":111607808,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":39,"acting":39,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41588,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94330252,"statfs":{"total":96636764160,"available":96594178048,"internally_reserved":0,"allocated":3706880,"data_stored":45882681,"data_compressed":2164105,"data_compressed_allocated":2850816,"data_compressed_original":45531136,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41396,"kb_used_data":4388,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94330444,"statfs":{"total":96636764160,"available":96594374656,"internally_reserved":0,"allocated":4493312,"data_stored":58400076,"data_compressed":2758521,"data_compressed_allocated":3633152,"data_compressed_original":58048512,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37044,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":823296,"data_stored":327336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43148,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94328692,"statfs":{"total":96636764160,"available":96592580608,"internally_reserved":0,"allocated":1241088,"data_stored":7067617,"data_compressed":322569,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4104192,"data_stored":65667072,"data_compressed":3117480,"data_compressed_allocated":4104192,"data_compressed_original":65667072,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2871296,"data_stored":45940736,"data_compressed":2180729,"data_compressed_allocated":2871296,"data_compressed_original":45940736,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:47.162 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 19 16 3647 3631 11.943 12.5625 0.0909577 0.083559 2024-09-16T07:54:48.107 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:48.162 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:54:48.164229+0000 min lat: 0.0164785 max lat: 0.205192 avg lat: 0.0835933 2024-09-16T07:54:48.162 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:54:48.162 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 20 16 3836 3820 11.9365 11.8125 0.040694 0.0835933 2024-09-16T07:54:48.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:48.268+0000 7fcf7d6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:48.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:48.279+0000 7fcf7d6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:49.165 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 21 16 4023 4007 11.9245 11.6875 0.0604253 0.0837049 2024-09-16T07:54:49.339 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:49.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:49.488+0000 7f011789c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:49.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:49.501+0000 7f011789c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:49.865 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:49.866 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:49.880 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-09-16T07:54:48.413222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47841832,"num_objects":725,"num_object_clones":0,"num_object_copies":2175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":801,"num_write_kb":47251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":163176,"kb_used_data":10024,"kb_used_omap":0,"kb_used_meta":153088,"kb_avail":377324184,"statfs":{"total":386547056640,"available":386379964416,"internally_reserved":0,"allocated":10264576,"data_stored":111677710,"data_compressed":5245195,"data_compressed_allocated":6909952,"data_compressed_original":110313472,"omap_allocated":0,"internal_metadata":156762112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002545"},"pg_stats":[{"pgid":"6.f","version":"100'113","reported_seq":125,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.600732+0000","last_change":"2024-09-16T07:54:27.190851+0000","last_active":"2024-09-16T07:54:35.600732+0000","last_peered":"2024-09-16T07:54:35.600732+0000","last_clean":"2024-09-16T07:54:35.600732+0000","last_became_active":"2024-09-16T07:54:27.182196+0000","last_became_peered":"2024-09-16T07:54:27.182196+0000","last_unstale":"2024-09-16T07:54:35.600732+0000","last_undegraded":"2024-09-16T07:54:35.600732+0000","last_fullsized":"2024-09-16T07:54:35.600732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092377+0000","last_change":"2024-09-16T07:54:27.093935+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092377+0000","last_undegraded":"2024-09-16T07:54:27.092377+0000","last_fullsized":"2024-09-16T07:54:27.092377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.097446+0000","last_change":"2024-09-16T07:54:27.100163+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.097446+0000","last_undegraded":"2024-09-16T07:54:27.097446+0000","last_fullsized":"2024-09-16T07:54:27.097446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":["1","0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.825541+0000","last_change":"2024-09-16T07:54:27.197656+0000","last_active":"2024-09-16T07:54:32.825541+0000","last_peered":"2024-09-16T07:54:32.825541+0000","last_clean":"2024-09-16T07:54:32.825541+0000","last_became_active":"2024-09-16T07:54:27.186041+0000","last_became_peered":"2024-09-16T07:54:27.186041+0000","last_unstale":"2024-09-16T07:54:32.825541+0000","last_undegraded":"2024-09-16T07:54:32.825541+0000","last_fullsized":"2024-09-16T07:54:32.825541+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.095323+0000","last_change":"2024-09-16T07:54:27.096790+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.095323+0000","last_undegraded":"2024-09-16T07:54:27.095323+0000","last_fullsized":"2024-09-16T07:54:27.095323+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":["1","2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"100'87","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.747482+0000","last_change":"2024-09-16T07:54:27.286418+0000","last_active":"2024-09-16T07:54:35.747482+0000","last_peered":"2024-09-16T07:54:35.747482+0000","last_clean":"2024-09-16T07:54:35.747482+0000","last_became_active":"2024-09-16T07:54:27.270873+0000","last_became_peered":"2024-09-16T07:54:27.270873+0000","last_unstale":"2024-09-16T07:54:35.747482+0000","last_undegraded":"2024-09-16T07:54:35.747482+0000","last_fullsized":"2024-09-16T07:54:35.747482+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.047740+0000","last_change":"2024-09-16T07:54:27.210146+0000","last_active":"2024-09-16T07:54:33.047740+0000","last_peered":"2024-09-16T07:54:33.047740+0000","last_clean":"2024-09-16T07:54:33.047740+0000","last_became_active":"2024-09-16T07:54:27.202101+0000","last_became_peered":"2024-09-16T07:54:27.202101+0000","last_unstale":"2024-09-16T07:54:33.047740+0000","last_undegraded":"2024-09-16T07:54:33.047740+0000","last_fullsized":"2024-09-16T07:54:33.047740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.021677+0000","last_change":"2024-09-16T07:54:04.226137+0000","last_active":"2024-09-16T07:54:28.021677+0000","last_peered":"2024-09-16T07:54:28.021677+0000","last_clean":"2024-09-16T07:54:28.021677+0000","last_became_active":"2024-09-16T07:54:04.213409+0000","last_became_peered":"2024-09-16T07:54:04.213409+0000","last_unstale":"2024-09-16T07:54:28.021677+0000","last_undegraded":"2024-09-16T07:54:28.021677+0000","last_fullsized":"2024-09-16T07:54:28.021677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.096663+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:54:27.096663+0000","last_peered":"2024-09-16T07:54:27.096663+0000","last_clean":"2024-09-16T07:54:27.096663+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:54:27.096663+0000","last_undegraded":"2024-09-16T07:54:27.096663+0000","last_fullsized":"2024-09-16T07:54:27.096663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"100'67","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.114964+0000","last_change":"2024-09-16T07:54:27.267114+0000","last_active":"2024-09-16T07:54:33.114964+0000","last_peered":"2024-09-16T07:54:33.114964+0000","last_clean":"2024-09-16T07:54:33.114964+0000","last_became_active":"2024-09-16T07:54:27.258014+0000","last_became_peered":"2024-09-16T07:54:27.258014+0000","last_unstale":"2024-09-16T07:54:33.114964+0000","last_undegraded":"2024-09-16T07:54:33.114964+0000","last_fullsized":"2024-09-16T07:54:33.114964+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.069932+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:20.069932+0000","last_peered":"2024-09-16T07:54:20.069932+0000","last_clean":"2024-09-16T07:54:20.069932+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:20.069932+0000","last_undegraded":"2024-09-16T07:54:20.069932+0000","last_fullsized":"2024-09-16T07:54:20.069932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"100'92","reported_seq":104,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.646788+0000","last_change":"2024-09-16T07:54:27.222094+0000","last_active":"2024-09-16T07:54:35.646788+0000","last_peered":"2024-09-16T07:54:35.646788+0000","last_clean":"2024-09-16T07:54:35.646788+0000","last_became_active":"2024-09-16T07:54:27.217304+0000","last_became_peered":"2024-09-16T07:54:27.217304+0000","last_unstale":"2024-09-16T07:54:35.646788+0000","last_undegraded":"2024-09-16T07:54:35.646788+0000","last_fullsized":"2024-09-16T07:54:35.646788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087985+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:54:27.087985+0000","last_peered":"2024-09-16T07:54:27.087985+0000","last_clean":"2024-09-16T07:54:27.087985+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:54:27.087985+0000","last_undegraded":"2024-09-16T07:54:27.087985+0000","last_fullsized":"2024-09-16T07:54:27.087985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"100'51","reported_seq":63,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.936929+0000","last_change":"2024-09-16T07:54:27.230732+0000","last_active":"2024-09-16T07:54:32.936929+0000","last_peered":"2024-09-16T07:54:32.936929+0000","last_clean":"2024-09-16T07:54:32.936929+0000","last_became_active":"2024-09-16T07:54:27.224955+0000","last_became_peered":"2024-09-16T07:54:27.224955+0000","last_unstale":"2024-09-16T07:54:32.936929+0000","last_undegraded":"2024-09-16T07:54:32.936929+0000","last_fullsized":"2024-09-16T07:54:32.936929+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.060224+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:20.060224+0000","last_peered":"2024-09-16T07:54:20.060224+0000","last_clean":"2024-09-16T07:54:20.060224+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:20.060224+0000","last_undegraded":"2024-09-16T07:54:20.060224+0000","last_fullsized":"2024-09-16T07:54:20.060224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"100'101","reported_seq":113,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.724678+0000","last_change":"2024-09-16T07:54:27.288961+0000","last_active":"2024-09-16T07:54:35.724678+0000","last_peered":"2024-09-16T07:54:35.724678+0000","last_clean":"2024-09-16T07:54:35.724678+0000","last_became_active":"2024-09-16T07:54:27.264185+0000","last_became_peered":"2024-09-16T07:54:27.264185+0000","last_unstale":"2024-09-16T07:54:35.724678+0000","last_undegraded":"2024-09-16T07:54:35.724678+0000","last_fullsized":"2024-09-16T07:54:35.724678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.031002+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:28.031002+0000","last_peered":"2024-09-16T07:54:28.031002+0000","last_clean":"2024-09-16T07:54:28.031002+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:28.031002+0000","last_undegraded":"2024-09-16T07:54:28.031002+0000","last_fullsized":"2024-09-16T07:54:28.031002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"100'84","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.648824+0000","last_change":"2024-09-16T07:54:27.244832+0000","last_active":"2024-09-16T07:54:35.648824+0000","last_peered":"2024-09-16T07:54:35.648824+0000","last_clean":"2024-09-16T07:54:35.648824+0000","last_became_active":"2024-09-16T07:54:27.237065+0000","last_became_peered":"2024-09-16T07:54:27.237065+0000","last_unstale":"2024-09-16T07:54:35.648824+0000","last_undegraded":"2024-09-16T07:54:35.648824+0000","last_fullsized":"2024-09-16T07:54:35.648824+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.024640+0000","last_change":"2024-09-16T07:54:05.026553+0000","last_active":"2024-09-16T07:54:28.024640+0000","last_peered":"2024-09-16T07:54:28.024640+0000","last_clean":"2024-09-16T07:54:28.024640+0000","last_became_active":"2024-09-16T07:54:04.222017+0000","last_became_peered":"2024-09-16T07:54:04.222017+0000","last_unstale":"2024-09-16T07:54:28.024640+0000","last_undegraded":"2024-09-16T07:54:28.024640+0000","last_fullsized":"2024-09-16T07:54:28.024640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092003+0000","last_change":"2024-09-16T07:54:27.094682+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092003+0000","last_undegraded":"2024-09-16T07:54:27.092003+0000","last_fullsized":"2024-09-16T07:54:27.092003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.023386+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:28.023386+0000","last_peered":"2024-09-16T07:54:28.023386+0000","last_clean":"2024-09-16T07:54:28.023386+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:28.023386+0000","last_undegraded":"2024-09-16T07:54:28.023386+0000","last_fullsized":"2024-09-16T07:54:28.023386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087522+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:54:27.087522+0000","last_peered":"2024-09-16T07:54:27.087522+0000","last_clean":"2024-09-16T07:54:27.087522+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:54:27.087522+0000","last_undegraded":"2024-09-16T07:54:27.087522+0000","last_fullsized":"2024-09-16T07:54:27.087522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6975488,"data_stored":111607808,"data_compressed":5298209,"data_compressed_allocated":6975488,"data_compressed_original":111607808,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":39,"acting":39,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41588,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94330252,"statfs":{"total":96636764160,"available":96594178048,"internally_reserved":0,"allocated":3706880,"data_stored":45882681,"data_compressed":2164105,"data_compressed_allocated":2850816,"data_compressed_original":45531136,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41396,"kb_used_data":4388,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94330444,"statfs":{"total":96636764160,"available":96594374656,"internally_reserved":0,"allocated":4493312,"data_stored":58400076,"data_compressed":2758521,"data_compressed_allocated":3633152,"data_compressed_original":58048512,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37044,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":823296,"data_stored":327336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43148,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94328692,"statfs":{"total":96636764160,"available":96592580608,"internally_reserved":0,"allocated":1241088,"data_stored":7067617,"data_compressed":322569,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4104192,"data_stored":65667072,"data_compressed":3117480,"data_compressed_allocated":4104192,"data_compressed_original":65667072,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2871296,"data_stored":45940736,"data_compressed":2180729,"data_compressed_allocated":2871296,"data_compressed_original":45940736,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:49.882 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:54:50.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:50.043+0000 7f375205a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:50.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:50.052+0000 7f375205a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:50.162 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 22 16 4206 4190 11.9023 11.4375 0.084607 0.0838032 2024-09-16T07:54:50.436 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:50.436 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":592,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":100,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473243,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":18},{"state_name":"creating+activating","count":4},{"state_name":"unknown","count":3}],"num_pgs":25,"num_pools":3,"num_objects":725,"data_bytes":47841832,"bytes_used":167092224,"bytes_avail":386379964416,"bytes_total":386547056640,"unknown_pgs_ratio":0.11999999731779099,"inactive_pgs_ratio":0.15999999642372131},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:54:50.456 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:54:50.456 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:50.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:50.627+0000 7fa31ff11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:50.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:50.642+0000 7fa31ff11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:50.649 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:50.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:50.819+0000 7fc8d0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:50.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:50.830+0000 7fc8d0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:50.956 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:50.956 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:50.974 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":385,"stamp":"2024-09-16T07:54:50.413680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47841832,"num_objects":725,"num_object_clones":0,"num_object_copies":2175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":801,"num_write_kb":47251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":776,"ondisk_log_size":776,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":163176,"kb_used_data":10024,"kb_used_omap":0,"kb_used_meta":153088,"kb_avail":377324184,"statfs":{"total":386547056640,"available":386379964416,"internally_reserved":0,"allocated":10264576,"data_stored":111677710,"data_compressed":5245195,"data_compressed_allocated":6909952,"data_compressed_original":110313472,"omap_allocated":0,"internal_metadata":156762112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002568"},"pg_stats":[{"pgid":"6.f","version":"100'113","reported_seq":125,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.600732+0000","last_change":"2024-09-16T07:54:27.190851+0000","last_active":"2024-09-16T07:54:35.600732+0000","last_peered":"2024-09-16T07:54:35.600732+0000","last_clean":"2024-09-16T07:54:35.600732+0000","last_became_active":"2024-09-16T07:54:27.182196+0000","last_became_peered":"2024-09-16T07:54:27.182196+0000","last_unstale":"2024-09-16T07:54:35.600732+0000","last_undegraded":"2024-09-16T07:54:35.600732+0000","last_fullsized":"2024-09-16T07:54:35.600732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092377+0000","last_change":"2024-09-16T07:54:27.093935+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092377+0000","last_undegraded":"2024-09-16T07:54:27.092377+0000","last_fullsized":"2024-09-16T07:54:27.092377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.097446+0000","last_change":"2024-09-16T07:54:27.100163+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.097446+0000","last_undegraded":"2024-09-16T07:54:27.097446+0000","last_fullsized":"2024-09-16T07:54:27.097446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":["1","0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.825541+0000","last_change":"2024-09-16T07:54:27.197656+0000","last_active":"2024-09-16T07:54:32.825541+0000","last_peered":"2024-09-16T07:54:32.825541+0000","last_clean":"2024-09-16T07:54:32.825541+0000","last_became_active":"2024-09-16T07:54:27.186041+0000","last_became_peered":"2024-09-16T07:54:27.186041+0000","last_unstale":"2024-09-16T07:54:32.825541+0000","last_undegraded":"2024-09-16T07:54:32.825541+0000","last_fullsized":"2024-09-16T07:54:32.825541+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.095323+0000","last_change":"2024-09-16T07:54:27.096790+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.095323+0000","last_undegraded":"2024-09-16T07:54:27.095323+0000","last_fullsized":"2024-09-16T07:54:27.095323+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":["1","2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"100'87","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.747482+0000","last_change":"2024-09-16T07:54:27.286418+0000","last_active":"2024-09-16T07:54:35.747482+0000","last_peered":"2024-09-16T07:54:35.747482+0000","last_clean":"2024-09-16T07:54:35.747482+0000","last_became_active":"2024-09-16T07:54:27.270873+0000","last_became_peered":"2024-09-16T07:54:27.270873+0000","last_unstale":"2024-09-16T07:54:35.747482+0000","last_undegraded":"2024-09-16T07:54:35.747482+0000","last_fullsized":"2024-09-16T07:54:35.747482+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.047740+0000","last_change":"2024-09-16T07:54:27.210146+0000","last_active":"2024-09-16T07:54:33.047740+0000","last_peered":"2024-09-16T07:54:33.047740+0000","last_clean":"2024-09-16T07:54:33.047740+0000","last_became_active":"2024-09-16T07:54:27.202101+0000","last_became_peered":"2024-09-16T07:54:27.202101+0000","last_unstale":"2024-09-16T07:54:33.047740+0000","last_undegraded":"2024-09-16T07:54:33.047740+0000","last_fullsized":"2024-09-16T07:54:33.047740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.021677+0000","last_change":"2024-09-16T07:54:04.226137+0000","last_active":"2024-09-16T07:54:28.021677+0000","last_peered":"2024-09-16T07:54:28.021677+0000","last_clean":"2024-09-16T07:54:28.021677+0000","last_became_active":"2024-09-16T07:54:04.213409+0000","last_became_peered":"2024-09-16T07:54:04.213409+0000","last_unstale":"2024-09-16T07:54:28.021677+0000","last_undegraded":"2024-09-16T07:54:28.021677+0000","last_fullsized":"2024-09-16T07:54:28.021677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.096663+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:54:27.096663+0000","last_peered":"2024-09-16T07:54:27.096663+0000","last_clean":"2024-09-16T07:54:27.096663+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:54:27.096663+0000","last_undegraded":"2024-09-16T07:54:27.096663+0000","last_fullsized":"2024-09-16T07:54:27.096663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"100'67","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.114964+0000","last_change":"2024-09-16T07:54:27.267114+0000","last_active":"2024-09-16T07:54:33.114964+0000","last_peered":"2024-09-16T07:54:33.114964+0000","last_clean":"2024-09-16T07:54:33.114964+0000","last_became_active":"2024-09-16T07:54:27.258014+0000","last_became_peered":"2024-09-16T07:54:27.258014+0000","last_unstale":"2024-09-16T07:54:33.114964+0000","last_undegraded":"2024-09-16T07:54:33.114964+0000","last_fullsized":"2024-09-16T07:54:33.114964+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.069932+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:20.069932+0000","last_peered":"2024-09-16T07:54:20.069932+0000","last_clean":"2024-09-16T07:54:20.069932+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:20.069932+0000","last_undegraded":"2024-09-16T07:54:20.069932+0000","last_fullsized":"2024-09-16T07:54:20.069932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"100'92","reported_seq":104,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.646788+0000","last_change":"2024-09-16T07:54:27.222094+0000","last_active":"2024-09-16T07:54:35.646788+0000","last_peered":"2024-09-16T07:54:35.646788+0000","last_clean":"2024-09-16T07:54:35.646788+0000","last_became_active":"2024-09-16T07:54:27.217304+0000","last_became_peered":"2024-09-16T07:54:27.217304+0000","last_unstale":"2024-09-16T07:54:35.646788+0000","last_undegraded":"2024-09-16T07:54:35.646788+0000","last_fullsized":"2024-09-16T07:54:35.646788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087985+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:54:27.087985+0000","last_peered":"2024-09-16T07:54:27.087985+0000","last_clean":"2024-09-16T07:54:27.087985+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:54:27.087985+0000","last_undegraded":"2024-09-16T07:54:27.087985+0000","last_fullsized":"2024-09-16T07:54:27.087985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"100'51","reported_seq":63,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.936929+0000","last_change":"2024-09-16T07:54:27.230732+0000","last_active":"2024-09-16T07:54:32.936929+0000","last_peered":"2024-09-16T07:54:32.936929+0000","last_clean":"2024-09-16T07:54:32.936929+0000","last_became_active":"2024-09-16T07:54:27.224955+0000","last_became_peered":"2024-09-16T07:54:27.224955+0000","last_unstale":"2024-09-16T07:54:32.936929+0000","last_undegraded":"2024-09-16T07:54:32.936929+0000","last_fullsized":"2024-09-16T07:54:32.936929+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-16T07:54:20.060224+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:20.060224+0000","last_peered":"2024-09-16T07:54:20.060224+0000","last_clean":"2024-09-16T07:54:20.060224+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:20.060224+0000","last_undegraded":"2024-09-16T07:54:20.060224+0000","last_fullsized":"2024-09-16T07:54:20.060224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"100'101","reported_seq":113,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.724678+0000","last_change":"2024-09-16T07:54:27.288961+0000","last_active":"2024-09-16T07:54:35.724678+0000","last_peered":"2024-09-16T07:54:35.724678+0000","last_clean":"2024-09-16T07:54:35.724678+0000","last_became_active":"2024-09-16T07:54:27.264185+0000","last_became_peered":"2024-09-16T07:54:27.264185+0000","last_unstale":"2024-09-16T07:54:35.724678+0000","last_undegraded":"2024-09-16T07:54:35.724678+0000","last_fullsized":"2024-09-16T07:54:35.724678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.031002+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:28.031002+0000","last_peered":"2024-09-16T07:54:28.031002+0000","last_clean":"2024-09-16T07:54:28.031002+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:28.031002+0000","last_undegraded":"2024-09-16T07:54:28.031002+0000","last_fullsized":"2024-09-16T07:54:28.031002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"100'84","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.648824+0000","last_change":"2024-09-16T07:54:27.244832+0000","last_active":"2024-09-16T07:54:35.648824+0000","last_peered":"2024-09-16T07:54:35.648824+0000","last_clean":"2024-09-16T07:54:35.648824+0000","last_became_active":"2024-09-16T07:54:27.237065+0000","last_became_peered":"2024-09-16T07:54:27.237065+0000","last_unstale":"2024-09-16T07:54:35.648824+0000","last_undegraded":"2024-09-16T07:54:35.648824+0000","last_fullsized":"2024-09-16T07:54:35.648824+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.024640+0000","last_change":"2024-09-16T07:54:05.026553+0000","last_active":"2024-09-16T07:54:28.024640+0000","last_peered":"2024-09-16T07:54:28.024640+0000","last_clean":"2024-09-16T07:54:28.024640+0000","last_became_active":"2024-09-16T07:54:04.222017+0000","last_became_peered":"2024-09-16T07:54:04.222017+0000","last_unstale":"2024-09-16T07:54:28.024640+0000","last_undegraded":"2024-09-16T07:54:28.024640+0000","last_fullsized":"2024-09-16T07:54:28.024640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092003+0000","last_change":"2024-09-16T07:54:27.094682+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092003+0000","last_undegraded":"2024-09-16T07:54:27.092003+0000","last_fullsized":"2024-09-16T07:54:27.092003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.023386+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:28.023386+0000","last_peered":"2024-09-16T07:54:28.023386+0000","last_clean":"2024-09-16T07:54:28.023386+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:28.023386+0000","last_undegraded":"2024-09-16T07:54:28.023386+0000","last_fullsized":"2024-09-16T07:54:28.023386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:54:26.065928+0000","last_change":"2024-09-16T07:54:26.065928+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:26.065928+0000","last_undegraded":"2024-09-16T07:54:26.065928+0000","last_fullsized":"2024-09-16T07:54:26.065928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087522+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:54:27.087522+0000","last_peered":"2024-09-16T07:54:27.087522+0000","last_clean":"2024-09-16T07:54:27.087522+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:54:27.087522+0000","last_undegraded":"2024-09-16T07:54:27.087522+0000","last_fullsized":"2024-09-16T07:54:27.087522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6975488,"data_stored":111607808,"data_compressed":5298209,"data_compressed_allocated":6975488,"data_compressed_original":111607808,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":39,"acting":39,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41588,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94330252,"statfs":{"total":96636764160,"available":96594178048,"internally_reserved":0,"allocated":3706880,"data_stored":45882681,"data_compressed":2164105,"data_compressed_allocated":2850816,"data_compressed_original":45531136,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41396,"kb_used_data":4388,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94330444,"statfs":{"total":96636764160,"available":96594374656,"internally_reserved":0,"allocated":4493312,"data_stored":58400076,"data_compressed":2758521,"data_compressed_allocated":3633152,"data_compressed_original":58048512,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37044,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":823296,"data_stored":327336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43148,"kb_used_data":1212,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94328692,"statfs":{"total":96636764160,"available":96592580608,"internally_reserved":0,"allocated":1241088,"data_stored":7067617,"data_compressed":322569,"data_compressed_allocated":425984,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4104192,"data_stored":65667072,"data_compressed":3117480,"data_compressed_allocated":4104192,"data_compressed_original":65667072,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2871296,"data_stored":45940736,"data_compressed":2180729,"data_compressed_allocated":2871296,"data_compressed_original":45940736,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:51.163 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 23 16 4380 4364 11.8576 10.875 0.0212623 0.0841046 2024-09-16T07:54:52.162 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 24 16 4564 4548 11.8427 11.5 0.0997788 0.0843015 2024-09-16T07:54:53.162 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 25 16 4747 4731 11.8264 11.4375 0.0528763 0.0844272 2024-09-16T07:54:53.218 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:53.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:53.375+0000 7f8e37d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:53.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:53.383+0000 7f8e37d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:53.976 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:54.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:54.135+0000 7f99abf08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:54.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:54.150+0000 7f99abf08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:54.162 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 26 16 4935 4919 11.8235 11.75 0.038784 0.0843762 2024-09-16T07:54:54.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:54.426 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:54.447 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2024-09-16T07:54:54.414385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":99877416,"num_objects":1519,"num_object_clones":0,"num_object_copies":4557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1595,"num_write_kb":98067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1570,"ondisk_log_size":1570,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":176652,"kb_used_data":23500,"kb_used_omap":0,"kb_used_meta":153088,"kb_avail":377310708,"statfs":{"total":386547056640,"available":386366164992,"internally_reserved":0,"allocated":24064000,"data_stored":331765369,"data_compressed":15694399,"data_compressed_allocated":20664320,"data_compressed_original":330383360,"omap_allocated":0,"internal_metadata":156762112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":52035584,"num_objects":794,"num_object_clones":0,"num_object_copies":2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":794,"num_write_kb":50816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002364"},"pg_stats":[{"pgid":"6.f","version":"100'113","reported_seq":125,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.600732+0000","last_change":"2024-09-16T07:54:27.190851+0000","last_active":"2024-09-16T07:54:35.600732+0000","last_peered":"2024-09-16T07:54:35.600732+0000","last_clean":"2024-09-16T07:54:35.600732+0000","last_became_active":"2024-09-16T07:54:27.182196+0000","last_became_peered":"2024-09-16T07:54:27.182196+0000","last_unstale":"2024-09-16T07:54:35.600732+0000","last_undegraded":"2024-09-16T07:54:35.600732+0000","last_fullsized":"2024-09-16T07:54:35.600732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092377+0000","last_change":"2024-09-16T07:54:27.093935+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092377+0000","last_undegraded":"2024-09-16T07:54:27.092377+0000","last_fullsized":"2024-09-16T07:54:27.092377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.097446+0000","last_change":"2024-09-16T07:54:27.100163+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.097446+0000","last_undegraded":"2024-09-16T07:54:27.097446+0000","last_fullsized":"2024-09-16T07:54:27.097446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":["1","0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.825541+0000","last_change":"2024-09-16T07:54:27.197656+0000","last_active":"2024-09-16T07:54:32.825541+0000","last_peered":"2024-09-16T07:54:32.825541+0000","last_clean":"2024-09-16T07:54:32.825541+0000","last_became_active":"2024-09-16T07:54:27.186041+0000","last_became_peered":"2024-09-16T07:54:27.186041+0000","last_unstale":"2024-09-16T07:54:32.825541+0000","last_undegraded":"2024-09-16T07:54:32.825541+0000","last_fullsized":"2024-09-16T07:54:32.825541+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.095323+0000","last_change":"2024-09-16T07:54:27.096790+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.095323+0000","last_undegraded":"2024-09-16T07:54:27.095323+0000","last_fullsized":"2024-09-16T07:54:27.095323+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":["1","2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"100'87","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.747482+0000","last_change":"2024-09-16T07:54:27.286418+0000","last_active":"2024-09-16T07:54:35.747482+0000","last_peered":"2024-09-16T07:54:35.747482+0000","last_clean":"2024-09-16T07:54:35.747482+0000","last_became_active":"2024-09-16T07:54:27.270873+0000","last_became_peered":"2024-09-16T07:54:27.270873+0000","last_unstale":"2024-09-16T07:54:35.747482+0000","last_undegraded":"2024-09-16T07:54:35.747482+0000","last_fullsized":"2024-09-16T07:54:35.747482+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.047740+0000","last_change":"2024-09-16T07:54:27.210146+0000","last_active":"2024-09-16T07:54:33.047740+0000","last_peered":"2024-09-16T07:54:33.047740+0000","last_clean":"2024-09-16T07:54:33.047740+0000","last_became_active":"2024-09-16T07:54:27.202101+0000","last_became_peered":"2024-09-16T07:54:27.202101+0000","last_unstale":"2024-09-16T07:54:33.047740+0000","last_undegraded":"2024-09-16T07:54:33.047740+0000","last_fullsized":"2024-09-16T07:54:33.047740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"100'251","reported_seq":263,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:50.475272+0000","last_change":"2024-09-16T07:54:27.256819+0000","last_active":"2024-09-16T07:54:50.475272+0000","last_peered":"2024-09-16T07:54:50.475272+0000","last_clean":"2024-09-16T07:54:50.475272+0000","last_became_active":"2024-09-16T07:54:27.243741+0000","last_became_peered":"2024-09-16T07:54:27.243741+0000","last_unstale":"2024-09-16T07:54:50.475272+0000","last_undegraded":"2024-09-16T07:54:50.475272+0000","last_fullsized":"2024-09-16T07:54:50.475272+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":16064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"100'259","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:50.505728+0000","last_change":"2024-09-16T07:54:27.295100+0000","last_active":"2024-09-16T07:54:50.505728+0000","last_peered":"2024-09-16T07:54:50.505728+0000","last_clean":"2024-09-16T07:54:50.505728+0000","last_became_active":"2024-09-16T07:54:27.279086+0000","last_became_peered":"2024-09-16T07:54:27.279086+0000","last_unstale":"2024-09-16T07:54:50.505728+0000","last_undegraded":"2024-09-16T07:54:50.505728+0000","last_fullsized":"2024-09-16T07:54:50.505728+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":16576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.021677+0000","last_change":"2024-09-16T07:54:04.226137+0000","last_active":"2024-09-16T07:54:28.021677+0000","last_peered":"2024-09-16T07:54:28.021677+0000","last_clean":"2024-09-16T07:54:28.021677+0000","last_became_active":"2024-09-16T07:54:04.213409+0000","last_became_peered":"2024-09-16T07:54:04.213409+0000","last_unstale":"2024-09-16T07:54:28.021677+0000","last_undegraded":"2024-09-16T07:54:28.021677+0000","last_fullsized":"2024-09-16T07:54:28.021677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.096663+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:54:27.096663+0000","last_peered":"2024-09-16T07:54:27.096663+0000","last_clean":"2024-09-16T07:54:27.096663+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:54:27.096663+0000","last_undegraded":"2024-09-16T07:54:27.096663+0000","last_fullsized":"2024-09-16T07:54:27.096663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"100'67","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.114964+0000","last_change":"2024-09-16T07:54:27.267114+0000","last_active":"2024-09-16T07:54:33.114964+0000","last_peered":"2024-09-16T07:54:33.114964+0000","last_clean":"2024-09-16T07:54:33.114964+0000","last_became_active":"2024-09-16T07:54:27.258014+0000","last_became_peered":"2024-09-16T07:54:27.258014+0000","last_unstale":"2024-09-16T07:54:33.114964+0000","last_undegraded":"2024-09-16T07:54:33.114964+0000","last_fullsized":"2024-09-16T07:54:33.114964+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.022639+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:28.022639+0000","last_peered":"2024-09-16T07:54:28.022639+0000","last_clean":"2024-09-16T07:54:28.022639+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:28.022639+0000","last_undegraded":"2024-09-16T07:54:28.022639+0000","last_fullsized":"2024-09-16T07:54:28.022639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"100'92","reported_seq":104,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.646788+0000","last_change":"2024-09-16T07:54:27.222094+0000","last_active":"2024-09-16T07:54:35.646788+0000","last_peered":"2024-09-16T07:54:35.646788+0000","last_clean":"2024-09-16T07:54:35.646788+0000","last_became_active":"2024-09-16T07:54:27.217304+0000","last_became_peered":"2024-09-16T07:54:27.217304+0000","last_unstale":"2024-09-16T07:54:35.646788+0000","last_undegraded":"2024-09-16T07:54:35.646788+0000","last_fullsized":"2024-09-16T07:54:35.646788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087985+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:54:27.087985+0000","last_peered":"2024-09-16T07:54:27.087985+0000","last_clean":"2024-09-16T07:54:27.087985+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:54:27.087985+0000","last_undegraded":"2024-09-16T07:54:27.087985+0000","last_fullsized":"2024-09-16T07:54:27.087985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"100'51","reported_seq":63,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.936929+0000","last_change":"2024-09-16T07:54:27.230732+0000","last_active":"2024-09-16T07:54:32.936929+0000","last_peered":"2024-09-16T07:54:32.936929+0000","last_clean":"2024-09-16T07:54:32.936929+0000","last_became_active":"2024-09-16T07:54:27.224955+0000","last_became_peered":"2024-09-16T07:54:27.224955+0000","last_unstale":"2024-09-16T07:54:32.936929+0000","last_undegraded":"2024-09-16T07:54:32.936929+0000","last_fullsized":"2024-09-16T07:54:32.936929+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":180,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.028338+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:28.028338+0000","last_peered":"2024-09-16T07:54:28.028338+0000","last_clean":"2024-09-16T07:54:28.028338+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:28.028338+0000","last_undegraded":"2024-09-16T07:54:28.028338+0000","last_fullsized":"2024-09-16T07:54:28.028338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"100'101","reported_seq":113,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.724678+0000","last_change":"2024-09-16T07:54:27.288961+0000","last_active":"2024-09-16T07:54:35.724678+0000","last_peered":"2024-09-16T07:54:35.724678+0000","last_clean":"2024-09-16T07:54:35.724678+0000","last_became_active":"2024-09-16T07:54:27.264185+0000","last_became_peered":"2024-09-16T07:54:27.264185+0000","last_unstale":"2024-09-16T07:54:35.724678+0000","last_undegraded":"2024-09-16T07:54:35.724678+0000","last_fullsized":"2024-09-16T07:54:35.724678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.031002+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:28.031002+0000","last_peered":"2024-09-16T07:54:28.031002+0000","last_clean":"2024-09-16T07:54:28.031002+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:28.031002+0000","last_undegraded":"2024-09-16T07:54:28.031002+0000","last_fullsized":"2024-09-16T07:54:28.031002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"100'84","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.648824+0000","last_change":"2024-09-16T07:54:27.244832+0000","last_active":"2024-09-16T07:54:35.648824+0000","last_peered":"2024-09-16T07:54:35.648824+0000","last_clean":"2024-09-16T07:54:35.648824+0000","last_became_active":"2024-09-16T07:54:27.237065+0000","last_became_peered":"2024-09-16T07:54:27.237065+0000","last_unstale":"2024-09-16T07:54:35.648824+0000","last_undegraded":"2024-09-16T07:54:35.648824+0000","last_fullsized":"2024-09-16T07:54:35.648824+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.024640+0000","last_change":"2024-09-16T07:54:05.026553+0000","last_active":"2024-09-16T07:54:28.024640+0000","last_peered":"2024-09-16T07:54:28.024640+0000","last_clean":"2024-09-16T07:54:28.024640+0000","last_became_active":"2024-09-16T07:54:04.222017+0000","last_became_peered":"2024-09-16T07:54:04.222017+0000","last_unstale":"2024-09-16T07:54:28.024640+0000","last_undegraded":"2024-09-16T07:54:28.024640+0000","last_fullsized":"2024-09-16T07:54:28.024640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092003+0000","last_change":"2024-09-16T07:54:27.094682+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092003+0000","last_undegraded":"2024-09-16T07:54:27.092003+0000","last_fullsized":"2024-09-16T07:54:27.092003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.023386+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:28.023386+0000","last_peered":"2024-09-16T07:54:28.023386+0000","last_clean":"2024-09-16T07:54:28.023386+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:28.023386+0000","last_undegraded":"2024-09-16T07:54:28.023386+0000","last_fullsized":"2024-09-16T07:54:28.023386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"100'284","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:50.385644+0000","last_change":"2024-09-16T07:54:27.314798+0000","last_active":"2024-09-16T07:54:50.385644+0000","last_peered":"2024-09-16T07:54:50.385644+0000","last_clean":"2024-09-16T07:54:50.385644+0000","last_became_active":"2024-09-16T07:54:27.306364+0000","last_became_peered":"2024-09-16T07:54:27.306364+0000","last_unstale":"2024-09-16T07:54:50.385644+0000","last_undegraded":"2024-09-16T07:54:50.385644+0000","last_fullsized":"2024-09-16T07:54:50.385644+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18612224,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":284,"num_write_kb":18176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087522+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:54:27.087522+0000","last_peered":"2024-09-16T07:54:27.087522+0000","last_clean":"2024-09-16T07:54:27.087522+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:54:27.087522+0000","last_undegraded":"2024-09-16T07:54:27.087522+0000","last_fullsized":"2024-09-16T07:54:27.087522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":99287040,"num_objects":1515,"num_object_clones":0,"num_object_copies":4545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1515,"num_write_kb":96960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21172224,"data_stored":338755584,"data_compressed":16083509,"data_compressed_allocated":21172224,"data_compressed_original":338755584,"omap_allocated":0,"internal_metadata":0},"log_size":1515,"ondisk_log_size":1515,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41588,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94330252,"statfs":{"total":96636764160,"available":96594178048,"internally_reserved":0,"allocated":3706880,"data_stored":45882681,"data_compressed":2164105,"data_compressed_allocated":2850816,"data_compressed_original":45531136,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41396,"kb_used_data":4388,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94330444,"statfs":{"total":96636764160,"available":96594374656,"internally_reserved":0,"allocated":4493312,"data_stored":58400076,"data_compressed":2758521,"data_compressed_allocated":3633152,"data_compressed_original":58048512,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37044,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":823296,"data_stored":327336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56624,"kb_used_data":14688,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94315216,"statfs":{"total":96636764160,"available":96578781184,"internally_reserved":0,"allocated":15040512,"data_stored":227155276,"data_compressed":10771773,"data_compressed_allocated":14180352,"data_compressed_original":226803712,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14196736,"data_stored":227147776,"data_compressed":10785300,"data_compressed_allocated":14196736,"data_compressed_original":227147776,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4104192,"data_stored":65667072,"data_compressed":3117480,"data_compressed_allocated":4104192,"data_compressed_original":65667072,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2871296,"data_stored":45940736,"data_compressed":2180729,"data_compressed_allocated":2871296,"data_compressed_original":45940736,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:54.449 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:54:54.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:54.607+0000 7fc9642ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:54.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:54.622+0000 7fc9642ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:55.140 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:55.141 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":597,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":100,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473243,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":21},{"state_name":"creating+activating","count":4}],"num_pgs":25,"num_pools":3,"num_objects":1519,"data_bytes":99877416,"bytes_used":180891648,"bytes_avail":386366164992,"bytes_total":386547056640,"inactive_pgs_ratio":0.15999999642372131,"write_bytes_sec":4335444,"read_op_per_sec":0,"write_op_per_sec":66},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:54:55.159 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:54:55.160 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:55.162 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 27 16 5126 5110 11.8276 11.9375 0.105736 0.0843223 2024-09-16T07:54:55.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:55.308+0000 7f9888cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:55.323+0000 7f9888cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:55.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:55.674 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:55.677 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:55.693 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2024-09-16T07:54:54.414385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":99877416,"num_objects":1519,"num_object_clones":0,"num_object_copies":4557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1595,"num_write_kb":98067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1570,"ondisk_log_size":1570,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":176652,"kb_used_data":23500,"kb_used_omap":0,"kb_used_meta":153088,"kb_avail":377310708,"statfs":{"total":386547056640,"available":386366164992,"internally_reserved":0,"allocated":24064000,"data_stored":331765369,"data_compressed":15694399,"data_compressed_allocated":20664320,"data_compressed_original":330383360,"omap_allocated":0,"internal_metadata":156762112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":52035584,"num_objects":794,"num_object_clones":0,"num_object_copies":2382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":794,"num_write_kb":50816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002364"},"pg_stats":[{"pgid":"6.f","version":"100'113","reported_seq":125,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.600732+0000","last_change":"2024-09-16T07:54:27.190851+0000","last_active":"2024-09-16T07:54:35.600732+0000","last_peered":"2024-09-16T07:54:35.600732+0000","last_clean":"2024-09-16T07:54:35.600732+0000","last_became_active":"2024-09-16T07:54:27.182196+0000","last_became_peered":"2024-09-16T07:54:27.182196+0000","last_unstale":"2024-09-16T07:54:35.600732+0000","last_undegraded":"2024-09-16T07:54:35.600732+0000","last_fullsized":"2024-09-16T07:54:35.600732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092377+0000","last_change":"2024-09-16T07:54:27.093935+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092377+0000","last_undegraded":"2024-09-16T07:54:27.092377+0000","last_fullsized":"2024-09-16T07:54:27.092377+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.097446+0000","last_change":"2024-09-16T07:54:27.100163+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.097446+0000","last_undegraded":"2024-09-16T07:54:27.097446+0000","last_fullsized":"2024-09-16T07:54:27.097446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":["1","0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.825541+0000","last_change":"2024-09-16T07:54:27.197656+0000","last_active":"2024-09-16T07:54:32.825541+0000","last_peered":"2024-09-16T07:54:32.825541+0000","last_clean":"2024-09-16T07:54:32.825541+0000","last_became_active":"2024-09-16T07:54:27.186041+0000","last_became_peered":"2024-09-16T07:54:27.186041+0000","last_unstale":"2024-09-16T07:54:32.825541+0000","last_undegraded":"2024-09-16T07:54:32.825541+0000","last_fullsized":"2024-09-16T07:54:32.825541+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.095323+0000","last_change":"2024-09-16T07:54:27.096790+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.095323+0000","last_undegraded":"2024-09-16T07:54:27.095323+0000","last_fullsized":"2024-09-16T07:54:27.095323+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":["1","2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"100'87","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.747482+0000","last_change":"2024-09-16T07:54:27.286418+0000","last_active":"2024-09-16T07:54:35.747482+0000","last_peered":"2024-09-16T07:54:35.747482+0000","last_clean":"2024-09-16T07:54:35.747482+0000","last_became_active":"2024-09-16T07:54:27.270873+0000","last_became_peered":"2024-09-16T07:54:27.270873+0000","last_unstale":"2024-09-16T07:54:35.747482+0000","last_undegraded":"2024-09-16T07:54:35.747482+0000","last_fullsized":"2024-09-16T07:54:35.747482+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.047740+0000","last_change":"2024-09-16T07:54:27.210146+0000","last_active":"2024-09-16T07:54:33.047740+0000","last_peered":"2024-09-16T07:54:33.047740+0000","last_clean":"2024-09-16T07:54:33.047740+0000","last_became_active":"2024-09-16T07:54:27.202101+0000","last_became_peered":"2024-09-16T07:54:27.202101+0000","last_unstale":"2024-09-16T07:54:33.047740+0000","last_undegraded":"2024-09-16T07:54:33.047740+0000","last_fullsized":"2024-09-16T07:54:33.047740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"100'251","reported_seq":263,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:50.475272+0000","last_change":"2024-09-16T07:54:27.256819+0000","last_active":"2024-09-16T07:54:50.475272+0000","last_peered":"2024-09-16T07:54:50.475272+0000","last_clean":"2024-09-16T07:54:50.475272+0000","last_became_active":"2024-09-16T07:54:27.243741+0000","last_became_peered":"2024-09-16T07:54:27.243741+0000","last_unstale":"2024-09-16T07:54:50.475272+0000","last_undegraded":"2024-09-16T07:54:50.475272+0000","last_fullsized":"2024-09-16T07:54:50.475272+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":16064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"100'259","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:50.505728+0000","last_change":"2024-09-16T07:54:27.295100+0000","last_active":"2024-09-16T07:54:50.505728+0000","last_peered":"2024-09-16T07:54:50.505728+0000","last_clean":"2024-09-16T07:54:50.505728+0000","last_became_active":"2024-09-16T07:54:27.279086+0000","last_became_peered":"2024-09-16T07:54:27.279086+0000","last_unstale":"2024-09-16T07:54:50.505728+0000","last_undegraded":"2024-09-16T07:54:50.505728+0000","last_fullsized":"2024-09-16T07:54:50.505728+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":16576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.021677+0000","last_change":"2024-09-16T07:54:04.226137+0000","last_active":"2024-09-16T07:54:28.021677+0000","last_peered":"2024-09-16T07:54:28.021677+0000","last_clean":"2024-09-16T07:54:28.021677+0000","last_became_active":"2024-09-16T07:54:04.213409+0000","last_became_peered":"2024-09-16T07:54:04.213409+0000","last_unstale":"2024-09-16T07:54:28.021677+0000","last_undegraded":"2024-09-16T07:54:28.021677+0000","last_fullsized":"2024-09-16T07:54:28.021677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.096663+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:54:27.096663+0000","last_peered":"2024-09-16T07:54:27.096663+0000","last_clean":"2024-09-16T07:54:27.096663+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:54:27.096663+0000","last_undegraded":"2024-09-16T07:54:27.096663+0000","last_fullsized":"2024-09-16T07:54:27.096663+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"100'67","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.114964+0000","last_change":"2024-09-16T07:54:27.267114+0000","last_active":"2024-09-16T07:54:33.114964+0000","last_peered":"2024-09-16T07:54:33.114964+0000","last_clean":"2024-09-16T07:54:33.114964+0000","last_became_active":"2024-09-16T07:54:27.258014+0000","last_became_peered":"2024-09-16T07:54:27.258014+0000","last_unstale":"2024-09-16T07:54:33.114964+0000","last_undegraded":"2024-09-16T07:54:33.114964+0000","last_fullsized":"2024-09-16T07:54:33.114964+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.022639+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:28.022639+0000","last_peered":"2024-09-16T07:54:28.022639+0000","last_clean":"2024-09-16T07:54:28.022639+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:28.022639+0000","last_undegraded":"2024-09-16T07:54:28.022639+0000","last_fullsized":"2024-09-16T07:54:28.022639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"100'92","reported_seq":104,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.646788+0000","last_change":"2024-09-16T07:54:27.222094+0000","last_active":"2024-09-16T07:54:35.646788+0000","last_peered":"2024-09-16T07:54:35.646788+0000","last_clean":"2024-09-16T07:54:35.646788+0000","last_became_active":"2024-09-16T07:54:27.217304+0000","last_became_peered":"2024-09-16T07:54:27.217304+0000","last_unstale":"2024-09-16T07:54:35.646788+0000","last_undegraded":"2024-09-16T07:54:35.646788+0000","last_fullsized":"2024-09-16T07:54:35.646788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":241,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087985+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:54:27.087985+0000","last_peered":"2024-09-16T07:54:27.087985+0000","last_clean":"2024-09-16T07:54:27.087985+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:54:27.087985+0000","last_undegraded":"2024-09-16T07:54:27.087985+0000","last_fullsized":"2024-09-16T07:54:27.087985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"100'51","reported_seq":63,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.936929+0000","last_change":"2024-09-16T07:54:27.230732+0000","last_active":"2024-09-16T07:54:32.936929+0000","last_peered":"2024-09-16T07:54:32.936929+0000","last_clean":"2024-09-16T07:54:32.936929+0000","last_became_active":"2024-09-16T07:54:27.224955+0000","last_became_peered":"2024-09-16T07:54:27.224955+0000","last_unstale":"2024-09-16T07:54:32.936929+0000","last_undegraded":"2024-09-16T07:54:32.936929+0000","last_fullsized":"2024-09-16T07:54:32.936929+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":180,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.028338+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:28.028338+0000","last_peered":"2024-09-16T07:54:28.028338+0000","last_clean":"2024-09-16T07:54:28.028338+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:28.028338+0000","last_undegraded":"2024-09-16T07:54:28.028338+0000","last_fullsized":"2024-09-16T07:54:28.028338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"100'101","reported_seq":113,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.724678+0000","last_change":"2024-09-16T07:54:27.288961+0000","last_active":"2024-09-16T07:54:35.724678+0000","last_peered":"2024-09-16T07:54:35.724678+0000","last_clean":"2024-09-16T07:54:35.724678+0000","last_became_active":"2024-09-16T07:54:27.264185+0000","last_became_peered":"2024-09-16T07:54:27.264185+0000","last_unstale":"2024-09-16T07:54:35.724678+0000","last_undegraded":"2024-09-16T07:54:35.724678+0000","last_fullsized":"2024-09-16T07:54:35.724678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.031002+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:28.031002+0000","last_peered":"2024-09-16T07:54:28.031002+0000","last_clean":"2024-09-16T07:54:28.031002+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:28.031002+0000","last_undegraded":"2024-09-16T07:54:28.031002+0000","last_fullsized":"2024-09-16T07:54:28.031002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"100'84","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.648824+0000","last_change":"2024-09-16T07:54:27.244832+0000","last_active":"2024-09-16T07:54:35.648824+0000","last_peered":"2024-09-16T07:54:35.648824+0000","last_clean":"2024-09-16T07:54:35.648824+0000","last_became_active":"2024-09-16T07:54:27.237065+0000","last_became_peered":"2024-09-16T07:54:27.237065+0000","last_unstale":"2024-09-16T07:54:35.648824+0000","last_undegraded":"2024-09-16T07:54:35.648824+0000","last_fullsized":"2024-09-16T07:54:35.648824+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.024640+0000","last_change":"2024-09-16T07:54:05.026553+0000","last_active":"2024-09-16T07:54:28.024640+0000","last_peered":"2024-09-16T07:54:28.024640+0000","last_clean":"2024-09-16T07:54:28.024640+0000","last_became_active":"2024-09-16T07:54:04.222017+0000","last_became_peered":"2024-09-16T07:54:04.222017+0000","last_unstale":"2024-09-16T07:54:28.024640+0000","last_undegraded":"2024-09-16T07:54:28.024640+0000","last_fullsized":"2024-09-16T07:54:28.024640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":99,"state":"creating+activating","last_fresh":"2024-09-16T07:54:27.092003+0000","last_change":"2024-09-16T07:54:27.094682+0000","last_active":"2024-09-16T07:54:26.065928+0000","last_peered":"2024-09-16T07:54:26.065928+0000","last_clean":"2024-09-16T07:54:26.065928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:54:27.092003+0000","last_undegraded":"2024-09-16T07:54:27.092003+0000","last_fullsized":"2024-09-16T07:54:27.092003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":["1","0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.023386+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:28.023386+0000","last_peered":"2024-09-16T07:54:28.023386+0000","last_clean":"2024-09-16T07:54:28.023386+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:28.023386+0000","last_undegraded":"2024-09-16T07:54:28.023386+0000","last_fullsized":"2024-09-16T07:54:28.023386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"100'284","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:50.385644+0000","last_change":"2024-09-16T07:54:27.314798+0000","last_active":"2024-09-16T07:54:50.385644+0000","last_peered":"2024-09-16T07:54:50.385644+0000","last_clean":"2024-09-16T07:54:50.385644+0000","last_became_active":"2024-09-16T07:54:27.306364+0000","last_became_peered":"2024-09-16T07:54:27.306364+0000","last_unstale":"2024-09-16T07:54:50.385644+0000","last_undegraded":"2024-09-16T07:54:50.385644+0000","last_fullsized":"2024-09-16T07:54:50.385644+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18612224,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":284,"num_write_kb":18176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":251,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-16T07:54:27.087522+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:54:27.087522+0000","last_peered":"2024-09-16T07:54:27.087522+0000","last_clean":"2024-09-16T07:54:27.087522+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:54:27.087522+0000","last_undegraded":"2024-09-16T07:54:27.087522+0000","last_fullsized":"2024-09-16T07:54:27.087522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":99287040,"num_objects":1515,"num_object_clones":0,"num_object_copies":4545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1515,"num_write_kb":96960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21172224,"data_stored":338755584,"data_compressed":16083509,"data_compressed_allocated":21172224,"data_compressed_original":338755584,"omap_allocated":0,"internal_metadata":0},"log_size":1515,"ondisk_log_size":1515,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41588,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94330252,"statfs":{"total":96636764160,"available":96594178048,"internally_reserved":0,"allocated":3706880,"data_stored":45882681,"data_compressed":2164105,"data_compressed_allocated":2850816,"data_compressed_original":45531136,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41396,"kb_used_data":4388,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94330444,"statfs":{"total":96636764160,"available":96594374656,"internally_reserved":0,"allocated":4493312,"data_stored":58400076,"data_compressed":2758521,"data_compressed_allocated":3633152,"data_compressed_original":58048512,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612756,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37044,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":823296,"data_stored":327336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56624,"kb_used_data":14688,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94315216,"statfs":{"total":96636764160,"available":96578781184,"internally_reserved":0,"allocated":15040512,"data_stored":227155276,"data_compressed":10771773,"data_compressed_allocated":14180352,"data_compressed_original":226803712,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14196736,"data_stored":227147776,"data_compressed":10785300,"data_compressed_allocated":14196736,"data_compressed_original":227147776,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4104192,"data_stored":65667072,"data_compressed":3117480,"data_compressed_allocated":4104192,"data_compressed_original":65667072,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2871296,"data_stored":45940736,"data_compressed":2180729,"data_compressed_allocated":2871296,"data_compressed_original":45940736,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:55.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:55.840+0000 7fb02967d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:55.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:55.848+0000 7fb02967d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:56.163 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 28 16 5302 5286 11.7981 11 0.066042 0.0846022 2024-09-16T07:54:57.163 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 29 16 5491 5475 11.7985 11.8125 0.0577743 0.0846448 2024-09-16T07:54:58.145 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:58.163 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 30 16 5685 5669 11.8094 12.125 0.0521249 0.0845122 2024-09-16T07:54:58.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:58.303+0000 7f8d1daa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:58.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:58.314+0000 7f8d1daa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:58.695 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:58.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:58.848+0000 7fad11548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:58.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:54:58.863+0000 7fad11548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:59.163 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 31 16 5867 5851 11.7953 11.375 0.132371 0.0846572 2024-09-16T07:54:59.179 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:54:59.180 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:54:59.200 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":389,"stamp":"2024-09-16T07:54:58.415237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":186843688,"num_objects":2846,"num_object_clones":0,"num_object_copies":8538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2922,"num_write_kb":182995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2897,"ondisk_log_size":2897,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":193836,"kb_used_data":40684,"kb_used_omap":0,"kb_used_meta":153088,"kb_avail":377293524,"statfs":{"total":386547056640,"available":386348568576,"internally_reserved":0,"allocated":41660416,"data_stored":613053181,"data_compressed":29050210,"data_compressed_allocated":38244352,"data_compressed_original":611663872,"omap_allocated":0,"internal_metadata":156762112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":139001856,"num_objects":2121,"num_object_clones":0,"num_object_copies":6363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2121,"num_write_kb":135744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002384"},"pg_stats":[{"pgid":"6.f","version":"100'113","reported_seq":125,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.600732+0000","last_change":"2024-09-16T07:54:27.190851+0000","last_active":"2024-09-16T07:54:35.600732+0000","last_peered":"2024-09-16T07:54:35.600732+0000","last_clean":"2024-09-16T07:54:35.600732+0000","last_became_active":"2024-09-16T07:54:27.182196+0000","last_became_peered":"2024-09-16T07:54:27.182196+0000","last_unstale":"2024-09-16T07:54:35.600732+0000","last_undegraded":"2024-09-16T07:54:35.600732+0000","last_fullsized":"2024-09-16T07:54:35.600732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"100'348","reported_seq":360,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:56.945851+0000","last_change":"2024-09-16T07:54:27.249560+0000","last_active":"2024-09-16T07:54:56.945851+0000","last_peered":"2024-09-16T07:54:56.945851+0000","last_clean":"2024-09-16T07:54:56.945851+0000","last_became_active":"2024-09-16T07:54:27.235300+0000","last_became_peered":"2024-09-16T07:54:27.235300+0000","last_unstale":"2024-09-16T07:54:56.945851+0000","last_undegraded":"2024-09-16T07:54:56.945851+0000","last_fullsized":"2024-09-16T07:54:56.945851+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22806528,"num_objects":348,"num_object_clones":0,"num_object_copies":1044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":348,"num_write_kb":22272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"100'333","reported_seq":345,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:56.902841+0000","last_change":"2024-09-16T07:54:27.267900+0000","last_active":"2024-09-16T07:54:56.902841+0000","last_peered":"2024-09-16T07:54:56.902841+0000","last_clean":"2024-09-16T07:54:56.902841+0000","last_became_active":"2024-09-16T07:54:27.244897+0000","last_became_peered":"2024-09-16T07:54:27.244897+0000","last_unstale":"2024-09-16T07:54:56.902841+0000","last_undegraded":"2024-09-16T07:54:56.902841+0000","last_fullsized":"2024-09-16T07:54:56.902841+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21823488,"num_objects":333,"num_object_clones":0,"num_object_copies":999,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":333,"num_write_kb":21312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.825541+0000","last_change":"2024-09-16T07:54:27.197656+0000","last_active":"2024-09-16T07:54:32.825541+0000","last_peered":"2024-09-16T07:54:32.825541+0000","last_clean":"2024-09-16T07:54:32.825541+0000","last_became_active":"2024-09-16T07:54:27.186041+0000","last_became_peered":"2024-09-16T07:54:27.186041+0000","last_unstale":"2024-09-16T07:54:32.825541+0000","last_undegraded":"2024-09-16T07:54:32.825541+0000","last_fullsized":"2024-09-16T07:54:32.825541+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"100'324","reported_seq":336,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:57.098679+0000","last_change":"2024-09-16T07:54:27.244356+0000","last_active":"2024-09-16T07:54:57.098679+0000","last_peered":"2024-09-16T07:54:57.098679+0000","last_clean":"2024-09-16T07:54:57.098679+0000","last_became_active":"2024-09-16T07:54:27.226887+0000","last_became_peered":"2024-09-16T07:54:27.226887+0000","last_unstale":"2024-09-16T07:54:57.098679+0000","last_undegraded":"2024-09-16T07:54:57.098679+0000","last_fullsized":"2024-09-16T07:54:57.098679+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":20736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"100'87","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.747482+0000","last_change":"2024-09-16T07:54:27.286418+0000","last_active":"2024-09-16T07:54:35.747482+0000","last_peered":"2024-09-16T07:54:35.747482+0000","last_clean":"2024-09-16T07:54:35.747482+0000","last_became_active":"2024-09-16T07:54:27.270873+0000","last_became_peered":"2024-09-16T07:54:27.270873+0000","last_unstale":"2024-09-16T07:54:35.747482+0000","last_undegraded":"2024-09-16T07:54:35.747482+0000","last_fullsized":"2024-09-16T07:54:35.747482+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"100'63","reported_seq":75,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.047740+0000","last_change":"2024-09-16T07:54:27.210146+0000","last_active":"2024-09-16T07:54:33.047740+0000","last_peered":"2024-09-16T07:54:33.047740+0000","last_clean":"2024-09-16T07:54:33.047740+0000","last_became_active":"2024-09-16T07:54:27.202101+0000","last_became_peered":"2024-09-16T07:54:27.202101+0000","last_unstale":"2024-09-16T07:54:33.047740+0000","last_undegraded":"2024-09-16T07:54:33.047740+0000","last_fullsized":"2024-09-16T07:54:33.047740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"100'251","reported_seq":263,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:50.475272+0000","last_change":"2024-09-16T07:54:27.256819+0000","last_active":"2024-09-16T07:54:50.475272+0000","last_peered":"2024-09-16T07:54:50.475272+0000","last_clean":"2024-09-16T07:54:50.475272+0000","last_became_active":"2024-09-16T07:54:27.243741+0000","last_became_peered":"2024-09-16T07:54:27.243741+0000","last_unstale":"2024-09-16T07:54:50.475272+0000","last_undegraded":"2024-09-16T07:54:50.475272+0000","last_fullsized":"2024-09-16T07:54:50.475272+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":16064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"100'259","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:50.505728+0000","last_change":"2024-09-16T07:54:27.295100+0000","last_active":"2024-09-16T07:54:50.505728+0000","last_peered":"2024-09-16T07:54:50.505728+0000","last_clean":"2024-09-16T07:54:50.505728+0000","last_became_active":"2024-09-16T07:54:27.279086+0000","last_became_peered":"2024-09-16T07:54:27.279086+0000","last_unstale":"2024-09-16T07:54:50.505728+0000","last_undegraded":"2024-09-16T07:54:50.505728+0000","last_fullsized":"2024-09-16T07:54:50.505728+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":16576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.021677+0000","last_change":"2024-09-16T07:54:04.226137+0000","last_active":"2024-09-16T07:54:28.021677+0000","last_peered":"2024-09-16T07:54:28.021677+0000","last_clean":"2024-09-16T07:54:28.021677+0000","last_became_active":"2024-09-16T07:54:04.213409+0000","last_became_peered":"2024-09-16T07:54:04.213409+0000","last_unstale":"2024-09-16T07:54:28.021677+0000","last_undegraded":"2024-09-16T07:54:28.021677+0000","last_fullsized":"2024-09-16T07:54:28.021677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":263,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.036879+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:54:28.036879+0000","last_peered":"2024-09-16T07:54:28.036879+0000","last_clean":"2024-09-16T07:54:28.036879+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:54:28.036879+0000","last_undegraded":"2024-09-16T07:54:28.036879+0000","last_fullsized":"2024-09-16T07:54:28.036879+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"100'67","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.114964+0000","last_change":"2024-09-16T07:54:27.267114+0000","last_active":"2024-09-16T07:54:33.114964+0000","last_peered":"2024-09-16T07:54:33.114964+0000","last_clean":"2024-09-16T07:54:33.114964+0000","last_became_active":"2024-09-16T07:54:27.258014+0000","last_became_peered":"2024-09-16T07:54:27.258014+0000","last_unstale":"2024-09-16T07:54:33.114964+0000","last_undegraded":"2024-09-16T07:54:33.114964+0000","last_fullsized":"2024-09-16T07:54:33.114964+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.022639+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:28.022639+0000","last_peered":"2024-09-16T07:54:28.022639+0000","last_clean":"2024-09-16T07:54:28.022639+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:54:28.022639+0000","last_undegraded":"2024-09-16T07:54:28.022639+0000","last_fullsized":"2024-09-16T07:54:28.022639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"100'92","reported_seq":104,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.646788+0000","last_change":"2024-09-16T07:54:27.222094+0000","last_active":"2024-09-16T07:54:35.646788+0000","last_peered":"2024-09-16T07:54:35.646788+0000","last_clean":"2024-09-16T07:54:35.646788+0000","last_became_active":"2024-09-16T07:54:27.217304+0000","last_became_peered":"2024-09-16T07:54:27.217304+0000","last_unstale":"2024-09-16T07:54:35.646788+0000","last_undegraded":"2024-09-16T07:54:35.646788+0000","last_fullsized":"2024-09-16T07:54:35.646788+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.030315+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:54:28.030315+0000","last_peered":"2024-09-16T07:54:28.030315+0000","last_clean":"2024-09-16T07:54:28.030315+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:54:28.030315+0000","last_undegraded":"2024-09-16T07:54:28.030315+0000","last_fullsized":"2024-09-16T07:54:28.030315+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"100'51","reported_seq":63,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:32.936929+0000","last_change":"2024-09-16T07:54:27.230732+0000","last_active":"2024-09-16T07:54:32.936929+0000","last_peered":"2024-09-16T07:54:32.936929+0000","last_clean":"2024-09-16T07:54:32.936929+0000","last_became_active":"2024-09-16T07:54:27.224955+0000","last_became_peered":"2024-09-16T07:54:27.224955+0000","last_unstale":"2024-09-16T07:54:32.936929+0000","last_undegraded":"2024-09-16T07:54:32.936929+0000","last_fullsized":"2024-09-16T07:54:32.936929+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":180,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.028338+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:28.028338+0000","last_peered":"2024-09-16T07:54:28.028338+0000","last_clean":"2024-09-16T07:54:28.028338+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:54:28.028338+0000","last_undegraded":"2024-09-16T07:54:28.028338+0000","last_fullsized":"2024-09-16T07:54:28.028338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"100'101","reported_seq":113,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.724678+0000","last_change":"2024-09-16T07:54:27.288961+0000","last_active":"2024-09-16T07:54:35.724678+0000","last_peered":"2024-09-16T07:54:35.724678+0000","last_clean":"2024-09-16T07:54:35.724678+0000","last_became_active":"2024-09-16T07:54:27.264185+0000","last_became_peered":"2024-09-16T07:54:27.264185+0000","last_unstale":"2024-09-16T07:54:35.724678+0000","last_undegraded":"2024-09-16T07:54:35.724678+0000","last_fullsized":"2024-09-16T07:54:35.724678+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.031002+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:28.031002+0000","last_peered":"2024-09-16T07:54:28.031002+0000","last_clean":"2024-09-16T07:54:28.031002+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:28.031002+0000","last_undegraded":"2024-09-16T07:54:28.031002+0000","last_fullsized":"2024-09-16T07:54:28.031002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"100'84","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:35.648824+0000","last_change":"2024-09-16T07:54:27.244832+0000","last_active":"2024-09-16T07:54:35.648824+0000","last_peered":"2024-09-16T07:54:35.648824+0000","last_clean":"2024-09-16T07:54:35.648824+0000","last_became_active":"2024-09-16T07:54:27.237065+0000","last_became_peered":"2024-09-16T07:54:27.237065+0000","last_unstale":"2024-09-16T07:54:35.648824+0000","last_undegraded":"2024-09-16T07:54:35.648824+0000","last_fullsized":"2024-09-16T07:54:35.648824+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.024640+0000","last_change":"2024-09-16T07:54:05.026553+0000","last_active":"2024-09-16T07:54:28.024640+0000","last_peered":"2024-09-16T07:54:28.024640+0000","last_clean":"2024-09-16T07:54:28.024640+0000","last_became_active":"2024-09-16T07:54:04.222017+0000","last_became_peered":"2024-09-16T07:54:04.222017+0000","last_unstale":"2024-09-16T07:54:28.024640+0000","last_undegraded":"2024-09-16T07:54:28.024640+0000","last_fullsized":"2024-09-16T07:54:28.024640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"100'322","reported_seq":334,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:57.095225+0000","last_change":"2024-09-16T07:54:27.274507+0000","last_active":"2024-09-16T07:54:57.095225+0000","last_peered":"2024-09-16T07:54:57.095225+0000","last_clean":"2024-09-16T07:54:57.095225+0000","last_became_active":"2024-09-16T07:54:27.256628+0000","last_became_peered":"2024-09-16T07:54:27.256628+0000","last_unstale":"2024-09-16T07:54:57.095225+0000","last_undegraded":"2024-09-16T07:54:57.095225+0000","last_fullsized":"2024-09-16T07:54:57.095225+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":322,"num_write_kb":20608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.023386+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:28.023386+0000","last_peered":"2024-09-16T07:54:28.023386+0000","last_clean":"2024-09-16T07:54:28.023386+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:28.023386+0000","last_undegraded":"2024-09-16T07:54:28.023386+0000","last_fullsized":"2024-09-16T07:54:28.023386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"100'284","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:50.385644+0000","last_change":"2024-09-16T07:54:27.314798+0000","last_active":"2024-09-16T07:54:50.385644+0000","last_peered":"2024-09-16T07:54:50.385644+0000","last_clean":"2024-09-16T07:54:50.385644+0000","last_became_active":"2024-09-16T07:54:27.306364+0000","last_became_peered":"2024-09-16T07:54:27.306364+0000","last_unstale":"2024-09-16T07:54:50.385644+0000","last_undegraded":"2024-09-16T07:54:50.385644+0000","last_fullsized":"2024-09-16T07:54:50.385644+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18612224,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":284,"num_write_kb":18176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":254,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.029050+0000","last_change":"2024-09-16T07:52:53.027160+0000","last_active":"2024-09-16T07:54:28.029050+0000","last_peered":"2024-09-16T07:54:28.029050+0000","last_clean":"2024-09-16T07:54:28.029050+0000","last_became_active":"2024-09-16T07:52:52.146746+0000","last_became_peered":"2024-09-16T07:52:52.146746+0000","last_unstale":"2024-09-16T07:54:28.029050+0000","last_undegraded":"2024-09-16T07:54:28.029050+0000","last_fullsized":"2024-09-16T07:54:28.029050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":186253312,"num_objects":2842,"num_object_clones":0,"num_object_copies":8526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2842,"num_write_kb":181888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":39288832,"data_stored":628621312,"data_compressed":29846992,"data_compressed_allocated":39288832,"data_compressed_original":628621312,"omap_allocated":0,"internal_metadata":0},"log_size":2842,"ondisk_log_size":2842,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41588,"kb_used_data":3620,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94330252,"statfs":{"total":96636764160,"available":96594178048,"internally_reserved":0,"allocated":3706880,"data_stored":45882681,"data_compressed":2164105,"data_compressed_allocated":2850816,"data_compressed_original":45531136,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41396,"kb_used_data":4388,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94330444,"statfs":{"total":96636764160,"available":96594374656,"internally_reserved":0,"allocated":4493312,"data_stored":58400076,"data_compressed":2758521,"data_compressed_allocated":3633152,"data_compressed_original":58048512,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54228,"kb_used_data":17988,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":94317612,"statfs":{"total":96636764160,"available":96581234688,"internally_reserved":0,"allocated":18419712,"data_stored":281615148,"data_compressed":13355811,"data_compressed_allocated":17580032,"data_compressed_original":281280512,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56624,"kb_used_data":14688,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94315216,"statfs":{"total":96636764160,"available":96578781184,"internally_reserved":0,"allocated":15040512,"data_stored":227155276,"data_compressed":10771773,"data_compressed_allocated":14180352,"data_compressed_original":226803712,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14196736,"data_stored":227147776,"data_compressed":10785300,"data_compressed_allocated":14196736,"data_compressed_original":227147776,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18116608,"data_stored":289865728,"data_compressed":13763483,"data_compressed_allocated":18116608,"data_compressed_original":289865728,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4104192,"data_stored":65667072,"data_compressed":3117480,"data_compressed_allocated":4104192,"data_compressed_original":65667072,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2871296,"data_stored":45940736,"data_compressed":2180729,"data_compressed_allocated":2871296,"data_compressed_original":45940736,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:59.202 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:54:59.202 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:54:59.202 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [2, 1, 0, 3] 2024-09-16T07:54:59.202 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T07:54:59.203 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:55:00.163 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 32 16 5890 5874 11.4716 1.4375 0.0167748 0.0846877 2024-09-16T07:55:00.616 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:55:00.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:00.741+0000 7f34b5391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:00.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:00.747+0000 7f34b5391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:01.163 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 33 16 5890 5874 11.124 0 - 0.0846877 2024-09-16T07:55:02.164 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 34 16 5890 5874 10.7968 0 - 0.0846877 2024-09-16T07:55:03.164 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 35 16 5890 5874 10.4883 0 - 0.0846877 2024-09-16T07:55:04.164 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 36 16 5890 5874 10.1969 0 - 0.0846877 2024-09-16T07:55:04.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-16T07:55:05.164 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 37 16 5890 5874 9.9213 0 - 0.0846877 2024-09-16T07:55:05.304 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T07:55:06.164 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 38 16 5890 5874 9.66021 0 - 0.0846877 2024-09-16T07:55:07.164 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 39 16 5890 5874 9.4125 0 - 0.0846877 2024-09-16T07:55:08.164 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:55:08.166592+0000 min lat: 0.0164785 max lat: 0.205192 avg lat: 0.0846877 2024-09-16T07:55:08.165 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:55:08.165 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 40 16 5890 5874 9.17718 0 - 0.0846877 2024-09-16T07:55:09.165 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 41 16 5890 5874 8.95333 0 - 0.0846877 2024-09-16T07:55:10.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-16T07:55:10.165 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 42 16 5890 5874 8.74015 0 - 0.0846877 2024-09-16T07:55:10.305 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [2, 1, 3] 2024-09-16T07:55:10.305 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:55:10.306 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-16T07:55:10.306 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:55:10.306 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T07:55:10.310 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:55:10.310 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:55:10.426 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:55:10.430 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:55:10.430 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:55:11.165 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 43 16 5890 5874 8.5369 0 - 0.0846877 2024-09-16T07:55:12.165 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 44 16 5890 5874 8.34288 0 - 0.0846877 2024-09-16T07:55:13.165 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 45 16 5890 5874 8.15749 0 - 0.0846877 2024-09-16T07:55:14.168 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 46 16 5890 5874 7.98015 0 - 0.0846877 2024-09-16T07:55:15.165 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 47 16 5890 5874 7.81036 0 - 0.0846877 2024-09-16T07:55:15.432 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:55:15.533 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:55:15.536 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:55:15.536 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:55:16.165 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 48 16 5890 5874 7.64765 0 - 0.0846877 2024-09-16T07:55:17.165 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 49 16 5890 5874 7.49158 0 - 0.0846877 2024-09-16T07:55:18.165 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 50 16 5890 5874 7.34174 0 - 0.0846877 2024-09-16T07:55:19.166 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 51 16 5890 5874 7.19778 0 - 0.0846877 2024-09-16T07:55:20.166 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 52 16 5890 5874 7.05936 0 - 0.0846877 2024-09-16T07:55:20.537 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:55:20.640 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:55:20.644 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:55:20.644 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:55:21.166 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 53 16 5890 5874 6.92617 0 - 0.0846877 2024-09-16T07:55:22.061 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:55:22.166 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 54 16 5890 5874 6.79791 0 - 0.0846877 2024-09-16T07:55:22.240 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:55:22.241 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:55:23.166 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 55 16 5890 5874 6.67431 0 - 0.0846877 2024-09-16T07:55:24.166 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 56 16 5890 5874 6.55513 0 - 0.0846877 2024-09-16T07:55:24.242 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:55:24.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:24.375+0000 7ffa3c751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:24.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:24.382+0000 7ffa3c751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:25.166 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 57 16 6028 6012 6.59143 0.345 0.117794 0.151621 2024-09-16T07:55:25.645 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:55:25.855 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T07:55:25.856 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [ 2024-09-16T07:55:25.856 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:25.856 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:25.856 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 415, 2024-09-16T07:55:25.856 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:25.856 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.856 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:25.856 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.754814+0000" 2024-09-16T07:55:25.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.857 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.857 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:25.857 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.754829+0000" 2024-09-16T07:55:25.857 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.857 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.857 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.857 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.857 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.857 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.857 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:25.857 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.757847+0000" 2024-09-16T07:55:25.857 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.857 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.858 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.858 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.858 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.858 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.858 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:25.858 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.858 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.858 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.858 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.858 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.858 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.858 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.858 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:25.858 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.758464+0000" 2024-09-16T07:55:25.859 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.859 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.859 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.859 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.859 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.859 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.859 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:25.859 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.763229+0000" 2024-09-16T07:55:25.859 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.859 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.859 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.859 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.859 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.860 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.860 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:25.860 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.860 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.860 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.860 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.860 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.860 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.860 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.861 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.861 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:25.861 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.764028+0000" 2024-09-16T07:55:25.861 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.861 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.861 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.861 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.861 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.861 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.861 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:25.861 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.861 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.861 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.861 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.862 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.862 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.862 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.862 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:25.862 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.764457+0000" 2024-09-16T07:55:25.862 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.862 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.862 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.862 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.862 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.862 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.862 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:25.862 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.863 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.863 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.863 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.863 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.863 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.863 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.863 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:25.863 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.863 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.863 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.863 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.863 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.863 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.864 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.864 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:25.864 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.864 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.864 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.864 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.864 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.864 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.864 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.864 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:25.864 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.765136+0000" 2024-09-16T07:55:25.864 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.864 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.865 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.865 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.865 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.865 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.865 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:25.865 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.865 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.865 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.865 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.865 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.865 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.865 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.865 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:25.866 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.866 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.866 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.866 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.866 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.866 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.866 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.866 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:25.866 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.767526+0000" 2024-09-16T07:55:25.866 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.866 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.866 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.866 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.867 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.867 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.867 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:25.867 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.867 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.867 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.867 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.867 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.867 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.867 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.867 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:25.867 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.868 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.868 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.868 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.868 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.868 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.868 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.868 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.868 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.869 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:25.869 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:25.869 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 419, 2024-09-16T07:55:25.869 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:25.869 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.869 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:25.869 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.783122+0000" 2024-09-16T07:55:25.869 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.869 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.869 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:25.869 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.783136+0000" 2024-09-16T07:55:25.870 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.870 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.870 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.870 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.870 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.870 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.870 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:25.870 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.783730+0000" 2024-09-16T07:55:25.870 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.870 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.870 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.870 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.870 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.871 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.871 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:25.871 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.871 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.871 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.871 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.871 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.871 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.871 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.871 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:25.871 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.784081+0000" 2024-09-16T07:55:25.871 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.872 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.872 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.872 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.872 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.872 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:25.872 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.785429+0000" 2024-09-16T07:55:25.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.872 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.872 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.872 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.873 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.873 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:25.873 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.873 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.873 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.873 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.873 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.873 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.873 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.873 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.873 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.873 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.873 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.874 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:25.874 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.786071+0000" 2024-09-16T07:55:25.874 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.874 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.874 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.874 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.874 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.874 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.874 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:25.874 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.874 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.874 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.874 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.875 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.875 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.875 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.875 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:25.875 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.786374+0000" 2024-09-16T07:55:25.875 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.875 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.875 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.875 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.875 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.875 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.875 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:25.875 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.876 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.876 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.876 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.876 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.876 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:25.876 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.876 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.876 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.876 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.877 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.877 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:25.877 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.877 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.877 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.877 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.877 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.877 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.877 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.877 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:25.877 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.787046+0000" 2024-09-16T07:55:25.877 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.878 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.878 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.878 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.878 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.878 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.878 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:25.878 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.878 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.878 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.878 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.878 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.878 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.878 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.879 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:25.879 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.879 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.879 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.879 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.879 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.879 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.879 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.879 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:25.879 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.789363+0000" 2024-09-16T07:55:25.879 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.879 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.879 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.879 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.880 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.880 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.880 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:25.880 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.880 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.880 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.880 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.880 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.880 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.880 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.880 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:25.880 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.880 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.880 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.881 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.881 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.881 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.881 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.881 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.881 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.881 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.881 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.881 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.881 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:25.881 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:25.881 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 304, 2024-09-16T07:55:25.882 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:25.882 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.882 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:25.882 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.022255+0000" 2024-09-16T07:55:25.882 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.882 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.882 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:25.882 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.022272+0000" 2024-09-16T07:55:25.882 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.882 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.882 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.882 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.882 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.883 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.883 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:25.883 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.022690+0000" 2024-09-16T07:55:25.883 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.883 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.883 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.883 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.883 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.883 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.883 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:25.883 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.883 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.883 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.884 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.884 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.884 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.884 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.884 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:25.884 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.022814+0000" 2024-09-16T07:55:25.884 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.884 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.884 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.884 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.884 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.884 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.884 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:25.885 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.023205+0000" 2024-09-16T07:55:25.885 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.885 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.885 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.885 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.885 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.885 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.885 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:25.885 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.885 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.885 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.885 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.886 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.886 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.886 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.886 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.886 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.069565+0000" 2024-09-16T07:55:25.886 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.886 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.886 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:25.886 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.023662+0000" 2024-09-16T07:55:25.886 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.886 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.886 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.886 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.886 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.887 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.887 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:25.887 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.887 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.887 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.887 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.887 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.887 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.887 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.887 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:25.887 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.023871+0000" 2024-09-16T07:55:25.887 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.887 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.888 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.888 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.888 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.888 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.888 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:25.888 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.888 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.888 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.888 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.888 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.888 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.888 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.889 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:25.889 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.889 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.889 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.889 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.889 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.889 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.889 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.889 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:25.889 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.890 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.890 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.890 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.890 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.890 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.890 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.890 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:25.890 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.024286+0000" 2024-09-16T07:55:25.890 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.891 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.891 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.891 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.891 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.891 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.891 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:25.891 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.891 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.891 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.891 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.891 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.891 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.891 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.892 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:25.892 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.892 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.892 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.892 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.892 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.892 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.892 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.892 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:25.893 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.025802+0000" 2024-09-16T07:55:25.893 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.893 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.893 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.893 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.893 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.893 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.893 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:25.893 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.893 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.893 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.894 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.894 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.894 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.894 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.894 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:25.894 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.068487+0000" 2024-09-16T07:55:25.894 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.894 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.894 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.894 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.894 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.894 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.895 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.895 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.895 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.895 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.895 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.895 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:25.895 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:25.895 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 306, 2024-09-16T07:55:25.895 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:25.895 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.895 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:25.895 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.046080+0000" 2024-09-16T07:55:25.895 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.896 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.896 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:25.896 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.046095+0000" 2024-09-16T07:55:25.896 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.896 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.896 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.896 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.896 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.896 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.896 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:25.896 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.049069+0000" 2024-09-16T07:55:25.896 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.896 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.896 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.897 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.897 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.897 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.897 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:25.897 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.897 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.897 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.897 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.897 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.897 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.897 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.897 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:25.898 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.049444+0000" 2024-09-16T07:55:25.898 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.898 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.898 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.898 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.898 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.898 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.898 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:25.898 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.051171+0000" 2024-09-16T07:55:25.898 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.898 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.898 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.898 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.899 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.899 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.899 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:25.899 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.899 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.899 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.899 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.899 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.899 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.899 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.899 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.899 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.118510+0000" 2024-09-16T07:55:25.899 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.900 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.900 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:25.900 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.051885+0000" 2024-09-16T07:55:25.900 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.900 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.900 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.900 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.900 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.900 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.900 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:25.900 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.900 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.901 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.901 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.901 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.901 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.901 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.901 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:25.901 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.052243+0000" 2024-09-16T07:55:25.901 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.901 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.901 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.901 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.901 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.902 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.902 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:25.902 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.902 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.902 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.902 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.902 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.902 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.902 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.902 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:25.902 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.902 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.902 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.903 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.903 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.903 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.903 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.903 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:25.903 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.903 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.903 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.903 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.903 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.903 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.903 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.903 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:25.903 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.052919+0000" 2024-09-16T07:55:25.904 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.904 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.904 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.904 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.904 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.904 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.904 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:25.904 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.904 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.904 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.904 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.904 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.905 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.905 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.905 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:25.905 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.905 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.905 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.905 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.905 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.905 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.905 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.905 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:25.905 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.056741+0000" 2024-09-16T07:55:25.905 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.905 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.906 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.906 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.906 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.906 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.906 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:25.906 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.906 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.906 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.906 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.906 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.906 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.906 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.907 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:25.907 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.117915+0000" 2024-09-16T07:55:25.907 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.907 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.907 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.907 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.907 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.907 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.908 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.908 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.908 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.908 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.908 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.908 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:25.908 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:25.908 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 308, 2024-09-16T07:55:25.908 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:25.909 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.909 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:25.909 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.052625+0000" 2024-09-16T07:55:25.909 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.909 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.909 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:25.909 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.052645+0000" 2024-09-16T07:55:25.909 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.909 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.909 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.909 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.909 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.910 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.910 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:25.910 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.053024+0000" 2024-09-16T07:55:25.910 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.910 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.910 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.910 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.910 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.910 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.910 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:25.910 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.910 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.911 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.911 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.911 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.911 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.911 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.911 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:25.911 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.053455+0000" 2024-09-16T07:55:25.911 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.911 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.911 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.911 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.911 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.911 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.912 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:25.912 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.054195+0000" 2024-09-16T07:55:25.912 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.912 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.912 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.912 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.912 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.912 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.912 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:25.912 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.912 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.912 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.912 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.913 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.913 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.913 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.913 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.913 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.130415+0000" 2024-09-16T07:55:25.913 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.913 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.913 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:25.913 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.054612+0000" 2024-09-16T07:55:25.913 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.913 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.913 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.913 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.914 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.914 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.914 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:25.914 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.914 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.914 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.914 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.914 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.914 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.914 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.914 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:25.914 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.054813+0000" 2024-09-16T07:55:25.914 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.915 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.915 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.915 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.915 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:25.915 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.915 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.915 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.915 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.915 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.915 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.916 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:25.916 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.916 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.916 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.916 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.916 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.916 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.916 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.916 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:25.916 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.916 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.916 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.916 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.917 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.917 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.917 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.917 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:25.917 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.055229+0000" 2024-09-16T07:55:25.917 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.917 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.917 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.917 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.917 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.917 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:25.918 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.918 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.918 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.918 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.918 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.918 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:25.918 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.918 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.918 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.919 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.919 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.919 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.919 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.919 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:25.919 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.062946+0000" 2024-09-16T07:55:25.919 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.919 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.919 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.919 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.919 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.920 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.920 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:25.920 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.920 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.920 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.920 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.920 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.920 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.920 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.920 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:25.920 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.129455+0000" 2024-09-16T07:55:25.920 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.921 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.921 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.921 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.921 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.921 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.921 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.921 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.921 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.921 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.921 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.921 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:25.921 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:25.921 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 312, 2024-09-16T07:55:25.922 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:25.922 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.922 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:25.922 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.080119+0000" 2024-09-16T07:55:25.922 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.922 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.922 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:25.922 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.080136+0000" 2024-09-16T07:55:25.922 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.922 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.922 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.922 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.922 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.922 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.923 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:25.923 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.080429+0000" 2024-09-16T07:55:25.923 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.923 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.923 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.923 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.923 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.923 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.923 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:25.923 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.923 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.923 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.923 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.924 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.924 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.924 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.924 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:25.924 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.080698+0000" 2024-09-16T07:55:25.924 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.924 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.924 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.924 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.924 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.924 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.924 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:25.924 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.083340+0000" 2024-09-16T07:55:25.925 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.925 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.925 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.925 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.925 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.925 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.925 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:25.925 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.925 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.925 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.925 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.925 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.925 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.926 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.926 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.926 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.143326+0000" 2024-09-16T07:55:25.926 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.926 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.926 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:25.926 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.084118+0000" 2024-09-16T07:55:25.926 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.926 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.926 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.926 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.926 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.926 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:25.927 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.927 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.927 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.927 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.927 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.927 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:25.928 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.084459+0000" 2024-09-16T07:55:25.928 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.928 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.928 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.928 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.928 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.928 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.928 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:25.928 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.928 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.928 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.929 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.929 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.929 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.929 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.929 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:25.929 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.929 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.929 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.929 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.929 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.929 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.929 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.929 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:25.930 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.930 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.930 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.930 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.930 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.930 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.930 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.930 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:25.930 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.085220+0000" 2024-09-16T07:55:25.930 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.930 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.930 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.930 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.931 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.931 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.931 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:25.931 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.931 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.931 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.931 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.931 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.931 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.931 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.931 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:25.931 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.931 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.931 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.932 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.932 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.932 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.932 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.932 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:25.932 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.090395+0000" 2024-09-16T07:55:25.932 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.932 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.932 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.932 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.932 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.932 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.932 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:25.933 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.933 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.933 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.933 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.933 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.933 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.933 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.933 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:25.933 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.142390+0000" 2024-09-16T07:55:25.933 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.933 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.933 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.934 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.934 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.934 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.934 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.934 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.934 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.934 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.934 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.934 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:25.934 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:25.934 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 326, 2024-09-16T07:55:25.934 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:25.934 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.935 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:25.935 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.170297+0000" 2024-09-16T07:55:25.935 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.935 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.935 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:25.935 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.170315+0000" 2024-09-16T07:55:25.935 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.935 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.935 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.935 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.935 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.935 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.935 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:25.935 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.171021+0000" 2024-09-16T07:55:25.936 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.936 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.936 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.936 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.936 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.936 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.936 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:25.936 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.936 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.936 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.936 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.936 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.936 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.937 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.937 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:25.937 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.171317+0000" 2024-09-16T07:55:25.937 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.937 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.937 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.937 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.937 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.937 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.937 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:25.938 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.173088+0000" 2024-09-16T07:55:25.938 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.938 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.938 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.938 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.938 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.938 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.938 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:25.938 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.938 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.938 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.938 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.939 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.939 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.939 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.939 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.939 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.233423+0000" 2024-09-16T07:55:25.939 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.939 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.939 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:25.939 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.173546+0000" 2024-09-16T07:55:25.939 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.939 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.939 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.939 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.939 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.940 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.940 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:25.940 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.940 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.940 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.940 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.940 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.940 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.940 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.940 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:25.940 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.173754+0000" 2024-09-16T07:55:25.940 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.940 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.941 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.941 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.941 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.941 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.941 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:25.941 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.941 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.941 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.941 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.941 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.942 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.942 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.942 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:25.942 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.942 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.942 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.942 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.942 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.942 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.942 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.942 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:25.942 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.942 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.942 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.943 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.943 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.943 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.943 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.943 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:25.943 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.174160+0000" 2024-09-16T07:55:25.943 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.943 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.943 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.943 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.943 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.943 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.944 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:25.944 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.944 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.944 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.944 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.944 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.944 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.944 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.944 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:25.944 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.944 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.945 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.945 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.945 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.945 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.945 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.945 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:25.945 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.175594+0000" 2024-09-16T07:55:25.945 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.945 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.945 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.945 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.945 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.945 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.946 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:25.946 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.946 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.946 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.946 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.946 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.946 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.946 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.946 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:25.946 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.232851+0000" 2024-09-16T07:55:25.946 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.946 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.946 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.947 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.947 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.947 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.947 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.947 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.947 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.947 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.947 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.947 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:25.947 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:25.947 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 329, 2024-09-16T07:55:25.947 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:25.948 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.948 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:25.948 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.181238+0000" 2024-09-16T07:55:25.948 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.948 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.948 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:25.948 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.181253+0000" 2024-09-16T07:55:25.948 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.948 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.948 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.948 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.948 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.948 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.949 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:25.949 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.181655+0000" 2024-09-16T07:55:25.949 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.949 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.949 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.949 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.949 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.949 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.949 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:25.950 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.950 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.950 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.950 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.950 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.950 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.950 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.950 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:25.950 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.184272+0000" 2024-09-16T07:55:25.950 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.950 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.951 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.951 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.951 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.951 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.951 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:25.951 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.186396+0000" 2024-09-16T07:55:25.951 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.951 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.951 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.951 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.951 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.951 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.952 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:25.952 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.952 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.952 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.952 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.952 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.952 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.952 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.952 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.952 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.246811+0000" 2024-09-16T07:55:25.952 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.952 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.953 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:25.953 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.187132+0000" 2024-09-16T07:55:25.953 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.953 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.953 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.953 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.953 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.953 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.953 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:25.953 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.953 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.953 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.954 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.954 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.954 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.954 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.954 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:25.954 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.187477+0000" 2024-09-16T07:55:25.954 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.954 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.954 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.954 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.954 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.954 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.954 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:25.955 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.955 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.955 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.955 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.955 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.955 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.955 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.955 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:25.955 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.955 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.955 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.955 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.955 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.956 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.956 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.956 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:25.956 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.956 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.956 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.956 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.956 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.956 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.956 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.956 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:25.956 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.188151+0000" 2024-09-16T07:55:25.957 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.957 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.957 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.957 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.957 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.957 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.957 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:25.957 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.957 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.957 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.958 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.958 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.958 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.958 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.958 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:25.958 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.958 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.958 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.958 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.958 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.958 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.958 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.958 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:25.959 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.189982+0000" 2024-09-16T07:55:25.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.959 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.959 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.959 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.959 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.959 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:25.959 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.959 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.959 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.960 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.960 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.960 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.960 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:25.960 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.244318+0000" 2024-09-16T07:55:25.960 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.961 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.961 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.961 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.961 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.961 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.961 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.961 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.961 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.961 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.961 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.961 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:25.961 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:25.962 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 335, 2024-09-16T07:55:25.962 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:25.962 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.962 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:25.962 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.234921+0000" 2024-09-16T07:55:25.962 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.962 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.963 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:25.963 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.234942+0000" 2024-09-16T07:55:25.963 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.963 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.963 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.963 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.964 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.964 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.964 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:25.964 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.235206+0000" 2024-09-16T07:55:25.964 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.965 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.965 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.965 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.965 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.965 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.965 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:25.965 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.965 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.965 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.965 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.965 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.966 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.966 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.966 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:25.966 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.235370+0000" 2024-09-16T07:55:25.966 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.966 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.966 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.967 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.967 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.967 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.967 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:25.967 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.235716+0000" 2024-09-16T07:55:25.968 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.968 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.968 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.968 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.968 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.968 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.968 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:25.968 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.968 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.968 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.968 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.968 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.968 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.969 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.969 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.969 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.305829+0000" 2024-09-16T07:55:25.969 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.969 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.969 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:25.969 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.236150+0000" 2024-09-16T07:55:25.969 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.969 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.969 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.969 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.969 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.970 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.970 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:25.970 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.970 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.970 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.970 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.970 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.970 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.970 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.970 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:25.970 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.236349+0000" 2024-09-16T07:55:25.970 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.971 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.971 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.971 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.971 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.971 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.971 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:25.971 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.971 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.971 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.971 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.971 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.971 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.971 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.972 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:25.972 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.972 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.972 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.972 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.972 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.972 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.972 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.972 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:25.972 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.972 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.972 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.972 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.973 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.973 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.973 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.973 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:25.973 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.236788+0000" 2024-09-16T07:55:25.973 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.973 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.973 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.973 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.973 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.973 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.973 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:25.973 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.974 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.974 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.974 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.974 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.974 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.974 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.974 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:25.974 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.974 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.974 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.974 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.974 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.975 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.975 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.975 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:25.975 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.238647+0000" 2024-09-16T07:55:25.975 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.975 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.975 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.975 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.975 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.975 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.976 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:25.976 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.976 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.976 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.976 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.976 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.976 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.976 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.976 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:25.976 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.304558+0000" 2024-09-16T07:55:25.976 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.976 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.977 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.977 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.977 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.977 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.977 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.977 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.977 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.977 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.977 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.977 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:25.977 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:25.977 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 339, 2024-09-16T07:55:25.978 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:25.978 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.978 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:25.978 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.256658+0000" 2024-09-16T07:55:25.978 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.978 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.978 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:25.978 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.256688+0000" 2024-09-16T07:55:25.978 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.978 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.978 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.978 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.978 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.978 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.979 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:25.979 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.256938+0000" 2024-09-16T07:55:25.979 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.979 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.979 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.979 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.979 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.979 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.979 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:25.979 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.979 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.979 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.979 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.980 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.980 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.980 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.980 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:25.980 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.257225+0000" 2024-09-16T07:55:25.980 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.980 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.980 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.980 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.980 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.980 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.980 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:25.980 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.257738+0000" 2024-09-16T07:55:25.981 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.981 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.981 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.981 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.981 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.981 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.981 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:25.981 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.981 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.981 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.981 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.981 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.981 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.982 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.982 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.982 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.309914+0000" 2024-09-16T07:55:25.982 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.982 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.982 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:25.982 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.258188+0000" 2024-09-16T07:55:25.982 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.982 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.982 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.982 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.982 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.982 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.983 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:25.983 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.983 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.983 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.983 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.983 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.983 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.983 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.983 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:25.983 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.258396+0000" 2024-09-16T07:55:25.983 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.983 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.983 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.984 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.984 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.984 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.984 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:25.984 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.984 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.984 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.984 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.984 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.984 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.984 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.984 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:25.985 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.985 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.985 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.985 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.985 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.985 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.985 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.985 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:25.985 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.985 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.985 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.985 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.985 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.986 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.986 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.986 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:25.986 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.258808+0000" 2024-09-16T07:55:25.986 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.986 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.986 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.986 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.986 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.986 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.987 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:25.987 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.987 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.987 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.987 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.987 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.987 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.987 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.987 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:25.987 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.987 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.987 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.987 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.988 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.988 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.988 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.988 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:25.988 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.262380+0000" 2024-09-16T07:55:25.988 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.988 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.988 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.988 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.988 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.988 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.989 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:25.989 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.989 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.989 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.989 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.989 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.989 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.989 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.989 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:25.989 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.309146+0000" 2024-09-16T07:55:25.989 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.989 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.989 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.990 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.990 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.990 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.990 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.990 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.990 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.990 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:25.990 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.990 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:25.990 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:25.990 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 342, 2024-09-16T07:55:25.990 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:25.990 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.991 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:25.991 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.293631+0000" 2024-09-16T07:55:25.991 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.991 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.991 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:25.991 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.293650+0000" 2024-09-16T07:55:25.991 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.991 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.991 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.991 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.992 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.992 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.992 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:25.992 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.293896+0000" 2024-09-16T07:55:25.992 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.992 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.992 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.992 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.992 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.992 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.992 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:25.992 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.993 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.993 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.993 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.993 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.993 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.993 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.993 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:25.993 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.294117+0000" 2024-09-16T07:55:25.993 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.993 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.993 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.993 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.994 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.994 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.994 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:25.994 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.294461+0000" 2024-09-16T07:55:25.994 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.994 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.994 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.994 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.994 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.994 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.994 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:25.994 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.994 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.995 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.995 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.995 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.995 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.995 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.995 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:25.995 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.343338+0000" 2024-09-16T07:55:25.995 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.995 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.995 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:25.995 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.294886+0000" 2024-09-16T07:55:25.995 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.995 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.996 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.996 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.996 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.996 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.996 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:25.996 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.996 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.996 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.996 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.996 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.996 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.997 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.997 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:25.997 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.295091+0000" 2024-09-16T07:55:25.997 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.997 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.997 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.997 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.997 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.997 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.997 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:25.997 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.997 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.997 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.998 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.998 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.998 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.998 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.998 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:25.998 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.998 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.998 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:25.998 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:25.998 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.999 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.999 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:25.999 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:25.999 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:25.999 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:25.999 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.000 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.000 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.000 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.000 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.000 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.000 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.295490+0000" 2024-09-16T07:55:26.000 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.001 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.001 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.001 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.001 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.001 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.001 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.002 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.002 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.002 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.002 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.002 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.002 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.003 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.003 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.003 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.003 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.003 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.003 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.004 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.004 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.004 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.004 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.004 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.298697+0000" 2024-09-16T07:55:26.005 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.005 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.005 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.005 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.005 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.005 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.006 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.006 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.006 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.006 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.006 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.006 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.007 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.007 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.007 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.007 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.342379+0000" 2024-09-16T07:55:26.007 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.007 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.008 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.008 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.008 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.008 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.008 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.009 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.009 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.009 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.009 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.009 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.009 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.010 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 343, 2024-09-16T07:55:26.010 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.010 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.010 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.010 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.294797+0000" 2024-09-16T07:55:26.010 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.011 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.011 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.011 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.294811+0000" 2024-09-16T07:55:26.011 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.011 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.012 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.012 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.012 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.012 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.012 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.012 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.295028+0000" 2024-09-16T07:55:26.013 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.013 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.013 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.013 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.013 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.014 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.014 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.014 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.014 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.014 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.014 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.014 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.015 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.015 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.015 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.015 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.295219+0000" 2024-09-16T07:55:26.015 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.015 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.015 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.016 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.016 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.016 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.016 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.016 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.296480+0000" 2024-09-16T07:55:26.016 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.016 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.016 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.017 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.017 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.017 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.017 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.017 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.017 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.017 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.017 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.017 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.017 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.017 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.018 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.018 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.388518+0000" 2024-09-16T07:55:26.018 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.018 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.018 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.018 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.296925+0000" 2024-09-16T07:55:26.018 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.018 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.018 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.018 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.018 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.018 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.019 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.019 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.019 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.019 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.019 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.019 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.019 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.019 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.019 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.019 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.297158+0000" 2024-09-16T07:55:26.019 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.019 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.019 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.020 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.020 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.020 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.020 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.020 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.020 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.020 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.020 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.020 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.020 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.021 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.021 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.021 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.021 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.021 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.021 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.021 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.021 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.021 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.021 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.021 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.021 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.021 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.022 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.022 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.022 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.022 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.022 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.022 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.297540+0000" 2024-09-16T07:55:26.022 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.022 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.022 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.022 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.022 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.022 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.022 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.022 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.023 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.023 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.023 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.023 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.023 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.023 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.023 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.023 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.023 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.024 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.024 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.024 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.304542+0000" 2024-09-16T07:55:26.024 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.024 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.024 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.024 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.024 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.024 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.024 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.024 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.024 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.024 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.024 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.025 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.025 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.025 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.025 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.025 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.387518+0000" 2024-09-16T07:55:26.025 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.025 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.025 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.025 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.025 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.025 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.025 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.025 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.026 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.026 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.026 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.026 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.026 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 349, 2024-09-16T07:55:26.026 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.026 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.026 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.026 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.342997+0000" 2024-09-16T07:55:26.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.026 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.026 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.027 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.343007+0000" 2024-09-16T07:55:26.027 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.027 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.027 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.027 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.027 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.027 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.027 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.027 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.343307+0000" 2024-09-16T07:55:26.027 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.027 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.027 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.027 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.027 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.028 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.028 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.028 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.028 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.028 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.028 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.028 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.028 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.028 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.343604+0000" 2024-09-16T07:55:26.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.028 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.344605+0000" 2024-09-16T07:55:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.440275+0000" 2024-09-16T07:55:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.345454+0000" 2024-09-16T07:55:26.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.031 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.345784+0000" 2024-09-16T07:55:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.032 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.033 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.346474+0000" 2024-09-16T07:55:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.034 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.035 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.348772+0000" 2024-09-16T07:55:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.036 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.438336+0000" 2024-09-16T07:55:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.037 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 354, 2024-09-16T07:55:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.038 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.374656+0000" 2024-09-16T07:55:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.374685+0000" 2024-09-16T07:55:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.039 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.376112+0000" 2024-09-16T07:55:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.040 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.376533+0000" 2024-09-16T07:55:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.378203+0000" 2024-09-16T07:55:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.041 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.042 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.450772+0000" 2024-09-16T07:55:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.378889+0000" 2024-09-16T07:55:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.044 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.044 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.044 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.044 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.044 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.044 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.044 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.379238+0000" 2024-09-16T07:55:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.045 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.046 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.379900+0000" 2024-09-16T07:55:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.047 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.381830+0000" 2024-09-16T07:55:26.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.050 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.449784+0000" 2024-09-16T07:55:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.051 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 363, 2024-09-16T07:55:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.052 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.427346+0000" 2024-09-16T07:55:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.427360+0000" 2024-09-16T07:55:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.053 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.054 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.430188+0000" 2024-09-16T07:55:26.054 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.054 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.054 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.054 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.054 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.054 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.054 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.054 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.054 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.433816+0000" 2024-09-16T07:55:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.055 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.434690+0000" 2024-09-16T07:55:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.056 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.531744+0000" 2024-09-16T07:55:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.057 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.435406+0000" 2024-09-16T07:55:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.058 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.435745+0000" 2024-09-16T07:55:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.060 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.061 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.436450+0000" 2024-09-16T07:55:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.062 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.063 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.441556+0000" 2024-09-16T07:55:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.064 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.531166+0000" 2024-09-16T07:55:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.065 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.066 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 364, 2024-09-16T07:55:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.436129+0000" 2024-09-16T07:55:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.436139+0000" 2024-09-16T07:55:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.067 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.437718+0000" 2024-09-16T07:55:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.068 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.069 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.069 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.069 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.069 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.069 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.069 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.069 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.069 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.069 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.069 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.437850+0000" 2024-09-16T07:55:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.438764+0000" 2024-09-16T07:55:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.070 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.071 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.540388+0000" 2024-09-16T07:55:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.439953+0000" 2024-09-16T07:55:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.072 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.441884+0000" 2024-09-16T07:55:26.073 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.074 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.075 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.444595+0000" 2024-09-16T07:55:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.076 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.077 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.452352+0000" 2024-09-16T07:55:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.078 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.079 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.539776+0000" 2024-09-16T07:55:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.080 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 369, 2024-09-16T07:55:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.462037+0000" 2024-09-16T07:55:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.081 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.462066+0000" 2024-09-16T07:55:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.465581+0000" 2024-09-16T07:55:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.082 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.083 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.467908+0000" 2024-09-16T07:55:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.471044+0000" 2024-09-16T07:55:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.084 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.085 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.085 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.085 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.085 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.085 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.085 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.085 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.085 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.085 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.085 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.085 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.086 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.086 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.086 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.565348+0000" 2024-09-16T07:55:26.086 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.086 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.086 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.086 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.471768+0000" 2024-09-16T07:55:26.086 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.086 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.086 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.086 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.086 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.087 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.087 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.087 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.087 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.087 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.087 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.087 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.087 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.087 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.087 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.087 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.472115+0000" 2024-09-16T07:55:26.087 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.087 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.088 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.088 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.088 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.088 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.088 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.088 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.088 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.088 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.088 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.088 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.088 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.089 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.089 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.089 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.089 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.089 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.089 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.089 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.089 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.089 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.089 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.089 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.089 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.090 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.090 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.090 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.090 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.090 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.090 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.090 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.472774+0000" 2024-09-16T07:55:26.090 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.090 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.090 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.090 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.090 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.091 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.091 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.091 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.091 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.091 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.091 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.091 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.091 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.091 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.092 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.092 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.092 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.092 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.092 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.092 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.092 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.474884+0000" 2024-09-16T07:55:26.092 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.092 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.092 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.092 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.093 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.093 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.093 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.093 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.093 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.093 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.093 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.093 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.094 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.564371+0000" 2024-09-16T07:55:26.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.094 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.094 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.094 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.094 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.094 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.094 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.094 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.094 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.095 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.095 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.095 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 373, 2024-09-16T07:55:26.095 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.095 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.095 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.095 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.499420+0000" 2024-09-16T07:55:26.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.095 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.095 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.096 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.499440+0000" 2024-09-16T07:55:26.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.096 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.096 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.096 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.096 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.096 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.096 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.501737+0000" 2024-09-16T07:55:26.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.096 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.097 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.097 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.097 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.097 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.097 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.097 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.097 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.097 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.098 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.098 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.098 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.502162+0000" 2024-09-16T07:55:26.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.098 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.098 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.098 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.098 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.098 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.098 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.504626+0000" 2024-09-16T07:55:26.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.099 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.099 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.099 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.099 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.099 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.099 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.099 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.099 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.099 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.099 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.100 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.100 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.100 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.100 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.592084+0000" 2024-09-16T07:55:26.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.100 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.100 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.100 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.505103+0000" 2024-09-16T07:55:26.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.100 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.101 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.101 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.101 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.101 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.101 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.101 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.101 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.101 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.101 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.101 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.102 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.102 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.102 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.505301+0000" 2024-09-16T07:55:26.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.102 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.102 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.102 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.102 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.102 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.103 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.103 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.103 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.103 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.103 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.103 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.103 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.103 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.104 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.104 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.104 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.104 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.104 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.104 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.104 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.104 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.105 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.105 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.105 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.505702+0000" 2024-09-16T07:55:26.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.105 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.105 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.105 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.105 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.105 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.105 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.106 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.106 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.106 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.106 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.106 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.106 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.106 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.106 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.107 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.107 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.107 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.107 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.507479+0000" 2024-09-16T07:55:26.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.107 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.107 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.107 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.107 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.108 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.108 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.108 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.108 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.108 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.108 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.108 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.108 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.588704+0000" 2024-09-16T07:55:26.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.108 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.109 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.109 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.109 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.109 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.109 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.109 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.109 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.109 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.109 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.109 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.109 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.110 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 384, 2024-09-16T07:55:26.110 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.110 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.110 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.110 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.568127+0000" 2024-09-16T07:55:26.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.110 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.110 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.110 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.568154+0000" 2024-09-16T07:55:26.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.110 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.110 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.111 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.111 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.111 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.111 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.568888+0000" 2024-09-16T07:55:26.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.111 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.111 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.111 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.111 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.112 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.112 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.112 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.112 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.112 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.570020+0000" 2024-09-16T07:55:26.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.113 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.113 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.113 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.113 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.113 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.113 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.570551+0000" 2024-09-16T07:55:26.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.113 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.113 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.113 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.114 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.114 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.114 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.114 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.114 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.114 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.114 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.114 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.114 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.621496+0000" 2024-09-16T07:55:26.115 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.115 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.115 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.115 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.571272+0000" 2024-09-16T07:55:26.115 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.115 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.115 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.115 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.115 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.115 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.115 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.115 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.116 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.116 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.116 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.116 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.116 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.116 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.571614+0000" 2024-09-16T07:55:26.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.116 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.116 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.117 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.117 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.117 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.117 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.117 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.117 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.117 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.117 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.117 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.118 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.118 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.118 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.118 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.118 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.118 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.118 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.118 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.118 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.119 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.119 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.119 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.119 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.572308+0000" 2024-09-16T07:55:26.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.119 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.119 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.119 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.119 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.120 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.120 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.120 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.120 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.120 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.121 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.121 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.121 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.121 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.121 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.121 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.121 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.576430+0000" 2024-09-16T07:55:26.121 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.121 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.121 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.121 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.122 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.122 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.122 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.122 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.122 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.122 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.122 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.122 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.123 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.620757+0000" 2024-09-16T07:55:26.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.123 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.123 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.123 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.123 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.123 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.123 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.123 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.123 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.124 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.124 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.124 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 386, 2024-09-16T07:55:26.124 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.124 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.124 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.124 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.571589+0000" 2024-09-16T07:55:26.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.124 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.124 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.124 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.571603+0000" 2024-09-16T07:55:26.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.125 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.125 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.125 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.125 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.125 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.125 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.572209+0000" 2024-09-16T07:55:26.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.125 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.125 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.125 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.125 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.126 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.126 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.126 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.126 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.126 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.126 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.126 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.126 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.573245+0000" 2024-09-16T07:55:26.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.126 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.127 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.127 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.127 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.127 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.127 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.573597+0000" 2024-09-16T07:55:26.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.127 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.127 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.127 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.127 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.128 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.128 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.128 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.128 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.128 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.128 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.128 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.128 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.128 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.128 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.649886+0000" 2024-09-16T07:55:26.128 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.129 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.129 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.129 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.574220+0000" 2024-09-16T07:55:26.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.129 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.129 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.129 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.129 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.129 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.130 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.130 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.130 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.130 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.130 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.130 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.130 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.574429+0000" 2024-09-16T07:55:26.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.130 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.130 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.131 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.131 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.131 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.131 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.131 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.131 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.131 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.131 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.131 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.131 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.131 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.132 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.132 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.132 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.132 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.132 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.132 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.132 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.132 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.132 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.132 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.132 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.133 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.133 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.133 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.133 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.133 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.133 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.574833+0000" 2024-09-16T07:55:26.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.133 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.133 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.134 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.134 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.134 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.134 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.134 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.134 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.134 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.134 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.134 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.135 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.135 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.135 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.135 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.135 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.135 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.135 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.580670+0000" 2024-09-16T07:55:26.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.135 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.136 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.136 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.136 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.136 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.136 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.136 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.136 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.136 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.136 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.136 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.136 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.136 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.137 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.137 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.649156+0000" 2024-09-16T07:55:26.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.137 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.137 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.137 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.137 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.137 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.137 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.137 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.137 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.138 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.138 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.138 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.138 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 410, 2024-09-16T07:55:26.138 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.138 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.138 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.138 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.726186+0000" 2024-09-16T07:55:26.138 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.138 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.138 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.139 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.726216+0000" 2024-09-16T07:55:26.139 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.139 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.139 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.139 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.139 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.139 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.139 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.139 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.726450+0000" 2024-09-16T07:55:26.139 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.139 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.139 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.140 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.140 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.140 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.140 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.140 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.140 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.140 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.140 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.141 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.141 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.726936+0000" 2024-09-16T07:55:26.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.141 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.141 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.141 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.141 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.141 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.141 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.728091+0000" 2024-09-16T07:55:26.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.142 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.142 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.142 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.142 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.142 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.142 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.142 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.142 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.142 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.142 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.142 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.143 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.143 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.143 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.143 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.799981+0000" 2024-09-16T07:55:26.143 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.143 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.143 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.143 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.728547+0000" 2024-09-16T07:55:26.143 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.143 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.143 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.143 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.143 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.144 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.144 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.144 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.144 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.144 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.144 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.144 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.144 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.144 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.144 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.144 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.728754+0000" 2024-09-16T07:55:26.145 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.145 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.145 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.145 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.145 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.145 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.145 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.145 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.145 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.145 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.145 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.145 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.146 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.146 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.146 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.146 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.146 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.146 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.146 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.146 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.146 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.146 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.146 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.146 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.147 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.147 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.147 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.147 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.147 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.147 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.147 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.147 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.729288+0000" 2024-09-16T07:55:26.147 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.147 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.147 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.148 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.148 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.148 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.148 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.148 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.148 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.148 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.148 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.149 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.149 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.149 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.149 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.149 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.149 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.149 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.149 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.149 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.149 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.731712+0000" 2024-09-16T07:55:26.149 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.150 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.150 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.150 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.150 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.150 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.150 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.150 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.150 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.150 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.150 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.150 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.151 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.151 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.151 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.151 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.799005+0000" 2024-09-16T07:55:26.151 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.151 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.151 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.151 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.151 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.151 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.151 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.151 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.152 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.152 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.152 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.152 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.152 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.152 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 206, 2024-09-16T07:55:26.152 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.152 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.152 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.152 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.478678+0000" 2024-09-16T07:55:26.152 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.153 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.153 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.153 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.478698+0000" 2024-09-16T07:55:26.153 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.153 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.153 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.153 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.153 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.153 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.153 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.153 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.479122+0000" 2024-09-16T07:55:26.154 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.154 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.154 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.154 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.154 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.154 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.154 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.154 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.154 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.154 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.154 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.154 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.155 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.155 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.155 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.155 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.479423+0000" 2024-09-16T07:55:26.155 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.155 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.155 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.155 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.155 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.155 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.155 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.156 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.480184+0000" 2024-09-16T07:55:26.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.156 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.156 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.156 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.156 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.156 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.156 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.156 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.157 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.157 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.157 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.157 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.157 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.157 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.542047+0000" 2024-09-16T07:55:26.157 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.157 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.157 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.157 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.480846+0000" 2024-09-16T07:55:26.157 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.158 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.158 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.158 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.158 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.158 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.158 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.158 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.158 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.158 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.158 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.158 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.158 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.159 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.159 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.159 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.481086+0000" 2024-09-16T07:55:26.159 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.159 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.159 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.159 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.159 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.159 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.159 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.159 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.160 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.160 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.160 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.160 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.160 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.160 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.160 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.160 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.161 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.161 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.161 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.161 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.161 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.161 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.161 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.161 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.161 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.161 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.162 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.162 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.162 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.481554+0000" 2024-09-16T07:55:26.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.162 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.162 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.162 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.162 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.162 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.162 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.163 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.163 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.163 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.163 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.163 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.163 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.163 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.163 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.163 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.163 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.163 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.163 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.163 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.164 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.164 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.483037+0000" 2024-09-16T07:55:26.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.164 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.164 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.164 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.164 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.164 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.164 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.164 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.164 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.165 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.165 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.165 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.165 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.541026+0000" 2024-09-16T07:55:26.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.165 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.165 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.165 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.165 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.165 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.166 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.166 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.166 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.166 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.166 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.166 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 215, 2024-09-16T07:55:26.166 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.166 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.166 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.167 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.503660+0000" 2024-09-16T07:55:26.167 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.167 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.167 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.167 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.503677+0000" 2024-09-16T07:55:26.167 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.167 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.167 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.167 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.167 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.167 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.167 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.167 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.504107+0000" 2024-09-16T07:55:26.168 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.168 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.168 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.168 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.168 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.168 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.168 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.168 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.168 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.168 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.168 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.169 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.169 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.169 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.169 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.169 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.504888+0000" 2024-09-16T07:55:26.169 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.169 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.169 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.169 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.169 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.169 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.170 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.170 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.506883+0000" 2024-09-16T07:55:26.170 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.170 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.170 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.170 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.170 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.170 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.170 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.170 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.170 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.170 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.171 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.171 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.171 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.171 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.171 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.171 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.569172+0000" 2024-09-16T07:55:26.171 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.171 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.171 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.171 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.507361+0000" 2024-09-16T07:55:26.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.172 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.172 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.172 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.172 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.172 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.172 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.172 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.172 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.172 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.173 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.173 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.173 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.173 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.507566+0000" 2024-09-16T07:55:26.173 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.173 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.173 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.173 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.173 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.173 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.173 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.174 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.174 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.174 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.174 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.174 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.174 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.174 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.174 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.174 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.174 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.174 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.175 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.175 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.175 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.175 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.175 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.175 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.175 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.175 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.175 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.175 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.175 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.175 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.176 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.176 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.507990+0000" 2024-09-16T07:55:26.176 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.176 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.176 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.176 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.176 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.176 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.176 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.176 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.176 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.177 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.177 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.177 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.177 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.177 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.177 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.177 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.177 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.177 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.177 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.177 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.178 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.178 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.178 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.178 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.509467+0000" 2024-09-16T07:55:26.178 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.178 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.178 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.178 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.178 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.178 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.178 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.179 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.179 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.179 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.179 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.179 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.179 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.179 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.179 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.179 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.568170+0000" 2024-09-16T07:55:26.179 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.179 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.180 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.180 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.180 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.180 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.180 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.180 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.180 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.180 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.180 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.180 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.180 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.181 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 268, 2024-09-16T07:55:26.181 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.181 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.181 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.181 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.815791+0000" 2024-09-16T07:55:26.181 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.181 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.181 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.181 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.815821+0000" 2024-09-16T07:55:26.181 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.181 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.181 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.182 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.182 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.182 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.182 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.182 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.816830+0000" 2024-09-16T07:55:26.182 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.182 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.182 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.182 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.182 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.182 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.182 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.183 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.183 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.183 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.183 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.183 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.183 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.183 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.183 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.183 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.817515+0000" 2024-09-16T07:55:26.183 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.183 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.184 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.184 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.184 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.184 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.184 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.184 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.819781+0000" 2024-09-16T07:55:26.184 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.184 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.184 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.184 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.184 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.184 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.185 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.185 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.185 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.185 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.185 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.185 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.185 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.185 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.185 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.185 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.879250+0000" 2024-09-16T07:55:26.185 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.185 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.186 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.186 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.820431+0000" 2024-09-16T07:55:26.186 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.186 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.186 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.186 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.186 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.186 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.186 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.186 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.186 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.187 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.187 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.187 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.187 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.187 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.187 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.187 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.820768+0000" 2024-09-16T07:55:26.187 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.187 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.187 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.187 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.187 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.188 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.188 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.188 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.188 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.188 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.188 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.188 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.188 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.188 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.188 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.188 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.188 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.189 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.189 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.189 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.189 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.189 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.189 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.189 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.189 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.189 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.189 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.189 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.189 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.190 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.190 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.190 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.821424+0000" 2024-09-16T07:55:26.190 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.190 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.190 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.190 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.190 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.190 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.190 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.190 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.190 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.191 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.191 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.191 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.191 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.191 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.191 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.191 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.191 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.191 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.191 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.191 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.192 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.192 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.192 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.192 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.827425+0000" 2024-09-16T07:55:26.192 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.192 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.192 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.192 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.192 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.192 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.192 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.192 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.193 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.193 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.193 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.193 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.193 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.193 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.878233+0000" 2024-09-16T07:55:26.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.193 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.193 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.193 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.194 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.194 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.194 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.194 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.194 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.194 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.194 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.194 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 280, 2024-09-16T07:55:26.194 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.194 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.195 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.195 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.883067+0000" 2024-09-16T07:55:26.195 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.195 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.195 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.195 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.883087+0000" 2024-09-16T07:55:26.195 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.195 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.195 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.195 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.195 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.195 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.196 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.196 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.883319+0000" 2024-09-16T07:55:26.196 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.196 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.196 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.196 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.196 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.196 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.196 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.196 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.196 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.196 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.197 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.197 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.197 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.197 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.197 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.883451+0000" 2024-09-16T07:55:26.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.197 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.197 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.197 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.198 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.198 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.198 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.885941+0000" 2024-09-16T07:55:26.198 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.198 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.198 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.198 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.198 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.198 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.198 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.198 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.198 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.199 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.199 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.199 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.199 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.199 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.199 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.199 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.957268+0000" 2024-09-16T07:55:26.199 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.199 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.199 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.199 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.886692+0000" 2024-09-16T07:55:26.200 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.200 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.200 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.200 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.200 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.200 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.200 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.200 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.200 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.200 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.200 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.201 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.201 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.201 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.201 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.201 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.887050+0000" 2024-09-16T07:55:26.201 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.201 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.201 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.201 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.201 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.201 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.201 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.202 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.202 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.202 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.202 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.202 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.203 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.203 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.203 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.203 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.203 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.203 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.203 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.203 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.203 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.204 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.204 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.204 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.204 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.204 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.204 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.888375+0000" 2024-09-16T07:55:26.204 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.204 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.204 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.204 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.204 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.205 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.205 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.205 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.205 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.205 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.205 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.205 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.205 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.205 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.205 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.206 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.206 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.206 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.206 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.206 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.206 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.206 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.206 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.206 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.892477+0000" 2024-09-16T07:55:26.206 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.207 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.207 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.207 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.207 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.207 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.207 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.207 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.207 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.207 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.208 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.208 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.208 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.956677+0000" 2024-09-16T07:55:26.208 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.208 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.208 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.208 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.208 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.208 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.208 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.209 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.209 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.209 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.209 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.209 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.209 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.209 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 284, 2024-09-16T07:55:26.209 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.209 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.209 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.209 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.899378+0000" 2024-09-16T07:55:26.210 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.210 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.210 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.210 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.899395+0000" 2024-09-16T07:55:26.210 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.210 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.210 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.210 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.210 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.210 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.210 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.211 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.899974+0000" 2024-09-16T07:55:26.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.211 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.211 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.211 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.211 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.211 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.211 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.211 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.212 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.212 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.212 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.212 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.212 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.212 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.902301+0000" 2024-09-16T07:55:26.212 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.212 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.212 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.212 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.213 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.213 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.213 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.213 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.905043+0000" 2024-09-16T07:55:26.213 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.213 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.213 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.213 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.213 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.213 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.213 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.213 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.214 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.214 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.214 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.214 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.214 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.214 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.214 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.214 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.974698+0000" 2024-09-16T07:55:26.214 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.214 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.214 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.215 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.905624+0000" 2024-09-16T07:55:26.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.215 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.215 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.215 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.215 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.215 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.215 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.215 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.215 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.216 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.216 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.216 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.216 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.216 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.905877+0000" 2024-09-16T07:55:26.216 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.216 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.216 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.216 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.216 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.216 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.216 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.217 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.217 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.217 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.217 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.217 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.217 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.217 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.217 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.217 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.217 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.217 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.218 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.218 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.218 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.218 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.218 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.218 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.218 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.218 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.218 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.218 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.218 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.218 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.219 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.219 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.908573+0000" 2024-09-16T07:55:26.219 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.219 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.219 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.219 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.219 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.219 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.219 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.219 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.219 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.219 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.219 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.220 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.220 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.220 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.220 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.220 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.220 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.220 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.220 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.220 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.220 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.220 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.221 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.221 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.910500+0000" 2024-09-16T07:55:26.221 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.221 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.221 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.221 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.221 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.221 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.221 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.221 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.221 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.222 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.222 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.222 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.222 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.222 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.222 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.222 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:24.973814+0000" 2024-09-16T07:55:26.222 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.222 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.222 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.222 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.223 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.223 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.223 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.223 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.223 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.223 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.223 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.223 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.223 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.223 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 325, 2024-09-16T07:55:26.223 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.223 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.224 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.224 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.167882+0000" 2024-09-16T07:55:26.224 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.224 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.224 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.224 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.167899+0000" 2024-09-16T07:55:26.224 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.224 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.224 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.224 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.224 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.225 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.225 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.225 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.168221+0000" 2024-09-16T07:55:26.225 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.225 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.225 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.225 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.225 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.225 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.225 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.225 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.225 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.226 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.226 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.226 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.226 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.226 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.226 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.226 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.168683+0000" 2024-09-16T07:55:26.226 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.226 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.226 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.226 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.227 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.227 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.227 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.227 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.169537+0000" 2024-09-16T07:55:26.227 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.227 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.227 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.227 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.227 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.227 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.227 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.227 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.228 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.228 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.228 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.228 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.228 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.228 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.228 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.228 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.228680+0000" 2024-09-16T07:55:26.228 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.228 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.228 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.228 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.170080+0000" 2024-09-16T07:55:26.228 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.229 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.229 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.229 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.229 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.229 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.229 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.229 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.229 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.229 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.229 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.229 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.229 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.230 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.230 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.230 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.170287+0000" 2024-09-16T07:55:26.230 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.230 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.230 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.230 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.230 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.230 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.230 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.230 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.231 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.231 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.231 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.231 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.231 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.231 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.231 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.231 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.231 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.231 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.231 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.232 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.232 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.232 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.232 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.232 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.232 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.232 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.232 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.232 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.232 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.232 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.233 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.233 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.170681+0000" 2024-09-16T07:55:26.233 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.233 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.233 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.233 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.233 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.233 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.233 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.233 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.233 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.234 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.234 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.234 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.234 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.234 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.234 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.234 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.234 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.234 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.234 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.234 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.235 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.235 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.235 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.235 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.172274+0000" 2024-09-16T07:55:26.235 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.235 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.235 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.235 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.235 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.235 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.235 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.236 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.236 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.236 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.236 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.236 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.236 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.236 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.236 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.236 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.228105+0000" 2024-09-16T07:55:26.236 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.236 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.237 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.237 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.237 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.237 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.237 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.237 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.237 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.237 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.237 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.237 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.237 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.238 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 340, 2024-09-16T07:55:26.238 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.238 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.238 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.238 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.264103+0000" 2024-09-16T07:55:26.238 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.238 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.238 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.238 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.264131+0000" 2024-09-16T07:55:26.238 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.238 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.239 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.239 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.239 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.239 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.239 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.239 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.264383+0000" 2024-09-16T07:55:26.239 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.239 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.239 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.239 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.239 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.239 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.240 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.240 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.240 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.240 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.240 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.240 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.240 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.240 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.240 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.240 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.264557+0000" 2024-09-16T07:55:26.240 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.241 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.241 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.241 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.241 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.241 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.241 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.241 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.264959+0000" 2024-09-16T07:55:26.241 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.241 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.241 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.241 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.241 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.242 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.242 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.242 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.242 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.242 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.242 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.242 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.242 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.242 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.242 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.242 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.319518+0000" 2024-09-16T07:55:26.243 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.243 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.243 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.243 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.265426+0000" 2024-09-16T07:55:26.243 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.243 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.243 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.243 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.243 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.243 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.243 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.244 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.244 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.244 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.244 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.244 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.244 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.244 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.244 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.244 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.265643+0000" 2024-09-16T07:55:26.244 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.244 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.245 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.245 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.245 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.245 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.245 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.245 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.245 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.245 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.245 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.245 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.246 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.246 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.246 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.246 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.246 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.246 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.246 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.246 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.246 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.246 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.246 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.246 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.246 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.247 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.247 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.247 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.247 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.247 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.247 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.247 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.266067+0000" 2024-09-16T07:55:26.247 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.247 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.247 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.247 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.247 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.247 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.248 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.248 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.248 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.248 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.248 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.248 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.248 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.248 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.248 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.248 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.249 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.249 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.249 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.249 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.249 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.249 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.249 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.249 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.267694+0000" 2024-09-16T07:55:26.249 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.249 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.250 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.250 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.250 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.250 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.250 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.250 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.250 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.250 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.250 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.250 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.250 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.250 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.251 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.251 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.316546+0000" 2024-09-16T07:55:26.251 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.251 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.251 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.251 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.251 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.251 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.251 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.251 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.251 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.252 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.252 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.252 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.252 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.252 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 345, 2024-09-16T07:55:26.252 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.252 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.252 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.252 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.316340+0000" 2024-09-16T07:55:26.252 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.252 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.252 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.253 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.316371+0000" 2024-09-16T07:55:26.253 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.253 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.253 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.253 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.253 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.253 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.253 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.253 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.316637+0000" 2024-09-16T07:55:26.253 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.254 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.254 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.254 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.254 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.254 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.254 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.254 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.254 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.254 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.254 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.254 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.254 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.255 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.255 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.255 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.316842+0000" 2024-09-16T07:55:26.255 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.255 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.255 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.255 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.255 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.255 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.255 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.255 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.319823+0000" 2024-09-16T07:55:26.256 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.256 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.256 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.256 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.256 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.256 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.256 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.256 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.256 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.256 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.256 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.257 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.257 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.257 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.257 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.257 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.410483+0000" 2024-09-16T07:55:26.257 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.257 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.257 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.257 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.320495+0000" 2024-09-16T07:55:26.257 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.257 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.257 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.258 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.258 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.258 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.258 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.258 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.258 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.258 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.258 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.258 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.258 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.258 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.258 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.259 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.320820+0000" 2024-09-16T07:55:26.259 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.259 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.259 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.259 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.259 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.259 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.259 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.259 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.259 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.259 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.260 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.260 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.260 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.260 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.260 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.260 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.260 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.260 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.260 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.260 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.260 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.260 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.261 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.261 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.261 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.261 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.261 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.261 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.261 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.261 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.261 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.261 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.321584+0000" 2024-09-16T07:55:26.261 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.262 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.262 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.262 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.262 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.262 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.262 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.262 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.262 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.262 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.262 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.262 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.262 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.263 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.263 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.263 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.263 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.263 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.263 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.263 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.263 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.263 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.263 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.263 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.323385+0000" 2024-09-16T07:55:26.264 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.264 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.264 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.264 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.264 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.264 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.264 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.264 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.264 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.264 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.264 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.264 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.265 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.265 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.265 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.265 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.408932+0000" 2024-09-16T07:55:26.265 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.265 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.265 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.265 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.265 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.265 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.265 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.266 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.266 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.266 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.266 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.266 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.266 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.266 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 351, 2024-09-16T07:55:26.266 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.266 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.266 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.266 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.348251+0000" 2024-09-16T07:55:26.267 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.267 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.267 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.267 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.348269+0000" 2024-09-16T07:55:26.267 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.267 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.267 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.267 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.267 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.267 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.267 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.268 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.349105+0000" 2024-09-16T07:55:26.268 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.268 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.268 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.268 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.268 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.268 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.268 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.268 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.268 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.268 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.269 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.269 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.269 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.269 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.269 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.269 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.350487+0000" 2024-09-16T07:55:26.269 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.269 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.269 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.269 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.269 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.269 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.270 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.270 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.351839+0000" 2024-09-16T07:55:26.270 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.270 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.270 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.270 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.270 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.270 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.270 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.270 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.270 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.270 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.271 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.271 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.271 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.271 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.271 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.271 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.441478+0000" 2024-09-16T07:55:26.271 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.271 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.271 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.271 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.352568+0000" 2024-09-16T07:55:26.271 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.272 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.272 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.272 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.272 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.272 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.272 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.272 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.272 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.272 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.272 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.272 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.273 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.273 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.273 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.273 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.352923+0000" 2024-09-16T07:55:26.273 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.273 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.273 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.273 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.273 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.273 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.274 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.274 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.274 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.274 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.274 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.274 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.274 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.274 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.274 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.274 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.274 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.274 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.275 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.275 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.275 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.275 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.275 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.275 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.275 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.275 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.275 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.275 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.275 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.276 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.276 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.276 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.353680+0000" 2024-09-16T07:55:26.276 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.276 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.276 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.276 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.276 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.276 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.276 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.276 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.277 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.277 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.277 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.277 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.277 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.277 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.277 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.277 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.277 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.277 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.277 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.278 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.278 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.278 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.278 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.278 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.355817+0000" 2024-09-16T07:55:26.278 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.278 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.278 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.278 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.278 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.278 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.279 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.279 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.279 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.279 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.279 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.279 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.279 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.279 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.279 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.279 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.440883+0000" 2024-09-16T07:55:26.279 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.279 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.279 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.280 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.280 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.280 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.280 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.280 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.280 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.280 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.280 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.280 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.280 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.280 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 359, 2024-09-16T07:55:26.281 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.281 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.281 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.281 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.394358+0000" 2024-09-16T07:55:26.281 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.281 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.281 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.281 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.394377+0000" 2024-09-16T07:55:26.281 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.281 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.281 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.282 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.282 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.282 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.282 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.282 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.401182+0000" 2024-09-16T07:55:26.282 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.282 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.282 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.282 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.282 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.282 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.283 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.283 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.283 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.283 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.283 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.283 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.283 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.283 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.283 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.283 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.403851+0000" 2024-09-16T07:55:26.283 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.284 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.284 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.284 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.284 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.284 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.284 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.284 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.408466+0000" 2024-09-16T07:55:26.284 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.284 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.284 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.284 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.284 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.285 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.285 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.285 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.285 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.285 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.285 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.285 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.285 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.285 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.285 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.285 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.482867+0000" 2024-09-16T07:55:26.285 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.286 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.286 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.286 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.409341+0000" 2024-09-16T07:55:26.286 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.286 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.286 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.286 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.286 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.286 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.286 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.286 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.287 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.287 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.287 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.287 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.287 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.287 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.287 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.287 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.409662+0000" 2024-09-16T07:55:26.287 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.287 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.287 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.287 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.288 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.288 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.288 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.288 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.288 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.288 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.288 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.288 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.288 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.288 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.288 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.288 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.289 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.289 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.289 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.289 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.289 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.289 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.289 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.289 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.289 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.289 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.289 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.290 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.290 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.290 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.290 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.290 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.410502+0000" 2024-09-16T07:55:26.290 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.290 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.290 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.290 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.290 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.290 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.291 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.291 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.291 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.291 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.291 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.291 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.291 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.291 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.291 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.291 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.291 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.292 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.292 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.292 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.292 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.292 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.292 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.292 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.412237+0000" 2024-09-16T07:55:26.292 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.292 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.292 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.292 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.292 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.293 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.293 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.293 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.293 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.293 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.293 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.293 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.293 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.293 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.293 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.293 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.481878+0000" 2024-09-16T07:55:26.294 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.294 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.294 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.294 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.294 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.294 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.294 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.294 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.294 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.294 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.295 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.295 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.295 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.295 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 360, 2024-09-16T07:55:26.295 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.295 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.295 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.295 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.413009+0000" 2024-09-16T07:55:26.295 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.295 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.295 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.296 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.413028+0000" 2024-09-16T07:55:26.296 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.296 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.296 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.296 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.296 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.296 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.296 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.296 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.413401+0000" 2024-09-16T07:55:26.296 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.296 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.296 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.297 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.297 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.297 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.297 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.297 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.297 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.297 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.297 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.297 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.297 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.297 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.298 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.298 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.413683+0000" 2024-09-16T07:55:26.298 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.298 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.298 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.298 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.298 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.298 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.298 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.298 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.416674+0000" 2024-09-16T07:55:26.298 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.299 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.299 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.299 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.299 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.299 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.299 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.299 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.299 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.299 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.299 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.299 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.299 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.300 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.300 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.300 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.530334+0000" 2024-09-16T07:55:26.300 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.300 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.300 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.300 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.417345+0000" 2024-09-16T07:55:26.300 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.300 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.300 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.300 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.301 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.417741+0000" 2024-09-16T07:55:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.302 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.303 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.418451+0000" 2024-09-16T07:55:26.304 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.305 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.306 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.422077+0000" 2024-09-16T07:55:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.307 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.529299+0000" 2024-09-16T07:55:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.308 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 376, 2024-09-16T07:55:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.309 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.509706+0000" 2024-09-16T07:55:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.509724+0000" 2024-09-16T07:55:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.310 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.511675+0000" 2024-09-16T07:55:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.311 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.514335+0000" 2024-09-16T07:55:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.312 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.519654+0000" 2024-09-16T07:55:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.313 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.598467+0000" 2024-09-16T07:55:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.314 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.520356+0000" 2024-09-16T07:55:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.315 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.520676+0000" 2024-09-16T07:55:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.316 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.317 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.318 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.521428+0000" 2024-09-16T07:55:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.319 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.523837+0000" 2024-09-16T07:55:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.597803+0000" 2024-09-16T07:55:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 380, 2024-09-16T07:55:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.540186+0000" 2024-09-16T07:55:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.540199+0000" 2024-09-16T07:55:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.540363+0000" 2024-09-16T07:55:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.325 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.541365+0000" 2024-09-16T07:55:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.543367+0000" 2024-09-16T07:55:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.327 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.612475+0000" 2024-09-16T07:55:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.543893+0000" 2024-09-16T07:55:26.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.329 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.544146+0000" 2024-09-16T07:55:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.331 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.332 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.544833+0000" 2024-09-16T07:55:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.333 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.549130+0000" 2024-09-16T07:55:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.335 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.336 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.610507+0000" 2024-09-16T07:55:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.337 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 392, 2024-09-16T07:55:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.607299+0000" 2024-09-16T07:55:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.607327+0000" 2024-09-16T07:55:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.607759+0000" 2024-09-16T07:55:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.339 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.608284+0000" 2024-09-16T07:55:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.610612+0000" 2024-09-16T07:55:26.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.680528+0000" 2024-09-16T07:55:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.612004+0000" 2024-09-16T07:55:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.343 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.612644+0000" 2024-09-16T07:55:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.345 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.347 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.613356+0000" 2024-09-16T07:55:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.348 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.615065+0000" 2024-09-16T07:55:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.350 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.676624+0000" 2024-09-16T07:55:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 395, 2024-09-16T07:55:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.352 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.634992+0000" 2024-09-16T07:55:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.635014+0000" 2024-09-16T07:55:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.353 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.354 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.638380+0000" 2024-09-16T07:55:26.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.354 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.354 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.354 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.354 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.355 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.355 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.639168+0000" 2024-09-16T07:55:26.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.355 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.355 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.356 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.640169+0000" 2024-09-16T07:55:26.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.356 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.356 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.356 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.356 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.357 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.357 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.706403+0000" 2024-09-16T07:55:26.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.357 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.640589+0000" 2024-09-16T07:55:26.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.358 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.358 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.358 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.358 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.358 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.359 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.640788+0000" 2024-09-16T07:55:26.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.359 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.359 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.360 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.360 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.360 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.360 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.360 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.360 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.361 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.361 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.361 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.361 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.361 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.361 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.641200+0000" 2024-09-16T07:55:26.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.362 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.362 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.362 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.363 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.363 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.364 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.364 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.642773+0000" 2024-09-16T07:55:26.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.364 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.364 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.364 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.364 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.365 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.365 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.705809+0000" 2024-09-16T07:55:26.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.365 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.366 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.366 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.366 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.366 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.366 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T07:55:26.366 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T07:55:26.366 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 402, 2024-09-16T07:55:26.366 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T07:55:26.366 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:55:26.367 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.673166+0000" 2024-09-16T07:55:26.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.367 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:55:26.367 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.673185+0000" 2024-09-16T07:55:26.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.367 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.367 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.368 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:55:26.368 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.674441+0000" 2024-09-16T07:55:26.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.368 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.368 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.368 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:55:26.369 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.369 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.369 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.369 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:55:26.369 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.676537+0000" 2024-09-16T07:55:26.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.369 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.369 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.370 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:55:26.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.680744+0000" 2024-09-16T07:55:26.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.370 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.370 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:55:26.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.371 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.371 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.371 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.371 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.764670+0000" 2024-09-16T07:55:26.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.371 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:55:26.372 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.681425+0000" 2024-09-16T07:55:26.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.372 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.372 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.372 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:55:26.372 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.373 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.373 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.373 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:55:26.373 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.682274+0000" 2024-09-16T07:55:26.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.373 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.373 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.374 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:55:26.374 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.374 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.374 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.374 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:55:26.374 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.375 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.375 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.375 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:55:26.375 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.375 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.376 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:55:26.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.685560+0000" 2024-09-16T07:55:26.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.376 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.376 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:55:26.377 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.377 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.377 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.377 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:55:26.377 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.377 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.378 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:55:26.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.688423+0000" 2024-09-16T07:55:26.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.378 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.378 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:55:26.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.379 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.379 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T07:55:26.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:55:26.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T07:55:25.763892+0000" 2024-09-16T07:55:26.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.379 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:55:26.380 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T07:55:26.380 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T07:55:26.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:55:26.380 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T07:55:26.380 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.380 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.380 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T07:55:26.380 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T07:55:26.380 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T07:55:26.382 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 58 16 6225 6209 6.69005 12.3125 0.0492982 0.149352 2024-09-16T07:55:26.806 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:55:26.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:26.954+0000 7f794eac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:26.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:26.966+0000 7f794eac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:27.166 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 59 16 6432 6416 6.79592 12.9375 0.0881539 0.147051 2024-09-16T07:55:28.166 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:55:28.168590+0000 min lat: 0.0164785 max lat: 25.2514 avg lat: 0.145183 2024-09-16T07:55:28.167 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:55:28.167 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 60 16 6624 6608 6.88263 12 0.0625006 0.145183 2024-09-16T07:55:29.166 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 61 16 6824 6808 6.9747 12.5 0.0509454 0.143283 2024-09-16T07:55:29.421 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:55:29.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:29.602+0000 7f4018511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:29.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:29.614+0000 7f4018511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:30.167 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 62 16 7012 6996 7.0517 11.75 0.0827844 0.141695 2024-09-16T07:55:31.167 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 63 16 7209 7193 7.13518 12.3125 0.103653 0.140069 2024-09-16T07:55:31.384 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [2, 1, 3, 0] 2024-09-16T07:55:31.384 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:55:31.385 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:55:31.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:31.541+0000 7fad54b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:31.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:31.552+0000 7fad54b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:31.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:55:31.894 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:55:31.911 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-09-16T07:55:30.423421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":375718440,"num_objects":5728,"num_object_clones":0,"num_object_copies":17184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5804,"num_write_kb":367443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5779,"ondisk_log_size":5779,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":259304,"kb_used_data":70056,"kb_used_omap":0,"kb_used_meta":189184,"kb_avail":377228056,"statfs":{"total":386547056640,"available":386281529344,"internally_reserved":0,"allocated":71737344,"data_stored":1093901837,"data_compressed":51882921,"data_compressed_allocated":68296704,"data_compressed_original":1092501504,"omap_allocated":0,"internal_metadata":193724416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15663104,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":15296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.401818"},"pg_stats":[{"pgid":"6.f","version":"100'366","reported_seq":378,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:59.306080+0000","last_change":"2024-09-16T07:54:27.190851+0000","last_active":"2024-09-16T07:54:59.306080+0000","last_peered":"2024-09-16T07:54:59.306080+0000","last_clean":"2024-09-16T07:54:59.306080+0000","last_became_active":"2024-09-16T07:54:27.182196+0000","last_became_peered":"2024-09-16T07:54:27.182196+0000","last_unstale":"2024-09-16T07:54:59.306080+0000","last_undegraded":"2024-09-16T07:54:59.306080+0000","last_fullsized":"2024-09-16T07:54:59.306080+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23986176,"num_objects":366,"num_object_clones":0,"num_object_copies":1098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":366,"num_write_kb":23424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"103'417","reported_seq":448,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-16T07:55:27.026994+0000","last_change":"2024-09-16T07:55:24.345534+0000","last_active":"2024-09-16T07:55:27.026994+0000","last_peered":"2024-09-16T07:55:27.026994+0000","last_clean":"2024-09-16T07:55:27.026994+0000","last_became_active":"2024-09-16T07:55:24.159978+0000","last_became_peered":"2024-09-16T07:55:24.159978+0000","last_unstale":"2024-09-16T07:55:27.026994+0000","last_undegraded":"2024-09-16T07:55:27.026994+0000","last_fullsized":"2024-09-16T07:55:27.026994+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27328512,"num_objects":417,"num_object_clones":0,"num_object_copies":1251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"103'395","reported_seq":424,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-16T07:55:27.002816+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:55:27.002816+0000","last_peered":"2024-09-16T07:55:27.002816+0000","last_clean":"2024-09-16T07:55:27.002816+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:55:27.002816+0000","last_undegraded":"2024-09-16T07:55:27.002816+0000","last_fullsized":"2024-09-16T07:55:27.002816+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25886720,"num_objects":395,"num_object_clones":0,"num_object_copies":1185,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":395,"num_write_kb":25280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"100'380","reported_seq":392,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:59.191131+0000","last_change":"2024-09-16T07:54:27.197656+0000","last_active":"2024-09-16T07:54:59.191131+0000","last_peered":"2024-09-16T07:54:59.191131+0000","last_clean":"2024-09-16T07:54:59.191131+0000","last_became_active":"2024-09-16T07:54:27.186041+0000","last_became_peered":"2024-09-16T07:54:27.186041+0000","last_unstale":"2024-09-16T07:54:59.191131+0000","last_undegraded":"2024-09-16T07:54:59.191131+0000","last_fullsized":"2024-09-16T07:54:59.191131+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24903680,"num_objects":380,"num_object_clones":0,"num_object_copies":1140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":380,"num_write_kb":24320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"103'384","reported_seq":405,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-16T07:55:27.061887+0000","last_change":"2024-09-16T07:54:27.244356+0000","last_active":"2024-09-16T07:55:27.061887+0000","last_peered":"2024-09-16T07:55:27.061887+0000","last_clean":"2024-09-16T07:55:27.061887+0000","last_became_active":"2024-09-16T07:54:27.226887+0000","last_became_peered":"2024-09-16T07:54:27.226887+0000","last_unstale":"2024-09-16T07:55:27.061887+0000","last_undegraded":"2024-09-16T07:55:27.061887+0000","last_fullsized":"2024-09-16T07:55:27.061887+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":384,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"100'337","reported_seq":349,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:58.991393+0000","last_change":"2024-09-16T07:54:27.286418+0000","last_active":"2024-09-16T07:54:58.991393+0000","last_peered":"2024-09-16T07:54:58.991393+0000","last_clean":"2024-09-16T07:54:58.991393+0000","last_became_active":"2024-09-16T07:54:27.270873+0000","last_became_peered":"2024-09-16T07:54:27.270873+0000","last_unstale":"2024-09-16T07:54:58.991393+0000","last_undegraded":"2024-09-16T07:54:58.991393+0000","last_fullsized":"2024-09-16T07:54:58.991393+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22085632,"num_objects":337,"num_object_clones":0,"num_object_copies":1011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":21568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"100'389","reported_seq":401,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:59.216578+0000","last_change":"2024-09-16T07:54:27.210146+0000","last_active":"2024-09-16T07:54:59.216578+0000","last_peered":"2024-09-16T07:54:59.216578+0000","last_clean":"2024-09-16T07:54:59.216578+0000","last_became_active":"2024-09-16T07:54:27.202101+0000","last_became_peered":"2024-09-16T07:54:27.202101+0000","last_unstale":"2024-09-16T07:54:59.216578+0000","last_undegraded":"2024-09-16T07:54:59.216578+0000","last_fullsized":"2024-09-16T07:54:59.216578+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"100'251","reported_seq":263,"reported_epoch":100,"state":"stale+active+clean","last_fresh":"2024-09-16T07:54:50.475272+0000","last_change":"2024-09-16T07:54:27.256819+0000","last_active":"2024-09-16T07:54:50.475272+0000","last_peered":"2024-09-16T07:54:50.475272+0000","last_clean":"2024-09-16T07:54:50.475272+0000","last_became_active":"2024-09-16T07:54:27.243741+0000","last_became_peered":"2024-09-16T07:54:27.243741+0000","last_unstale":"2024-09-16T07:55:22.060483+0000","last_undegraded":"2024-09-16T07:54:50.475272+0000","last_fullsized":"2024-09-16T07:54:50.475272+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16449536,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":16064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"100'259","reported_seq":271,"reported_epoch":100,"state":"stale+active+clean","last_fresh":"2024-09-16T07:54:50.505728+0000","last_change":"2024-09-16T07:54:27.295100+0000","last_active":"2024-09-16T07:54:50.505728+0000","last_peered":"2024-09-16T07:54:50.505728+0000","last_clean":"2024-09-16T07:54:50.505728+0000","last_became_active":"2024-09-16T07:54:27.279086+0000","last_became_peered":"2024-09-16T07:54:27.279086+0000","last_unstale":"2024-09-16T07:55:22.060501+0000","last_undegraded":"2024-09-16T07:54:50.505728+0000","last_fullsized":"2024-09-16T07:54:50.505728+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16973824,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":16576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":296,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.021677+0000","last_change":"2024-09-16T07:54:04.226137+0000","last_active":"2024-09-16T07:54:28.021677+0000","last_peered":"2024-09-16T07:54:28.021677+0000","last_clean":"2024-09-16T07:54:28.021677+0000","last_became_active":"2024-09-16T07:54:04.213409+0000","last_became_peered":"2024-09-16T07:54:04.213409+0000","last_unstale":"2024-09-16T07:54:28.021677+0000","last_undegraded":"2024-09-16T07:54:28.021677+0000","last_fullsized":"2024-09-16T07:54:28.021677+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":272,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-16T07:55:24.051865+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:55:24.051865+0000","last_peered":"2024-09-16T07:55:24.051865+0000","last_clean":"2024-09-16T07:55:24.051865+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:55:24.051865+0000","last_undegraded":"2024-09-16T07:55:24.051865+0000","last_fullsized":"2024-09-16T07:55:24.051865+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"100'365","reported_seq":377,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:59.215350+0000","last_change":"2024-09-16T07:54:27.267114+0000","last_active":"2024-09-16T07:54:59.215350+0000","last_peered":"2024-09-16T07:54:59.215350+0000","last_clean":"2024-09-16T07:54:59.215350+0000","last_became_active":"2024-09-16T07:54:27.258014+0000","last_became_peered":"2024-09-16T07:54:27.258014+0000","last_unstale":"2024-09-16T07:54:59.215350+0000","last_undegraded":"2024-09-16T07:54:59.215350+0000","last_fullsized":"2024-09-16T07:54:59.215350+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":23360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":100,"state":"stale+active+clean","last_fresh":"2024-09-16T07:54:28.022639+0000","last_change":"2024-09-16T07:52:53.063038+0000","last_active":"2024-09-16T07:54:28.022639+0000","last_peered":"2024-09-16T07:54:28.022639+0000","last_clean":"2024-09-16T07:54:28.022639+0000","last_became_active":"2024-09-16T07:52:52.211690+0000","last_became_peered":"2024-09-16T07:52:52.211690+0000","last_unstale":"2024-09-16T07:55:22.060510+0000","last_undegraded":"2024-09-16T07:54:28.022639+0000","last_fullsized":"2024-09-16T07:54:28.022639+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"100'391","reported_seq":403,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:59.166481+0000","last_change":"2024-09-16T07:54:27.222094+0000","last_active":"2024-09-16T07:54:59.166481+0000","last_peered":"2024-09-16T07:54:59.166481+0000","last_clean":"2024-09-16T07:54:59.166481+0000","last_became_active":"2024-09-16T07:54:27.217304+0000","last_became_peered":"2024-09-16T07:54:27.217304+0000","last_unstale":"2024-09-16T07:54:59.166481+0000","last_undegraded":"2024-09-16T07:54:59.166481+0000","last_fullsized":"2024-09-16T07:54:59.166481+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25624576,"num_objects":391,"num_object_clones":0,"num_object_copies":1173,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":25024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":253,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-16T07:55:24.040760+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:55:24.040760+0000","last_peered":"2024-09-16T07:55:24.040760+0000","last_clean":"2024-09-16T07:55:24.040760+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:55:24.040760+0000","last_undegraded":"2024-09-16T07:55:24.040760+0000","last_fullsized":"2024-09-16T07:55:24.040760+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"100'375","reported_seq":387,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:59.150736+0000","last_change":"2024-09-16T07:54:27.230732+0000","last_active":"2024-09-16T07:54:59.150736+0000","last_peered":"2024-09-16T07:54:59.150736+0000","last_clean":"2024-09-16T07:54:59.150736+0000","last_became_active":"2024-09-16T07:54:27.224955+0000","last_became_peered":"2024-09-16T07:54:27.224955+0000","last_unstale":"2024-09-16T07:54:59.150736+0000","last_undegraded":"2024-09-16T07:54:59.150736+0000","last_fullsized":"2024-09-16T07:54:59.150736+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24576000,"num_objects":375,"num_object_clones":0,"num_object_copies":1125,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":24000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":180,"reported_epoch":100,"state":"stale+active+clean","last_fresh":"2024-09-16T07:54:28.028338+0000","last_change":"2024-09-16T07:52:53.063711+0000","last_active":"2024-09-16T07:54:28.028338+0000","last_peered":"2024-09-16T07:54:28.028338+0000","last_clean":"2024-09-16T07:54:28.028338+0000","last_became_active":"2024-09-16T07:52:52.237617+0000","last_became_peered":"2024-09-16T07:52:52.237617+0000","last_unstale":"2024-09-16T07:55:22.060513+0000","last_undegraded":"2024-09-16T07:54:28.028338+0000","last_fullsized":"2024-09-16T07:54:28.028338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"100'391","reported_seq":403,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:58.968748+0000","last_change":"2024-09-16T07:54:27.288961+0000","last_active":"2024-09-16T07:54:58.968748+0000","last_peered":"2024-09-16T07:54:58.968748+0000","last_clean":"2024-09-16T07:54:58.968748+0000","last_became_active":"2024-09-16T07:54:27.264185+0000","last_became_peered":"2024-09-16T07:54:27.264185+0000","last_unstale":"2024-09-16T07:54:58.968748+0000","last_undegraded":"2024-09-16T07:54:58.968748+0000","last_fullsized":"2024-09-16T07:54:58.968748+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25624576,"num_objects":391,"num_object_clones":0,"num_object_copies":1173,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":391,"num_write_kb":25024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.031002+0000","last_change":"2024-09-16T07:54:05.032160+0000","last_active":"2024-09-16T07:54:28.031002+0000","last_peered":"2024-09-16T07:54:28.031002+0000","last_clean":"2024-09-16T07:54:28.031002+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:54:28.031002+0000","last_undegraded":"2024-09-16T07:54:28.031002+0000","last_fullsized":"2024-09-16T07:54:28.031002+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"100'370","reported_seq":382,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:59.119427+0000","last_change":"2024-09-16T07:54:27.244832+0000","last_active":"2024-09-16T07:54:59.119427+0000","last_peered":"2024-09-16T07:54:59.119427+0000","last_clean":"2024-09-16T07:54:59.119427+0000","last_became_active":"2024-09-16T07:54:27.237065+0000","last_became_peered":"2024-09-16T07:54:27.237065+0000","last_unstale":"2024-09-16T07:54:59.119427+0000","last_undegraded":"2024-09-16T07:54:59.119427+0000","last_fullsized":"2024-09-16T07:54:59.119427+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":23680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.024640+0000","last_change":"2024-09-16T07:54:05.026553+0000","last_active":"2024-09-16T07:54:28.024640+0000","last_peered":"2024-09-16T07:54:28.024640+0000","last_clean":"2024-09-16T07:54:28.024640+0000","last_became_active":"2024-09-16T07:54:04.222017+0000","last_became_peered":"2024-09-16T07:54:04.222017+0000","last_unstale":"2024-09-16T07:54:28.024640+0000","last_undegraded":"2024-09-16T07:54:28.024640+0000","last_fullsized":"2024-09-16T07:54:28.024640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"103'370","reported_seq":392,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-16T07:55:26.995775+0000","last_change":"2024-09-16T07:55:24.226144+0000","last_active":"2024-09-16T07:55:26.995775+0000","last_peered":"2024-09-16T07:55:26.995775+0000","last_clean":"2024-09-16T07:55:26.995775+0000","last_became_active":"2024-09-16T07:55:24.208517+0000","last_became_peered":"2024-09-16T07:55:24.208517+0000","last_unstale":"2024-09-16T07:55:26.995775+0000","last_undegraded":"2024-09-16T07:55:26.995775+0000","last_fullsized":"2024-09-16T07:55:26.995775+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":23680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":262,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-16T07:54:28.023386+0000","last_change":"2024-09-16T07:54:05.028346+0000","last_active":"2024-09-16T07:54:28.023386+0000","last_peered":"2024-09-16T07:54:28.023386+0000","last_clean":"2024-09-16T07:54:28.023386+0000","last_became_active":"2024-09-16T07:54:04.172466+0000","last_became_peered":"2024-09-16T07:54:04.172466+0000","last_unstale":"2024-09-16T07:54:28.023386+0000","last_undegraded":"2024-09-16T07:54:28.023386+0000","last_fullsized":"2024-09-16T07:54:28.023386+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"100'284","reported_seq":296,"reported_epoch":100,"state":"stale+active+clean","last_fresh":"2024-09-16T07:54:50.385644+0000","last_change":"2024-09-16T07:54:27.314798+0000","last_active":"2024-09-16T07:54:50.385644+0000","last_peered":"2024-09-16T07:54:50.385644+0000","last_clean":"2024-09-16T07:54:50.385644+0000","last_became_active":"2024-09-16T07:54:27.306364+0000","last_became_peered":"2024-09-16T07:54:27.306364+0000","last_unstale":"2024-09-16T07:55:22.060517+0000","last_undegraded":"2024-09-16T07:54:50.385644+0000","last_fullsized":"2024-09-16T07:54:50.385644+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18612224,"num_objects":284,"num_object_clones":0,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":284,"num_write_kb":18176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":264,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-16T07:55:24.147956+0000","last_change":"2024-09-16T07:55:24.149536+0000","last_active":"2024-09-16T07:55:24.147956+0000","last_peered":"2024-09-16T07:55:24.147956+0000","last_clean":"2024-09-16T07:54:28.031013+0000","last_became_active":"2024-09-16T07:55:24.142290+0000","last_became_peered":"2024-09-16T07:55:24.142290+0000","last_unstale":"2024-09-16T07:55:24.147956+0000","last_undegraded":"2024-09-16T07:55:24.147956+0000","last_fullsized":"2024-09-16T07:55:24.147956+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":375128064,"num_objects":5724,"num_object_clones":0,"num_object_copies":17172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5724,"num_write_kb":366336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":68759552,"data_stored":1100152832,"data_compressed":52237814,"data_compressed_allocated":68759552,"data_compressed_original":1100152832,"omap_allocated":0,"internal_metadata":0},"log_size":5724,"ondisk_log_size":5724,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122108,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55208,"kb_used_data":17240,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94316632,"statfs":{"total":96636764160,"available":96580231168,"internally_reserved":0,"allocated":17653760,"data_stored":269032761,"data_compressed":12760432,"data_compressed_allocated":16797696,"data_compressed_original":268681216,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103406,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67976,"kb_used_data":17080,"kb_used_omap":0,"kb_used_meta":50880,"kb_avail":94303864,"statfs":{"total":96636764160,"available":96567156736,"internally_reserved":0,"allocated":17489920,"data_stored":266345804,"data_compressed":12632897,"data_compressed_allocated":16629760,"data_compressed_original":265994240,"omap_allocated":0,"internal_metadata":52101120},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612816,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79496,"kb_used_data":21048,"kb_used_omap":0,"kb_used_meta":58432,"kb_avail":94292344,"statfs":{"total":96636764160,"available":96555360256,"internally_reserved":0,"allocated":21553152,"data_stored":331367996,"data_compressed":15717819,"data_compressed_allocated":20688896,"data_compressed_original":331022336,"omap_allocated":0,"internal_metadata":59834368},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":80,"seq":343597383799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56624,"kb_used_data":14688,"kb_used_omap":0,"kb_used_meta":41920,"kb_avail":94315216,"statfs":{"total":96636764160,"available":96578781184,"internally_reserved":0,"allocated":15040512,"data_stored":227155276,"data_compressed":10771773,"data_compressed_allocated":14180352,"data_compressed_original":226803712,"omap_allocated":0,"internal_metadata":42926080},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14196736,"data_stored":227147776,"data_compressed":10785300,"data_compressed_allocated":14196736,"data_compressed_original":227147776,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21217280,"data_stored":339476480,"data_compressed":16119267,"data_compressed_allocated":21217280,"data_compressed_original":339476480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16588800,"data_stored":265420800,"data_compressed":12602856,"data_compressed_allocated":16588800,"data_compressed_original":265420800,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16756736,"data_stored":268107776,"data_compressed":12730391,"data_compressed_allocated":16756736,"data_compressed_original":268107776,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:55:32.031 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:55:32.167 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 64 16 7401 7385 7.21115 12 0.0898015 0.13855 2024-09-16T07:55:32.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:32.180+0000 7faef70bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:32.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:32.189+0000 7faef70bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:33.167 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 65 16 7580 7564 7.27231 11.1875 0.0632394 0.13742 2024-09-16T07:55:34.167 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 66 16 7776 7760 7.34771 12.25 0.102215 0.136015 2024-09-16T07:55:34.569 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:55:34.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:34.721+0000 7f76f6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:34.729+0000 7f76f6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:35.167 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 67 16 7960 7944 7.40967 11.5 0.0636791 0.134875 2024-09-16T07:55:36.167 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 68 16 8168 8152 7.49186 13 0.0420909 0.133402 2024-09-16T07:55:36.913 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [2, 1, 3, 0] 2024-09-16T07:55:36.914 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:55:36.914 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [2, 1, 3, 0] 2024-09-16T07:55:36.914 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T07:55:36.914 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:55:37.087 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:55:37.168 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 69 16 8328 8312 7.5282 10 0.025506 0.132354 2024-09-16T07:55:37.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:37.197+0000 7efd32b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:37.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:37.203+0000 7efd32b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:38.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-16T07:55:38.168 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 70 16 8328 8312 7.42065 0 - 0.132354 2024-09-16T07:55:39.168 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 71 16 8328 8312 7.31613 0 - 0.132354 2024-09-16T07:55:40.168 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 72 16 8328 8312 7.21451 0 - 0.132354 2024-09-16T07:55:41.168 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 73 16 8328 8312 7.11569 0 - 0.132354 2024-09-16T07:55:42.168 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 74 16 8328 8312 7.01952 0 - 0.132354 2024-09-16T07:55:43.014 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T07:55:43.168 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 75 16 8328 8312 6.92592 0 - 0.132354 2024-09-16T07:55:43.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-16T07:55:44.168 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 76 16 8328 8312 6.83479 0 - 0.132354 2024-09-16T07:55:45.169 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 77 16 8328 8312 6.74602 0 - 0.132354 2024-09-16T07:55:46.169 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 78 16 8328 8312 6.65953 0 - 0.132354 2024-09-16T07:55:47.169 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 79 16 8328 8312 6.57522 0 - 0.132354 2024-09-16T07:55:48.015 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2] live_osds: [1, 3, 0] 2024-09-16T07:55:48.015 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:55:48.015 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:55:48.016 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:55:48.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:48.141+0000 7fa39bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:48.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:48.152+0000 7fa39bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:48.169 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:55:48.171279+0000 min lat: 0.0164785 max lat: 25.2514 avg lat: 0.132354 2024-09-16T07:55:48.169 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:55:48.169 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 80 16 8328 8312 6.49304 0 - 0.132354 2024-09-16T07:55:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:55:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:55:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:55:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:55:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:55:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:55:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:55:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:55:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:55:48.173 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:55:48.174 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:55:48.174 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:55:48.176 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:55:48.176 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:55:48.177 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:55:48.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:48.297+0000 7fbf39d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:48.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:48.307+0000 7fbf39d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:48.324 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:55:48.324 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:55:48.324 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:55:48.324 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:55:48.324 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:55:48.324 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:55:48.324 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:55:48.324 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:55:48.325 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:55:48.325 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:55:48.325 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:55:48.325 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:55:48.327 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:55:48.328 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:55:48.328 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:55:48.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:48.439+0000 7feecf591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:48.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:55:48.449+0000 7feecf591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:55:49.169 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 81 16 8328 8312 6.41287 0 - 0.132354 2024-09-16T07:55:50.170 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 82 16 8328 8312 6.33466 0 - 0.132354 2024-09-16T07:55:51.170 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 83 16 8328 8312 6.25834 0 - 0.132354 2024-09-16T07:55:52.170 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 84 16 8328 8312 6.18383 0 - 0.132354 2024-09-16T07:55:53.170 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 85 16 8328 8312 6.11107 0 - 0.132354 2024-09-16T07:55:54.174 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 86 16 8328 8312 6.04001 0 - 0.132354 2024-09-16T07:55:55.170 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 87 16 8328 8312 5.97058 0 - 0.132354 2024-09-16T07:55:56.170 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 88 16 8328 8312 5.90273 0 - 0.132354 2024-09-16T07:55:57.171 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 89 16 8328 8312 5.8364 0 - 0.132354 2024-09-16T07:55:58.171 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 90 16 8328 8312 5.77155 0 - 0.132354 2024-09-16T07:55:59.171 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 91 16 8328 8312 5.70812 0 - 0.132354 2024-09-16T07:56:00.171 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 92 16 8328 8312 5.64608 0 - 0.132354 2024-09-16T07:56:01.171 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 93 16 8328 8312 5.58537 0 - 0.132354 2024-09-16T07:56:02.171 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 94 16 8328 8312 5.52595 0 - 0.132354 2024-09-16T07:56:03.030 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:56:03.030 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:56:03.035 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:56:03.035 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:56:03.036 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:56:03.126 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:56:03.126 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:56:03.171 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 95 16 8328 8312 5.46778 0 - 0.132354 2024-09-16T07:56:03.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:03.214+0000 7f6efeca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:03.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:03.224+0000 7f6efeca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:56:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:56:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:56:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:56:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:56:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:56:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:56:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:56:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:56:03.240 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:56:03.240 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:56:03.240 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:56:03.242 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:56:03.242 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:56:04.171 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 96 14 8328 8314 5.41213 0.00462963 27.2449 0.138879 2024-09-16T07:56:05.128 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:56:05.172 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Total time run: 96.1508 2024-09-16T07:56:05.172 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Total writes made: 8328 2024-09-16T07:56:05.172 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Write size: 65536 2024-09-16T07:56:05.172 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Object size: 65536 2024-09-16T07:56:05.172 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Bandwidth (MB/sec): 5.41337 2024-09-16T07:56:05.172 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev Bandwidth: 5.92194 2024-09-16T07:56:05.172 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max bandwidth (MB/sec): 13 2024-09-16T07:56:05.172 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min bandwidth (MB/sec): 0 2024-09-16T07:56:05.172 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Average IOPS: 86 2024-09-16T07:56:05.172 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev IOPS: 94.7564 2024-09-16T07:56:05.173 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max IOPS: 208 2024-09-16T07:56:05.173 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min IOPS: 0 2024-09-16T07:56:05.173 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Average Latency(s): 0.184544 2024-09-16T07:56:05.173 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev Latency(s): 1.61948 2024-09-16T07:56:05.173 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max latency(s): 27.3737 2024-09-16T07:56:05.173 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min latency(s): 0.0164785 2024-09-16T07:56:05.203 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T07:56:05.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:05.290+0000 7f6ed3511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:05.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:05.302+0000 7f6ed3511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:05.569 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:56:05.611 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:56:05.611 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:56:07.612 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:56:07.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:07.768+0000 7ff156cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:07.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:07.780+0000 7ff156cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:08.032 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:56:08.099 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:56:08.099 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:56:08.243 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2] live_osds: [1, 3, 0] 2024-09-16T07:56:08.244 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:56:08.244 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:56:08.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:08.396+0000 7f84fc288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:08.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:08.409+0000 7f84fc288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:08.719 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:56:08.720 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:56:08.742 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":430,"stamp":"2024-09-16T07:56:08.432200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":543097384,"num_objects":8282,"num_object_clones":0,"num_object_copies":24846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8358,"num_write_kb":530899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":917504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8338,"ondisk_log_size":8338,"up":68,"acting":68,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":282400,"kb_used_data":102240,"kb_used_omap":0,"kb_used_meta":180096,"kb_avail":377204960,"statfs":{"total":386547056640,"available":386257879040,"internally_reserved":0,"allocated":104693760,"data_stored":1619546805,"data_compressed":76841161,"data_compressed_allocated":101146624,"data_compressed_original":1618100224,"omap_allocated":0,"internal_metadata":184418304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11927552,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":11648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001531"},"pg_stats":[{"pgid":"6.f","version":"104'514","reported_seq":548,"reported_epoch":104,"state":"stale+active+clean","last_fresh":"2024-09-16T07:55:35.706089+0000","last_change":"2024-09-16T07:55:24.440209+0000","last_active":"2024-09-16T07:55:35.706089+0000","last_peered":"2024-09-16T07:55:35.706089+0000","last_clean":"2024-09-16T07:55:35.706089+0000","last_became_active":"2024-09-16T07:55:24.147398+0000","last_became_peered":"2024-09-16T07:55:24.147398+0000","last_unstale":"2024-09-16T07:56:03.028003+0000","last_undegraded":"2024-09-16T07:55:35.706089+0000","last_fullsized":"2024-09-16T07:55:35.706089+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33685504,"num_objects":514,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":514,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"104'561","reported_seq":595,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-16T07:55:36.876942+0000","last_change":"2024-09-16T07:55:24.345534+0000","last_active":"2024-09-16T07:55:36.876942+0000","last_peered":"2024-09-16T07:55:36.876942+0000","last_clean":"2024-09-16T07:55:36.876942+0000","last_became_active":"2024-09-16T07:55:24.159978+0000","last_became_peered":"2024-09-16T07:55:24.159978+0000","last_unstale":"2024-09-16T07:55:36.876942+0000","last_undegraded":"2024-09-16T07:55:36.876942+0000","last_fullsized":"2024-09-16T07:55:36.876942+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36765696,"num_objects":561,"num_object_clones":0,"num_object_copies":1683,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":561,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"104'513","reported_seq":545,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-16T07:55:36.928298+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:55:36.928298+0000","last_peered":"2024-09-16T07:55:36.928298+0000","last_clean":"2024-09-16T07:55:36.928298+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:55:36.928298+0000","last_undegraded":"2024-09-16T07:55:36.928298+0000","last_fullsized":"2024-09-16T07:55:36.928298+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33619968,"num_objects":513,"num_object_clones":0,"num_object_copies":1539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":513,"num_write_kb":32832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"104'533","reported_seq":558,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:36.958095+0000","last_change":"2024-09-16T07:56:03.046936+0000","last_active":"2024-09-16T07:56:03.046936+0000","last_peered":"2024-09-16T07:55:36.958095+0000","last_clean":"2024-09-16T07:55:36.958095+0000","last_became_active":"2024-09-16T07:54:27.186041+0000","last_became_peered":"2024-09-16T07:54:27.186041+0000","last_unstale":"2024-09-16T07:55:36.958095+0000","last_undegraded":"2024-09-16T07:55:36.958095+0000","last_fullsized":"2024-09-16T07:55:36.958095+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"104'522","reported_seq":546,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-16T07:55:36.897768+0000","last_change":"2024-09-16T07:54:27.244356+0000","last_active":"2024-09-16T07:55:36.897768+0000","last_peered":"2024-09-16T07:55:36.897768+0000","last_clean":"2024-09-16T07:55:36.897768+0000","last_became_active":"2024-09-16T07:54:27.226887+0000","last_became_peered":"2024-09-16T07:54:27.226887+0000","last_unstale":"2024-09-16T07:55:36.897768+0000","last_undegraded":"2024-09-16T07:55:36.897768+0000","last_fullsized":"2024-09-16T07:55:36.897768+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34209792,"num_objects":522,"num_object_clones":0,"num_object_copies":1566,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"104'479","reported_seq":504,"reported_epoch":104,"state":"stale+active+clean","last_fresh":"2024-09-16T07:55:35.550461+0000","last_change":"2024-09-16T07:55:24.172191+0000","last_active":"2024-09-16T07:55:35.550461+0000","last_peered":"2024-09-16T07:55:35.550461+0000","last_clean":"2024-09-16T07:55:35.550461+0000","last_became_active":"2024-09-16T07:55:24.163650+0000","last_became_peered":"2024-09-16T07:55:24.163650+0000","last_unstale":"2024-09-16T07:56:03.028006+0000","last_undegraded":"2024-09-16T07:55:35.550461+0000","last_fullsized":"2024-09-16T07:55:35.550461+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":479,"num_write_kb":30656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"104'524","reported_seq":549,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:37.019430+0000","last_change":"2024-09-16T07:56:03.059619+0000","last_active":"2024-09-16T07:56:03.059619+0000","last_peered":"2024-09-16T07:55:37.019430+0000","last_clean":"2024-09-16T07:55:37.019430+0000","last_became_active":"2024-09-16T07:54:27.202101+0000","last_became_peered":"2024-09-16T07:54:27.202101+0000","last_unstale":"2024-09-16T07:55:37.019430+0000","last_undegraded":"2024-09-16T07:55:37.019430+0000","last_fullsized":"2024-09-16T07:55:37.019430+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34340864,"num_objects":524,"num_object_clones":0,"num_object_copies":1572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":524,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"104'516","reported_seq":539,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-16T07:55:36.906198+0000","last_change":"2024-09-16T07:55:24.280967+0000","last_active":"2024-09-16T07:55:36.906198+0000","last_peered":"2024-09-16T07:55:36.906198+0000","last_clean":"2024-09-16T07:55:36.906198+0000","last_became_active":"2024-09-16T07:55:24.262352+0000","last_became_peered":"2024-09-16T07:55:24.262352+0000","last_unstale":"2024-09-16T07:55:36.906198+0000","last_undegraded":"2024-09-16T07:55:36.906198+0000","last_fullsized":"2024-09-16T07:55:36.906198+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33751040,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"104'479","reported_seq":502,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-16T07:55:36.837386+0000","last_change":"2024-09-16T07:55:24.208999+0000","last_active":"2024-09-16T07:55:36.837386+0000","last_peered":"2024-09-16T07:55:36.837386+0000","last_clean":"2024-09-16T07:55:36.837386+0000","last_became_active":"2024-09-16T07:55:24.201873+0000","last_became_peered":"2024-09-16T07:55:24.201873+0000","last_unstale":"2024-09-16T07:55:36.837386+0000","last_undegraded":"2024-09-16T07:55:36.837386+0000","last_fullsized":"2024-09-16T07:55:36.837386+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31326208,"num_objects":478,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":478,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":310,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:28.041802+0000","last_change":"2024-09-16T07:56:03.061792+0000","last_active":"2024-09-16T07:56:03.061792+0000","last_peered":"2024-09-16T07:55:28.041802+0000","last_clean":"2024-09-16T07:55:28.041802+0000","last_became_active":"2024-09-16T07:55:24.127181+0000","last_became_peered":"2024-09-16T07:55:24.127181+0000","last_unstale":"2024-09-16T07:55:28.041802+0000","last_undegraded":"2024-09-16T07:55:28.041802+0000","last_fullsized":"2024-09-16T07:55:28.041802+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":275,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-16T07:55:28.054188+0000","last_change":"2024-09-16T07:54:05.034849+0000","last_active":"2024-09-16T07:55:28.054188+0000","last_peered":"2024-09-16T07:55:28.054188+0000","last_clean":"2024-09-16T07:55:28.054188+0000","last_became_active":"2024-09-16T07:54:04.145840+0000","last_became_peered":"2024-09-16T07:54:04.145840+0000","last_unstale":"2024-09-16T07:55:28.054188+0000","last_undegraded":"2024-09-16T07:55:28.054188+0000","last_fullsized":"2024-09-16T07:55:28.054188+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"104'504","reported_seq":541,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-16T07:56:03.077790+0000","last_change":"2024-09-16T07:55:24.512496+0000","last_active":"2024-09-16T07:56:03.077790+0000","last_peered":"2024-09-16T07:56:03.077790+0000","last_clean":"2024-09-16T07:56:03.077790+0000","last_became_active":"2024-09-16T07:55:24.193135+0000","last_became_peered":"2024-09-16T07:55:24.193135+0000","last_unstale":"2024-09-16T07:56:03.077790+0000","last_undegraded":"2024-09-16T07:56:03.077790+0000","last_fullsized":"2024-09-16T07:56:03.077790+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":127,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-16T07:55:28.075201+0000","last_change":"2024-09-16T07:55:28.082447+0000","last_active":"2024-09-16T07:55:28.075201+0000","last_peered":"2024-09-16T07:55:28.075201+0000","last_clean":"2024-09-16T07:55:28.075201+0000","last_became_active":"2024-09-16T07:55:24.249628+0000","last_became_peered":"2024-09-16T07:55:24.249628+0000","last_unstale":"2024-09-16T07:55:28.075201+0000","last_undegraded":"2024-09-16T07:55:28.075201+0000","last_fullsized":"2024-09-16T07:55:28.075201+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"104'536","reported_seq":566,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:36.633330+0000","last_change":"2024-09-16T07:56:03.074363+0000","last_active":"2024-09-16T07:56:03.074363+0000","last_peered":"2024-09-16T07:55:36.633330+0000","last_clean":"2024-09-16T07:55:36.633330+0000","last_became_active":"2024-09-16T07:55:24.191944+0000","last_became_peered":"2024-09-16T07:55:24.191944+0000","last_unstale":"2024-09-16T07:55:36.633330+0000","last_undegraded":"2024-09-16T07:55:36.633330+0000","last_fullsized":"2024-09-16T07:55:36.633330+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":256,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-16T07:55:28.044173+0000","last_change":"2024-09-16T07:54:05.028844+0000","last_active":"2024-09-16T07:55:28.044173+0000","last_peered":"2024-09-16T07:55:28.044173+0000","last_clean":"2024-09-16T07:55:28.044173+0000","last_became_active":"2024-09-16T07:54:04.112310+0000","last_became_peered":"2024-09-16T07:54:04.112310+0000","last_unstale":"2024-09-16T07:55:28.044173+0000","last_undegraded":"2024-09-16T07:55:28.044173+0000","last_fullsized":"2024-09-16T07:55:28.044173+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"104'508","reported_seq":541,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-16T07:56:03.051903+0000","last_change":"2024-09-16T07:55:24.360283+0000","last_active":"2024-09-16T07:56:03.051903+0000","last_peered":"2024-09-16T07:56:03.051903+0000","last_clean":"2024-09-16T07:56:03.051903+0000","last_became_active":"2024-09-16T07:55:24.148057+0000","last_became_peered":"2024-09-16T07:55:24.148057+0000","last_unstale":"2024-09-16T07:56:03.051903+0000","last_undegraded":"2024-09-16T07:56:03.051903+0000","last_fullsized":"2024-09-16T07:56:03.051903+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":135,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-16T07:55:28.079805+0000","last_change":"2024-09-16T07:55:28.098350+0000","last_active":"2024-09-16T07:55:28.079805+0000","last_peered":"2024-09-16T07:55:28.079805+0000","last_clean":"2024-09-16T07:55:28.079805+0000","last_became_active":"2024-09-16T07:55:24.232819+0000","last_became_peered":"2024-09-16T07:55:24.232819+0000","last_unstale":"2024-09-16T07:55:28.079805+0000","last_undegraded":"2024-09-16T07:55:28.079805+0000","last_fullsized":"2024-09-16T07:55:28.079805+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"104'548","reported_seq":578,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:36.763272+0000","last_change":"2024-09-16T07:56:03.080305+0000","last_active":"2024-09-16T07:56:03.080305+0000","last_peered":"2024-09-16T07:55:36.763272+0000","last_clean":"2024-09-16T07:55:36.763272+0000","last_became_active":"2024-09-16T07:55:24.229040+0000","last_became_peered":"2024-09-16T07:55:24.229040+0000","last_unstale":"2024-09-16T07:55:36.763272+0000","last_undegraded":"2024-09-16T07:55:36.763272+0000","last_fullsized":"2024-09-16T07:55:36.763272+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35848192,"num_objects":547,"num_object_clones":0,"num_object_copies":1641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":35008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":266,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:24.068405+0000","last_change":"2024-09-16T07:55:22.119290+0000","last_active":"2024-09-16T07:55:22.119290+0000","last_peered":"2024-09-16T07:54:28.031314+0000","last_clean":"2024-09-16T07:54:28.031314+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:55:24.068405+0000","last_undegraded":"2024-09-16T07:55:24.068405+0000","last_fullsized":"2024-09-16T07:55:24.068405+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"104'505","reported_seq":530,"reported_epoch":104,"state":"stale+active+clean","last_fresh":"2024-09-16T07:55:35.788002+0000","last_change":"2024-09-16T07:55:24.222174+0000","last_active":"2024-09-16T07:55:35.788002+0000","last_peered":"2024-09-16T07:55:35.788002+0000","last_clean":"2024-09-16T07:55:35.788002+0000","last_became_active":"2024-09-16T07:55:24.212763+0000","last_became_peered":"2024-09-16T07:55:24.212763+0000","last_unstale":"2024-09-16T07:56:03.028016+0000","last_undegraded":"2024-09-16T07:55:35.788002+0000","last_fullsized":"2024-09-16T07:55:35.788002+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33095680,"num_objects":505,"num_object_clones":0,"num_object_copies":1515,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":505,"num_write_kb":32320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":244,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:28.045582+0000","last_change":"2024-09-16T07:56:03.055810+0000","last_active":"2024-09-16T07:56:03.055810+0000","last_peered":"2024-09-16T07:55:28.045582+0000","last_clean":"2024-09-16T07:55:28.045582+0000","last_became_active":"2024-09-16T07:55:24.138878+0000","last_became_peered":"2024-09-16T07:55:24.138878+0000","last_unstale":"2024-09-16T07:55:28.045582+0000","last_undegraded":"2024-09-16T07:55:28.045582+0000","last_fullsized":"2024-09-16T07:55:28.045582+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"104'488","reported_seq":513,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-16T07:55:36.598760+0000","last_change":"2024-09-16T07:55:24.226144+0000","last_active":"2024-09-16T07:55:36.598760+0000","last_peered":"2024-09-16T07:55:36.598760+0000","last_clean":"2024-09-16T07:55:36.598760+0000","last_became_active":"2024-09-16T07:55:24.208517+0000","last_became_peered":"2024-09-16T07:55:24.208517+0000","last_unstale":"2024-09-16T07:55:36.598760+0000","last_undegraded":"2024-09-16T07:55:36.598760+0000","last_fullsized":"2024-09-16T07:55:36.598760+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31981568,"num_objects":488,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":276,"reported_epoch":104,"state":"stale+active+clean","last_fresh":"2024-09-16T07:55:28.056822+0000","last_change":"2024-09-16T07:55:28.062431+0000","last_active":"2024-09-16T07:55:28.056822+0000","last_peered":"2024-09-16T07:55:28.056822+0000","last_clean":"2024-09-16T07:55:28.056822+0000","last_became_active":"2024-09-16T07:55:24.139747+0000","last_became_peered":"2024-09-16T07:55:24.139747+0000","last_unstale":"2024-09-16T07:56:03.028019+0000","last_undegraded":"2024-09-16T07:55:28.056822+0000","last_fullsized":"2024-09-16T07:55:28.056822+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"104'553","reported_seq":576,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-16T07:55:36.760204+0000","last_change":"2024-09-16T07:55:24.237111+0000","last_active":"2024-09-16T07:55:36.760204+0000","last_peered":"2024-09-16T07:55:36.760204+0000","last_clean":"2024-09-16T07:55:36.760204+0000","last_became_active":"2024-09-16T07:55:24.227063+0000","last_became_peered":"2024-09-16T07:55:24.227063+0000","last_unstale":"2024-09-16T07:55:36.760204+0000","last_undegraded":"2024-09-16T07:55:36.760204+0000","last_fullsized":"2024-09-16T07:55:36.760204+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36175872,"num_objects":552,"num_object_clones":0,"num_object_copies":1656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":268,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-16T07:55:28.043261+0000","last_change":"2024-09-16T07:55:28.056128+0000","last_active":"2024-09-16T07:55:28.043261+0000","last_peered":"2024-09-16T07:55:28.043261+0000","last_clean":"2024-09-16T07:55:28.043261+0000","last_became_active":"2024-09-16T07:55:24.142290+0000","last_became_peered":"2024-09-16T07:55:24.142290+0000","last_unstale":"2024-09-16T07:55:28.043261+0000","last_undegraded":"2024-09-16T07:55:28.043261+0000","last_fullsized":"2024-09-16T07:55:28.043261+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":542507008,"num_objects":8278,"num_object_clones":0,"num_object_copies":24834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8278,"num_write_kb":529792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":917504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101568512,"data_stored":1625096192,"data_compressed":77164934,"data_compressed_allocated":101568512,"data_compressed_original":1625096192,"omap_allocated":0,"internal_metadata":0},"log_size":8283,"ondisk_log_size":8283,"up":44,"acting":44,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":22,"acting":22,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65980,"kb_used_data":23852,"kb_used_omap":0,"kb_used_meta":42112,"kb_avail":94305860,"statfs":{"total":96636764160,"available":96569200640,"internally_reserved":0,"allocated":24424448,"data_stored":376853799,"data_compressed":17879672,"data_compressed_allocated":23535616,"data_compressed_original":376487936,"omap_allocated":0,"internal_metadata":43122688},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103436,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77812,"kb_used_data":22756,"kb_used_omap":0,"kb_used_meta":55040,"kb_avail":94294028,"statfs":{"total":96636764160,"available":96557084672,"internally_reserved":0,"allocated":23302144,"data_stored":358831418,"data_compressed":17023929,"data_compressed_allocated":22409216,"data_compressed_original":358465536,"omap_allocated":0,"internal_metadata":56360960},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612846,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73712,"kb_used_data":27744,"kb_used_omap":0,"kb_used_meta":45952,"kb_avail":94298128,"statfs":{"total":96636764160,"available":96561283072,"internally_reserved":0,"allocated":28409856,"data_stored":440947482,"data_compressed":20921083,"data_compressed_allocated":27537408,"data_compressed_original":440598528,"omap_allocated":0,"internal_metadata":47054848},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64896,"kb_used_data":27888,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94306944,"statfs":{"total":96636764160,"available":96570310656,"internally_reserved":0,"allocated":28557312,"data_stored":442914106,"data_compressed":21016477,"data_compressed_allocated":27664384,"data_compressed_original":442548224,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27623424,"data_stored":441974784,"data_compressed":20986436,"data_compressed_allocated":27623424,"data_compressed_original":441974784,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27537408,"data_stored":440598528,"data_compressed":20921083,"data_compressed_allocated":27537408,"data_compressed_original":440598528,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22913024,"data_stored":366608384,"data_compressed":17407784,"data_compressed_allocated":22913024,"data_compressed_original":366608384,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23494656,"data_stored":375914496,"data_compressed":17849631,"data_compressed_allocated":23494656,"data_compressed_original":375914496,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:56:10.100 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:56:10.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:10.247+0000 7fcc46191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:10.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:10.257+0000 7fcc46191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:10.541 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:56:10.579 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:56:10.579 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:56:12.580 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:56:12.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:12.739+0000 7f868ed11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:12.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:12.752+0000 7f868ed11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:13.000 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:56:13.039 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:56:13.039 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:56:13.744 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2] live_osds: [1, 3, 0] 2024-09-16T07:56:13.744 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:56:13.744 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-09-16T07:56:13.745 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T07:56:13.745 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T07:56:13.747 INFO:tasks.ceph.osd.2:Started 2024-09-16T07:56:13.747 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T07:56:13.863 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:56:13.866 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:56:13.867 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-16T07:56:15.040 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:56:15.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:15.201+0000 7fccc1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:15.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:15.216+0000 7fccc1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:15.499 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:56:15.550 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:56:15.551 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:56:17.552 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:56:17.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:17.702+0000 7f1a33911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:17.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:17.714+0000 7f1a33911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:17.953 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:56:18.033 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:56:18.034 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:56:18.868 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T07:56:18.994 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:56:18.998 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:56:18.999 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-16T07:56:20.035 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:56:20.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:20.163+0000 7f08fdd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:20.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:20.171+0000 7f08fdd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:20.356 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:56:20.497 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:56:20.498 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:56:22.499 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:56:22.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:22.646+0000 7f35b9711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:22.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:22.657+0000 7f35b9711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:22.743 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:56:22.903 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:56:22.904 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:56:23.999 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T07:56:24.125 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:56:24.129 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:56:24.130 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-16T07:56:24.905 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:56:25.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:25.062+0000 7fe2a70ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:25.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:25.074+0000 7fe2a70ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:25.257 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:56:25.400 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:56:25.401 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:56:27.402 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:56:27.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:27.555+0000 7ff88b0ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:27.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:27.563+0000 7ff88b0ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:27.784 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:56:27.902 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:56:27.903 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:56:29.130 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T07:56:29.237 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-16T07:56:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "ops_in_flight": [ 2024-09-16T07:56:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:56:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client_request", 2024-09-16T07:56:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 55, 2024-09-16T07:56:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:56:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.821072+0000" 2024-09-16T07:56:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.238 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:56:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.821090+0000" 2024-09-16T07:56:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:56:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.828124+0000" 2024-09-16T07:56:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.239 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:56:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:56:29.240 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.831023+0000" 2024-09-16T07:56:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:56:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.834153+0000" 2024-09-16T07:56:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.241 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:56:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:56:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.837684+0000" 2024-09-16T07:56:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:56:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:56:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.840599+0000" 2024-09-16T07:56:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.244 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:56:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.842518+0000", 2024-09-16T07:56:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "blocker": { 2024-09-16T07:56:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "op_type": "PGActivationBlocker", 2024-09-16T07:56:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "6.0" 2024-09-16T07:56:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.245 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:56:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:56:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:56:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:56:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:56:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:56:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.249 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:56:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:56:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.250 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.251 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:56:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client_request", 2024-09-16T07:56:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 44, 2024-09-16T07:56:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:56:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.790448+0000" 2024-09-16T07:56:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:56:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.790472+0000" 2024-09-16T07:56:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.253 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:56:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.804574+0000" 2024-09-16T07:56:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:56:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.254 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:56:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.809166+0000" 2024-09-16T07:56:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.255 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:56:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.816719+0000" 2024-09-16T07:56:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:56:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.256 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:56:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.817379+0000" 2024-09-16T07:56:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.257 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:56:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:56:29.258 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.817900+0000" 2024-09-16T07:56:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:56:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.818257+0000", 2024-09-16T07:56:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "blocker": { 2024-09-16T07:56:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "op_type": "PGActivationBlocker", 2024-09-16T07:56:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "6.a" 2024-09-16T07:56:29.259 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:56:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.260 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:56:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:56:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:56:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.262 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:56:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:56:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.263 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:56:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.264 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client_request", 2024-09-16T07:56:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 47, 2024-09-16T07:56:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:56:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.794306+0000" 2024-09-16T07:56:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:56:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.794323+0000" 2024-09-16T07:56:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.266 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:56:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.809031+0000" 2024-09-16T07:56:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:56:29.267 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:56:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.818490+0000" 2024-09-16T07:56:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:56:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.823546+0000" 2024-09-16T07:56:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:56:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:56:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.824022+0000" 2024-09-16T07:56:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.271 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.824280+0000" 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.824390+0000", 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "blocker": { 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "op_type": "PGActivationBlocker", 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.272 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "6.5" 2024-09-16T07:56:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:56:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:56:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:56:29.274 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:56:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:56:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:56:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:56:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.277 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:56:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:56:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client_request", 2024-09-16T07:56:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 52, 2024-09-16T07:56:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:56:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.800407+0000" 2024-09-16T07:56:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:56:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.800417+0000" 2024-09-16T07:56:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:56:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.822675+0000" 2024-09-16T07:56:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.280 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:56:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:56:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.826995+0000" 2024-09-16T07:56:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.281 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.831409+0000" 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.282 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:56:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.832108+0000" 2024-09-16T07:56:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.283 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:56:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:56:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.832531+0000", 2024-09-16T07:56:29.284 INFO:teuthology.orchestra.run.smithi134.stdout: "blocker": { 2024-09-16T07:56:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "op_type": "CommonPGPipeline:::wait_for_active", 2024-09-16T07:56:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "waiting": 1, 2024-09-16T07:56:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "held_by_operation_id": 47 2024-09-16T07:56:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.285 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:56:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:56:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.286 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:56:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:56:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:56:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.288 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:56:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:56:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.289 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:56:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.290 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:56:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:56:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client_request", 2024-09-16T07:56:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 59, 2024-09-16T07:56:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:56:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.850711+0000" 2024-09-16T07:56:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:56:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.850730+0000" 2024-09-16T07:56:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:56:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.851590+0000" 2024-09-16T07:56:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.293 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:56:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:56:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.853423+0000" 2024-09-16T07:56:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.294 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:56:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.857123+0000" 2024-09-16T07:56:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:56:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:56:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.857788+0000" 2024-09-16T07:56:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:56:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:56:29.297 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.858157+0000", 2024-09-16T07:56:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "blocker": { 2024-09-16T07:56:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "op_type": "CommonPGPipeline:::wait_for_active", 2024-09-16T07:56:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "waiting": 1, 2024-09-16T07:56:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "held_by_operation_id": 44 2024-09-16T07:56:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.298 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:56:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:56:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.299 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:56:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:56:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:56:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.301 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:56:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:56:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:56:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.303 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:56:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:56:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client_request", 2024-09-16T07:56:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 38, 2024-09-16T07:56:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:56:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.784712+0000" 2024-09-16T07:56:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:56:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.784739+0000" 2024-09-16T07:56:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.305 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:56:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.784888+0000" 2024-09-16T07:56:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:56:29.306 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.785787+0000" 2024-09-16T07:56:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:56:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.799180+0000" 2024-09-16T07:56:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:56:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.800183+0000" 2024-09-16T07:56:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:56:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:56:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.800606+0000" 2024-09-16T07:56:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.309 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:56:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:56:29.310 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.800811+0000" 2024-09-16T07:56:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:56:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.800907+0000", 2024-09-16T07:56:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "blocker": { 2024-09-16T07:56:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "op_type": "PGActivationBlocker", 2024-09-16T07:56:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.311 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "6.1" 2024-09-16T07:56:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:56:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.312 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:56:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:56:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:56:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:56:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.315 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:56:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:56:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.316 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:56:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.317 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:56:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client_request", 2024-09-16T07:56:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 41, 2024-09-16T07:56:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:56:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.786907+0000" 2024-09-16T07:56:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.318 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:56:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.786922+0000" 2024-09-16T07:56:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:56:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.787503+0000" 2024-09-16T07:56:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.319 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:56:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:56:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.803711+0000" 2024-09-16T07:56:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:56:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.807285+0000" 2024-09-16T07:56:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:56:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:56:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.808227+0000" 2024-09-16T07:56:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:56:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:56:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.808502+0000", 2024-09-16T07:56:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "blocker": { 2024-09-16T07:56:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "op_type": "CommonPGPipeline:::wait_for_active", 2024-09-16T07:56:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "waiting": 1, 2024-09-16T07:56:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: "held_by_operation_id": 38 2024-09-16T07:56:29.324 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:56:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.325 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:56:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:56:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:56:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:56:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:56:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:56:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:56:29.329 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:56:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T07:56:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client_request", 2024-09-16T07:56:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 49, 2024-09-16T07:56:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T07:56:29.331 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.797738+0000" 2024-09-16T07:56:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T07:56:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.797766+0000" 2024-09-16T07:56:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T07:56:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.818414+0000" 2024-09-16T07:56:29.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T07:56:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.333 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T07:56:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.822332+0000" 2024-09-16T07:56:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T07:56:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.828310+0000" 2024-09-16T07:56:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.334 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T07:56:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T07:56:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.828792+0000" 2024-09-16T07:56:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T07:56:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T07:56:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.829141+0000" 2024-09-16T07:56:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.337 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T07:56:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-16T07:56:28.829318+0000", 2024-09-16T07:56:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "blocker": { 2024-09-16T07:56:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "op_type": "PGActivationBlocker", 2024-09-16T07:56:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T07:56:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "6.f" 2024-09-16T07:56:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.338 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T07:56:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T07:56:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.339 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T07:56:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T07:56:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T07:56:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.341 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T07:56:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T07:56:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.342 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "blocking_event": { 2024-09-16T07:56:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T07:56:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T07:56:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T07:56:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time_event": { 2024-09-16T07:56:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T07:56:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "0.000000" 2024-09-16T07:56:29.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T07:56:29.344 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-16T07:56:29.344 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-16T07:56:29.904 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:56:30.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:30.015+0000 7f2d6e0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:30.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:30.022+0000 7f2d6e0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:32.120 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:56:32.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:32.293+0000 7f8df0991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:32.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:32.303+0000 7f8df0991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:34.345 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [1, 3, 0, 2] 2024-09-16T07:56:34.346 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:56:34.346 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [1, 3, 0, 2] 2024-09-16T07:56:34.346 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T07:56:34.346 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:56:34.443 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T07:56:34.851 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:56:34.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:34.964+0000 7fdab3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:34.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:34.970+0000 7fdab3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:39.443 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [1] live_osds: [3, 0, 2] 2024-09-16T07:56:39.444 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-09-16T07:56:39.444 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T07:56:39.444 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T07:56:39.447 INFO:tasks.ceph.osd.1:Started 2024-09-16T07:56:39.447 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T07:56:39.550 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:56:39.553 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:56:39.553 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-16T07:56:44.554 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T07:56:44.657 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:56:44.660 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:56:44.661 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-16T07:56:49.662 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T07:56:49.782 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T07:56:49.783 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [] 2024-09-16T07:56:49.783 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T07:56:49.793 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:56:49.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:49.904+0000 7fea44191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:49.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:49.915+0000 7fea44191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:51.041 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:56:51.067 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:56:51.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:51.215+0000 7f9cd7f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:51.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:51.229+0000 7f9cd7f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:52.084 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:56:52.104 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:56:52.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:52.260+0000 7f7d99191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:52.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:52.275+0000 7f7d99191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:53.035 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:56:53.057 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:56:53.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:53.184+0000 7f8a8c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:53.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:53.201+0000 7f8a8c591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:54.088 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:56:54.113 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:56:54.113 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:56:54.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:54.252+0000 7fbb1ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:54.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:54.265+0000 7fbb1ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:54.575 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:56:54.575 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:56:54.604 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":470,"stamp":"2024-09-16T07:56:54.443086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":263914048,"num_objects":4023,"num_object_clones":0,"num_object_copies":12069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2181,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12701,"num_write_kb":533524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":340,"num_bytes_recovered":1245184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12684,"ondisk_log_size":12684,"up":63,"acting":60,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248232,"kb_used_data":59752,"kb_used_omap":0,"kb_used_meta":188416,"kb_avail":377239128,"statfs":{"total":386547056640,"available":386292867072,"internally_reserved":0,"allocated":61186048,"data_stored":920168559,"data_compressed":43629371,"data_compressed_allocated":57430016,"data_compressed_original":918634496,"omap_allocated":0,"internal_metadata":192937984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-21364736,"num_objects":-326,"num_object_clones":0,"num_object_copies":-978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-323,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001089"},"pg_stats":[{"pgid":"6.f","version":"106'790","reported_seq":830,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.978698+0000","last_change":"2024-09-16T07:56:04.201034+0000","last_active":"2024-09-16T07:56:26.978698+0000","last_peered":"2024-09-16T07:56:26.978698+0000","last_clean":"2024-09-16T07:55:36.831185+0000","last_became_active":"2024-09-16T07:56:04.201034+0000","last_became_peered":"2024-09-16T07:56:04.201034+0000","last_unstale":"2024-09-16T07:56:50.042192+0000","last_undegraded":"2024-09-16T07:56:04.086716+0000","last_fullsized":"2024-09-16T07:56:04.085419+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17891328,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":273,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":273}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"106'822","reported_seq":863,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.713938+0000","last_change":"2024-09-16T07:56:04.234616+0000","last_active":"2024-09-16T07:56:26.713938+0000","last_peered":"2024-09-16T07:56:26.713938+0000","last_clean":"2024-09-16T07:55:36.894044+0000","last_became_active":"2024-09-16T07:56:04.234616+0000","last_became_peered":"2024-09-16T07:56:04.234616+0000","last_unstale":"2024-09-16T07:56:50.042195+0000","last_undegraded":"2024-09-16T07:56:04.095494+0000","last_fullsized":"2024-09-16T07:56:04.093963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":300}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"106'784","reported_seq":823,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-09-16T07:56:26.993304+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:56:26.993304+0000","last_peered":"2024-09-16T07:56:26.993304+0000","last_clean":"2024-09-16T07:56:26.993304+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:56:50.042197+0000","last_undegraded":"2024-09-16T07:56:26.993304+0000","last_fullsized":"2024-09-16T07:56:26.993304+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925272,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":784,"num_write_kb":32833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"109'850","reported_seq":901,"reported_epoch":110,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:56:33.056863+0000","last_change":"2024-09-16T07:56:31.196007+0000","last_active":"2024-09-16T07:56:33.056863+0000","last_peered":"2024-09-16T07:56:33.056863+0000","last_clean":"2024-09-16T07:55:36.958095+0000","last_became_active":"2024-09-16T07:56:31.113588+0000","last_became_peered":"2024-09-16T07:56:31.113588+0000","last_unstale":"2024-09-16T07:56:33.056863+0000","last_undegraded":"2024-09-16T07:56:30.612013+0000","last_fullsized":"2024-09-16T07:56:30.587298+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":296,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":850,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":215}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"106'765","reported_seq":796,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.802068+0000","last_change":"2024-09-16T07:56:04.188084+0000","last_active":"2024-09-16T07:56:26.802068+0000","last_peered":"2024-09-16T07:56:26.802068+0000","last_clean":"2024-09-16T07:55:37.016460+0000","last_became_active":"2024-09-16T07:56:04.188084+0000","last_became_peered":"2024-09-16T07:56:04.188084+0000","last_unstale":"2024-09-16T07:56:50.042199+0000","last_undegraded":"2024-09-16T07:56:04.099920+0000","last_fullsized":"2024-09-16T07:56:04.098703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":279,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":279}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"106'733","reported_seq":764,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:27.097568+0000","last_change":"2024-09-16T07:56:04.175306+0000","last_active":"2024-09-16T07:56:27.097568+0000","last_peered":"2024-09-16T07:56:27.097568+0000","last_clean":"2024-09-16T07:55:36.690514+0000","last_became_active":"2024-09-16T07:56:04.175306+0000","last_became_peered":"2024-09-16T07:56:04.175306+0000","last_unstale":"2024-09-16T07:56:50.042201+0000","last_undegraded":"2024-09-16T07:56:04.083289+0000","last_fullsized":"2024-09-16T07:56:04.081485+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":254,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":31552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":254}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.9","version":"109'847","reported_seq":893,"reported_epoch":110,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:56:33.055355+0000","last_change":"2024-09-16T07:56:31.242408+0000","last_active":"2024-09-16T07:56:33.055355+0000","last_peered":"2024-09-16T07:56:33.055355+0000","last_clean":"2024-09-16T07:55:37.019430+0000","last_became_active":"2024-09-16T07:56:31.227591+0000","last_became_peered":"2024-09-16T07:56:31.227591+0000","last_unstale":"2024-09-16T07:56:33.055355+0000","last_undegraded":"2024-09-16T07:56:30.634662+0000","last_fullsized":"2024-09-16T07:56:30.613321+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":200}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"110'817","reported_seq":1439,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.123346+0000","last_change":"2024-09-16T07:56:39.099974+0000","last_active":"2024-09-16T07:56:52.123346+0000","last_peered":"2024-09-16T07:56:52.123346+0000","last_clean":"2024-09-16T07:56:52.123346+0000","last_became_active":"2024-09-16T07:56:39.094850+0000","last_became_peered":"2024-09-16T07:56:39.094850+0000","last_unstale":"2024-09-16T07:56:52.123346+0000","last_undegraded":"2024-09-16T07:56:52.123346+0000","last_fullsized":"2024-09-16T07:56:52.123346+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"110'774","reported_seq":849,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.244861+0000","last_change":"2024-09-16T07:56:52.246248+0000","last_active":"2024-09-16T07:56:52.244861+0000","last_peered":"2024-09-16T07:56:52.244861+0000","last_clean":"2024-09-16T07:56:49.058981+0000","last_became_active":"2024-09-16T07:56:52.238011+0000","last_became_peered":"2024-09-16T07:56:52.238011+0000","last_unstale":"2024-09-16T07:56:52.244861+0000","last_undegraded":"2024-09-16T07:56:52.244861+0000","last_fullsized":"2024-09-16T07:56:52.244861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.054111+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:56:33.054111+0000","last_peered":"2024-09-16T07:56:33.054111+0000","last_clean":"2024-09-16T07:56:33.054111+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:56:33.054111+0000","last_undegraded":"2024-09-16T07:56:33.054111+0000","last_fullsized":"2024-09-16T07:56:33.054111+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":282,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:04.168624+0000","last_change":"2024-09-16T07:56:04.167227+0000","last_active":"2024-09-16T07:56:04.168624+0000","last_peered":"2024-09-16T07:56:04.168624+0000","last_clean":"2024-09-16T07:55:28.056115+0000","last_became_active":"2024-09-16T07:56:04.167227+0000","last_became_peered":"2024-09-16T07:56:04.167227+0000","last_unstale":"2024-09-16T07:56:50.042204+0000","last_undegraded":"2024-09-16T07:56:04.100204+0000","last_fullsized":"2024-09-16T07:56:04.098024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"110'800","reported_seq":852,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.066295+0000","last_change":"2024-09-16T07:55:24.512496+0000","last_active":"2024-09-16T07:56:33.066295+0000","last_peered":"2024-09-16T07:56:33.066295+0000","last_clean":"2024-09-16T07:56:33.066295+0000","last_became_active":"2024-09-16T07:55:24.193135+0000","last_became_peered":"2024-09-16T07:55:24.193135+0000","last_unstale":"2024-09-16T07:56:33.066295+0000","last_undegraded":"2024-09-16T07:56:33.066295+0000","last_fullsized":"2024-09-16T07:56:33.066295+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.223011+0000","last_change":"2024-09-16T07:56:52.225705+0000","last_active":"2024-09-16T07:56:52.223011+0000","last_peered":"2024-09-16T07:56:52.223011+0000","last_clean":"2024-09-16T07:56:49.056656+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:56:52.223011+0000","last_undegraded":"2024-09-16T07:56:52.223011+0000","last_fullsized":"2024-09-16T07:56:52.223011+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"109'854","reported_seq":1016,"reported_epoch":110,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T07:56:33.155656+0000","last_change":"2024-09-16T07:56:31.333217+0000","last_active":"2024-09-16T07:56:33.155656+0000","last_peered":"2024-09-16T07:56:33.155656+0000","last_clean":"2024-09-16T07:55:36.633330+0000","last_became_active":"2024-09-16T07:56:31.127951+0000","last_became_peered":"2024-09-16T07:56:31.127951+0000","last_unstale":"2024-09-16T07:56:33.155656+0000","last_undegraded":"2024-09-16T07:56:33.155656+0000","last_fullsized":"2024-09-16T07:56:30.640913+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14352384,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":853,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[{"shards":"0,3","objects":219}],"blocked_by":[],"up_primary":2,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.153952+0000","last_change":"2024-09-16T07:56:04.153196+0000","last_active":"2024-09-16T07:56:04.153952+0000","last_peered":"2024-09-16T07:56:04.153952+0000","last_clean":"2024-09-16T07:55:28.045293+0000","last_became_active":"2024-09-16T07:56:04.153196+0000","last_became_peered":"2024-09-16T07:56:04.153196+0000","last_unstale":"2024-09-16T07:56:50.042206+0000","last_undegraded":"2024-09-16T07:56:04.153952+0000","last_fullsized":"2024-09-16T07:56:04.074241+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"109'815","reported_seq":863,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.061359+0000","last_change":"2024-09-16T07:55:24.360283+0000","last_active":"2024-09-16T07:56:33.061359+0000","last_peered":"2024-09-16T07:56:33.061359+0000","last_clean":"2024-09-16T07:56:33.061359+0000","last_became_active":"2024-09-16T07:55:24.148057+0000","last_became_peered":"2024-09-16T07:55:24.148057+0000","last_unstale":"2024-09-16T07:56:33.061359+0000","last_undegraded":"2024-09-16T07:56:33.061359+0000","last_fullsized":"2024-09-16T07:56:33.061359+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.259755+0000","last_change":"2024-09-16T07:56:52.263340+0000","last_active":"2024-09-16T07:56:52.259755+0000","last_peered":"2024-09-16T07:56:52.259755+0000","last_clean":"2024-09-16T07:56:49.060679+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:56:52.259755+0000","last_undegraded":"2024-09-16T07:56:52.259755+0000","last_fullsized":"2024-09-16T07:56:52.259755+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"104'548","reported_seq":578,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:36.763272+0000","last_change":"2024-09-16T07:56:03.080305+0000","last_active":"2024-09-16T07:56:03.080305+0000","last_peered":"2024-09-16T07:55:36.763272+0000","last_clean":"2024-09-16T07:55:36.763272+0000","last_became_active":"2024-09-16T07:55:24.229040+0000","last_became_peered":"2024-09-16T07:55:24.229040+0000","last_unstale":"2024-09-16T07:55:36.763272+0000","last_undegraded":"2024-09-16T07:55:36.763272+0000","last_fullsized":"2024-09-16T07:55:36.763272+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35848192,"num_objects":547,"num_object_clones":0,"num_object_copies":1641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":35008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":266,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:24.068405+0000","last_change":"2024-09-16T07:55:22.119290+0000","last_active":"2024-09-16T07:55:22.119290+0000","last_peered":"2024-09-16T07:54:28.031314+0000","last_clean":"2024-09-16T07:54:28.031314+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:55:24.068405+0000","last_undegraded":"2024-09-16T07:55:24.068405+0000","last_fullsized":"2024-09-16T07:55:24.068405+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"106'788","reported_seq":819,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.810584+0000","last_change":"2024-09-16T07:56:04.233329+0000","last_active":"2024-09-16T07:56:26.810584+0000","last_peered":"2024-09-16T07:56:26.810584+0000","last_clean":"2024-09-16T07:55:36.614734+0000","last_became_active":"2024-09-16T07:56:04.233329+0000","last_became_peered":"2024-09-16T07:56:04.233329+0000","last_unstale":"2024-09-16T07:56:50.042213+0000","last_undegraded":"2024-09-16T07:56:04.094852+0000","last_fullsized":"2024-09-16T07:56:04.092743+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":241,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":241}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":266,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.056382+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:56:33.056382+0000","last_peered":"2024-09-16T07:56:33.056382+0000","last_clean":"2024-09-16T07:56:33.056382+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:56:33.056382+0000","last_undegraded":"2024-09-16T07:56:33.056382+0000","last_fullsized":"2024-09-16T07:56:33.056382+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"106'740","reported_seq":772,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.778896+0000","last_change":"2024-09-16T07:56:04.242962+0000","last_active":"2024-09-16T07:56:26.778896+0000","last_peered":"2024-09-16T07:56:26.778896+0000","last_clean":"2024-09-16T07:55:36.812189+0000","last_became_active":"2024-09-16T07:56:04.242962+0000","last_became_peered":"2024-09-16T07:56:04.242962+0000","last_unstale":"2024-09-16T07:56:50.042216+0000","last_undegraded":"2024-09-16T07:56:04.106106+0000","last_fullsized":"2024-09-16T07:56:04.103930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":236}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":272,"reported_epoch":106,"state":"active+undersized","last_fresh":"2024-09-16T07:56:04.169384+0000","last_change":"2024-09-16T07:56:04.168623+0000","last_active":"2024-09-16T07:56:04.169384+0000","last_peered":"2024-09-16T07:56:04.169384+0000","last_clean":"2024-09-16T07:54:28.024466+0000","last_became_active":"2024-09-16T07:56:04.168623+0000","last_became_peered":"2024-09-16T07:56:04.168623+0000","last_unstale":"2024-09-16T07:56:04.169384+0000","last_undegraded":"2024-09-16T07:56:04.169384+0000","last_fullsized":"2024-09-16T07:56:04.085808+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"110'902","reported_seq":978,"reported_epoch":121,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T07:56:52.265701+0000","last_change":"2024-09-16T07:56:52.268058+0000","last_active":"2024-09-16T07:56:52.265701+0000","last_peered":"2024-09-16T07:56:52.265701+0000","last_clean":"2024-09-16T07:56:49.061054+0000","last_became_active":"2024-09-16T07:56:52.254107+0000","last_became_peered":"2024-09-16T07:56:52.254107+0000","last_unstale":"2024-09-16T07:56:52.265701+0000","last_undegraded":"2024-09-16T07:56:52.160213+0000","last_fullsized":"2024-09-16T07:56:52.265701+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","3"],"object_location_counts":[{"shards":"0,1,3","objects":203}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":275,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.168913+0000","last_change":"2024-09-16T07:56:04.168188+0000","last_active":"2024-09-16T07:56:04.168913+0000","last_peered":"2024-09-16T07:56:04.168913+0000","last_clean":"2024-09-16T07:55:28.056128+0000","last_became_active":"2024-09-16T07:56:04.168188+0000","last_became_peered":"2024-09-16T07:56:04.168188+0000","last_unstale":"2024-09-16T07:56:50.042218+0000","last_undegraded":"2024-09-16T07:56:04.168913+0000","last_fullsized":"2024-09-16T07:56:04.078402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":263323672,"num_objects":4019,"num_object_clones":0,"num_object_copies":12057,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12621,"num_write_kb":532417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":339,"num_bytes_recovered":1245184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56963072,"data_stored":911212616,"data_compressed":43268504,"data_compressed_allocated":56950784,"data_compressed_original":911212544,"omap_allocated":0,"internal_metadata":0},"log_size":12629,"ondisk_log_size":12629,"up":41,"acting":38,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":19,"acting":19,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122197,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48800,"kb_used_data":10832,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94323040,"statfs":{"total":96636764160,"available":96586792960,"internally_reserved":0,"allocated":11091968,"data_stored":162831840,"data_compressed":7716681,"data_compressed_allocated":10158080,"data_compressed_original":162447360,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103436,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77812,"kb_used_data":22756,"kb_used_omap":0,"kb_used_meta":55040,"kb_avail":94294028,"statfs":{"total":96636764160,"available":96557084672,"internally_reserved":0,"allocated":23302144,"data_stored":358831418,"data_compressed":17023929,"data_compressed_allocated":22409216,"data_compressed_original":358465536,"omap_allocated":0,"internal_metadata":56360960},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73004,"kb_used_data":14556,"kb_used_omap":0,"kb_used_meta":58432,"kb_avail":94298836,"statfs":{"total":96636764160,"available":96562008064,"internally_reserved":0,"allocated":14905344,"data_stored":224554674,"data_compressed":10646152,"data_compressed_allocated":14012416,"data_compressed_original":224198656,"omap_allocated":0,"internal_metadata":59834368},"hb_peers":[0,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48616,"kb_used_data":11608,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":11886592,"data_stored":173950627,"data_compressed":8242609,"data_compressed_allocated":10850304,"data_compressed_original":173522944,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10813440,"data_stored":172949528,"data_compressed":8212568,"data_compressed_allocated":10809344,"data_compressed_original":172949504,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13541376,"data_stored":216596504,"data_compressed":10285160,"data_compressed_allocated":13537280,"data_compressed_original":216596480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22913024,"data_stored":366608384,"data_compressed":17407784,"data_compressed_allocated":22913024,"data_compressed_original":366608384,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9695232,"data_stored":155058200,"data_compressed":7362992,"data_compressed_allocated":9691136,"data_compressed_original":155058176,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:56:54.606 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:56:54.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:54.757+0000 7f4569b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:54.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:54.769+0000 7f4569b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:56:55.034 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:56:55.052 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":470,"stamp":"2024-09-16T07:56:54.443086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":263914048,"num_objects":4023,"num_object_clones":0,"num_object_copies":12069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2181,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12701,"num_write_kb":533524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":340,"num_bytes_recovered":1245184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12684,"ondisk_log_size":12684,"up":63,"acting":60,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248232,"kb_used_data":59752,"kb_used_omap":0,"kb_used_meta":188416,"kb_avail":377239128,"statfs":{"total":386547056640,"available":386292867072,"internally_reserved":0,"allocated":61186048,"data_stored":920168559,"data_compressed":43629371,"data_compressed_allocated":57430016,"data_compressed_original":918634496,"omap_allocated":0,"internal_metadata":192937984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-21364736,"num_objects":-326,"num_object_clones":0,"num_object_copies":-978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-323,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001089"},"pg_stats":[{"pgid":"6.f","version":"106'790","reported_seq":830,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.978698+0000","last_change":"2024-09-16T07:56:04.201034+0000","last_active":"2024-09-16T07:56:26.978698+0000","last_peered":"2024-09-16T07:56:26.978698+0000","last_clean":"2024-09-16T07:55:36.831185+0000","last_became_active":"2024-09-16T07:56:04.201034+0000","last_became_peered":"2024-09-16T07:56:04.201034+0000","last_unstale":"2024-09-16T07:56:50.042192+0000","last_undegraded":"2024-09-16T07:56:04.086716+0000","last_fullsized":"2024-09-16T07:56:04.085419+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17891328,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":273,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":273}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"106'822","reported_seq":863,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.713938+0000","last_change":"2024-09-16T07:56:04.234616+0000","last_active":"2024-09-16T07:56:26.713938+0000","last_peered":"2024-09-16T07:56:26.713938+0000","last_clean":"2024-09-16T07:55:36.894044+0000","last_became_active":"2024-09-16T07:56:04.234616+0000","last_became_peered":"2024-09-16T07:56:04.234616+0000","last_unstale":"2024-09-16T07:56:50.042195+0000","last_undegraded":"2024-09-16T07:56:04.095494+0000","last_fullsized":"2024-09-16T07:56:04.093963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":300}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"106'784","reported_seq":823,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-09-16T07:56:26.993304+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:56:26.993304+0000","last_peered":"2024-09-16T07:56:26.993304+0000","last_clean":"2024-09-16T07:56:26.993304+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:56:50.042197+0000","last_undegraded":"2024-09-16T07:56:26.993304+0000","last_fullsized":"2024-09-16T07:56:26.993304+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925272,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":784,"num_write_kb":32833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"109'850","reported_seq":901,"reported_epoch":110,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:56:33.056863+0000","last_change":"2024-09-16T07:56:31.196007+0000","last_active":"2024-09-16T07:56:33.056863+0000","last_peered":"2024-09-16T07:56:33.056863+0000","last_clean":"2024-09-16T07:55:36.958095+0000","last_became_active":"2024-09-16T07:56:31.113588+0000","last_became_peered":"2024-09-16T07:56:31.113588+0000","last_unstale":"2024-09-16T07:56:33.056863+0000","last_undegraded":"2024-09-16T07:56:30.612013+0000","last_fullsized":"2024-09-16T07:56:30.587298+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":296,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":850,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":215}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"106'765","reported_seq":796,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.802068+0000","last_change":"2024-09-16T07:56:04.188084+0000","last_active":"2024-09-16T07:56:26.802068+0000","last_peered":"2024-09-16T07:56:26.802068+0000","last_clean":"2024-09-16T07:55:37.016460+0000","last_became_active":"2024-09-16T07:56:04.188084+0000","last_became_peered":"2024-09-16T07:56:04.188084+0000","last_unstale":"2024-09-16T07:56:50.042199+0000","last_undegraded":"2024-09-16T07:56:04.099920+0000","last_fullsized":"2024-09-16T07:56:04.098703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":279,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":279}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"106'733","reported_seq":764,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:27.097568+0000","last_change":"2024-09-16T07:56:04.175306+0000","last_active":"2024-09-16T07:56:27.097568+0000","last_peered":"2024-09-16T07:56:27.097568+0000","last_clean":"2024-09-16T07:55:36.690514+0000","last_became_active":"2024-09-16T07:56:04.175306+0000","last_became_peered":"2024-09-16T07:56:04.175306+0000","last_unstale":"2024-09-16T07:56:50.042201+0000","last_undegraded":"2024-09-16T07:56:04.083289+0000","last_fullsized":"2024-09-16T07:56:04.081485+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":254,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":31552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":254}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.9","version":"109'847","reported_seq":893,"reported_epoch":110,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:56:33.055355+0000","last_change":"2024-09-16T07:56:31.242408+0000","last_active":"2024-09-16T07:56:33.055355+0000","last_peered":"2024-09-16T07:56:33.055355+0000","last_clean":"2024-09-16T07:55:37.019430+0000","last_became_active":"2024-09-16T07:56:31.227591+0000","last_became_peered":"2024-09-16T07:56:31.227591+0000","last_unstale":"2024-09-16T07:56:33.055355+0000","last_undegraded":"2024-09-16T07:56:30.634662+0000","last_fullsized":"2024-09-16T07:56:30.613321+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":200}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"110'817","reported_seq":1439,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.123346+0000","last_change":"2024-09-16T07:56:39.099974+0000","last_active":"2024-09-16T07:56:52.123346+0000","last_peered":"2024-09-16T07:56:52.123346+0000","last_clean":"2024-09-16T07:56:52.123346+0000","last_became_active":"2024-09-16T07:56:39.094850+0000","last_became_peered":"2024-09-16T07:56:39.094850+0000","last_unstale":"2024-09-16T07:56:52.123346+0000","last_undegraded":"2024-09-16T07:56:52.123346+0000","last_fullsized":"2024-09-16T07:56:52.123346+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"110'774","reported_seq":849,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.244861+0000","last_change":"2024-09-16T07:56:52.246248+0000","last_active":"2024-09-16T07:56:52.244861+0000","last_peered":"2024-09-16T07:56:52.244861+0000","last_clean":"2024-09-16T07:56:49.058981+0000","last_became_active":"2024-09-16T07:56:52.238011+0000","last_became_peered":"2024-09-16T07:56:52.238011+0000","last_unstale":"2024-09-16T07:56:52.244861+0000","last_undegraded":"2024-09-16T07:56:52.244861+0000","last_fullsized":"2024-09-16T07:56:52.244861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.054111+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:56:33.054111+0000","last_peered":"2024-09-16T07:56:33.054111+0000","last_clean":"2024-09-16T07:56:33.054111+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:56:33.054111+0000","last_undegraded":"2024-09-16T07:56:33.054111+0000","last_fullsized":"2024-09-16T07:56:33.054111+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":282,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:04.168624+0000","last_change":"2024-09-16T07:56:04.167227+0000","last_active":"2024-09-16T07:56:04.168624+0000","last_peered":"2024-09-16T07:56:04.168624+0000","last_clean":"2024-09-16T07:55:28.056115+0000","last_became_active":"2024-09-16T07:56:04.167227+0000","last_became_peered":"2024-09-16T07:56:04.167227+0000","last_unstale":"2024-09-16T07:56:50.042204+0000","last_undegraded":"2024-09-16T07:56:04.100204+0000","last_fullsized":"2024-09-16T07:56:04.098024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"110'800","reported_seq":852,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.066295+0000","last_change":"2024-09-16T07:55:24.512496+0000","last_active":"2024-09-16T07:56:33.066295+0000","last_peered":"2024-09-16T07:56:33.066295+0000","last_clean":"2024-09-16T07:56:33.066295+0000","last_became_active":"2024-09-16T07:55:24.193135+0000","last_became_peered":"2024-09-16T07:55:24.193135+0000","last_unstale":"2024-09-16T07:56:33.066295+0000","last_undegraded":"2024-09-16T07:56:33.066295+0000","last_fullsized":"2024-09-16T07:56:33.066295+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.223011+0000","last_change":"2024-09-16T07:56:52.225705+0000","last_active":"2024-09-16T07:56:52.223011+0000","last_peered":"2024-09-16T07:56:52.223011+0000","last_clean":"2024-09-16T07:56:49.056656+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:56:52.223011+0000","last_undegraded":"2024-09-16T07:56:52.223011+0000","last_fullsized":"2024-09-16T07:56:52.223011+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"109'854","reported_seq":1016,"reported_epoch":110,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T07:56:33.155656+0000","last_change":"2024-09-16T07:56:31.333217+0000","last_active":"2024-09-16T07:56:33.155656+0000","last_peered":"2024-09-16T07:56:33.155656+0000","last_clean":"2024-09-16T07:55:36.633330+0000","last_became_active":"2024-09-16T07:56:31.127951+0000","last_became_peered":"2024-09-16T07:56:31.127951+0000","last_unstale":"2024-09-16T07:56:33.155656+0000","last_undegraded":"2024-09-16T07:56:33.155656+0000","last_fullsized":"2024-09-16T07:56:30.640913+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14352384,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":853,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[{"shards":"0,3","objects":219}],"blocked_by":[],"up_primary":2,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.153952+0000","last_change":"2024-09-16T07:56:04.153196+0000","last_active":"2024-09-16T07:56:04.153952+0000","last_peered":"2024-09-16T07:56:04.153952+0000","last_clean":"2024-09-16T07:55:28.045293+0000","last_became_active":"2024-09-16T07:56:04.153196+0000","last_became_peered":"2024-09-16T07:56:04.153196+0000","last_unstale":"2024-09-16T07:56:50.042206+0000","last_undegraded":"2024-09-16T07:56:04.153952+0000","last_fullsized":"2024-09-16T07:56:04.074241+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"109'815","reported_seq":863,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.061359+0000","last_change":"2024-09-16T07:55:24.360283+0000","last_active":"2024-09-16T07:56:33.061359+0000","last_peered":"2024-09-16T07:56:33.061359+0000","last_clean":"2024-09-16T07:56:33.061359+0000","last_became_active":"2024-09-16T07:55:24.148057+0000","last_became_peered":"2024-09-16T07:55:24.148057+0000","last_unstale":"2024-09-16T07:56:33.061359+0000","last_undegraded":"2024-09-16T07:56:33.061359+0000","last_fullsized":"2024-09-16T07:56:33.061359+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.259755+0000","last_change":"2024-09-16T07:56:52.263340+0000","last_active":"2024-09-16T07:56:52.259755+0000","last_peered":"2024-09-16T07:56:52.259755+0000","last_clean":"2024-09-16T07:56:49.060679+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:56:52.259755+0000","last_undegraded":"2024-09-16T07:56:52.259755+0000","last_fullsized":"2024-09-16T07:56:52.259755+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"104'548","reported_seq":578,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:36.763272+0000","last_change":"2024-09-16T07:56:03.080305+0000","last_active":"2024-09-16T07:56:03.080305+0000","last_peered":"2024-09-16T07:55:36.763272+0000","last_clean":"2024-09-16T07:55:36.763272+0000","last_became_active":"2024-09-16T07:55:24.229040+0000","last_became_peered":"2024-09-16T07:55:24.229040+0000","last_unstale":"2024-09-16T07:55:36.763272+0000","last_undegraded":"2024-09-16T07:55:36.763272+0000","last_fullsized":"2024-09-16T07:55:36.763272+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35848192,"num_objects":547,"num_object_clones":0,"num_object_copies":1641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":35008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":266,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:24.068405+0000","last_change":"2024-09-16T07:55:22.119290+0000","last_active":"2024-09-16T07:55:22.119290+0000","last_peered":"2024-09-16T07:54:28.031314+0000","last_clean":"2024-09-16T07:54:28.031314+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:55:24.068405+0000","last_undegraded":"2024-09-16T07:55:24.068405+0000","last_fullsized":"2024-09-16T07:55:24.068405+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"106'788","reported_seq":819,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.810584+0000","last_change":"2024-09-16T07:56:04.233329+0000","last_active":"2024-09-16T07:56:26.810584+0000","last_peered":"2024-09-16T07:56:26.810584+0000","last_clean":"2024-09-16T07:55:36.614734+0000","last_became_active":"2024-09-16T07:56:04.233329+0000","last_became_peered":"2024-09-16T07:56:04.233329+0000","last_unstale":"2024-09-16T07:56:50.042213+0000","last_undegraded":"2024-09-16T07:56:04.094852+0000","last_fullsized":"2024-09-16T07:56:04.092743+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":241,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":241}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":266,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.056382+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:56:33.056382+0000","last_peered":"2024-09-16T07:56:33.056382+0000","last_clean":"2024-09-16T07:56:33.056382+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:56:33.056382+0000","last_undegraded":"2024-09-16T07:56:33.056382+0000","last_fullsized":"2024-09-16T07:56:33.056382+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"106'740","reported_seq":772,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.778896+0000","last_change":"2024-09-16T07:56:04.242962+0000","last_active":"2024-09-16T07:56:26.778896+0000","last_peered":"2024-09-16T07:56:26.778896+0000","last_clean":"2024-09-16T07:55:36.812189+0000","last_became_active":"2024-09-16T07:56:04.242962+0000","last_became_peered":"2024-09-16T07:56:04.242962+0000","last_unstale":"2024-09-16T07:56:50.042216+0000","last_undegraded":"2024-09-16T07:56:04.106106+0000","last_fullsized":"2024-09-16T07:56:04.103930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":236}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":272,"reported_epoch":106,"state":"active+undersized","last_fresh":"2024-09-16T07:56:04.169384+0000","last_change":"2024-09-16T07:56:04.168623+0000","last_active":"2024-09-16T07:56:04.169384+0000","last_peered":"2024-09-16T07:56:04.169384+0000","last_clean":"2024-09-16T07:54:28.024466+0000","last_became_active":"2024-09-16T07:56:04.168623+0000","last_became_peered":"2024-09-16T07:56:04.168623+0000","last_unstale":"2024-09-16T07:56:04.169384+0000","last_undegraded":"2024-09-16T07:56:04.169384+0000","last_fullsized":"2024-09-16T07:56:04.085808+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"110'902","reported_seq":978,"reported_epoch":121,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T07:56:52.265701+0000","last_change":"2024-09-16T07:56:52.268058+0000","last_active":"2024-09-16T07:56:52.265701+0000","last_peered":"2024-09-16T07:56:52.265701+0000","last_clean":"2024-09-16T07:56:49.061054+0000","last_became_active":"2024-09-16T07:56:52.254107+0000","last_became_peered":"2024-09-16T07:56:52.254107+0000","last_unstale":"2024-09-16T07:56:52.265701+0000","last_undegraded":"2024-09-16T07:56:52.160213+0000","last_fullsized":"2024-09-16T07:56:52.265701+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","3"],"object_location_counts":[{"shards":"0,1,3","objects":203}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":275,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.168913+0000","last_change":"2024-09-16T07:56:04.168188+0000","last_active":"2024-09-16T07:56:04.168913+0000","last_peered":"2024-09-16T07:56:04.168913+0000","last_clean":"2024-09-16T07:55:28.056128+0000","last_became_active":"2024-09-16T07:56:04.168188+0000","last_became_peered":"2024-09-16T07:56:04.168188+0000","last_unstale":"2024-09-16T07:56:50.042218+0000","last_undegraded":"2024-09-16T07:56:04.168913+0000","last_fullsized":"2024-09-16T07:56:04.078402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":263323672,"num_objects":4019,"num_object_clones":0,"num_object_copies":12057,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12621,"num_write_kb":532417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":339,"num_bytes_recovered":1245184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56963072,"data_stored":911212616,"data_compressed":43268504,"data_compressed_allocated":56950784,"data_compressed_original":911212544,"omap_allocated":0,"internal_metadata":0},"log_size":12629,"ondisk_log_size":12629,"up":41,"acting":38,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":19,"acting":19,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122197,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48800,"kb_used_data":10832,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94323040,"statfs":{"total":96636764160,"available":96586792960,"internally_reserved":0,"allocated":11091968,"data_stored":162831840,"data_compressed":7716681,"data_compressed_allocated":10158080,"data_compressed_original":162447360,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103436,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77812,"kb_used_data":22756,"kb_used_omap":0,"kb_used_meta":55040,"kb_avail":94294028,"statfs":{"total":96636764160,"available":96557084672,"internally_reserved":0,"allocated":23302144,"data_stored":358831418,"data_compressed":17023929,"data_compressed_allocated":22409216,"data_compressed_original":358465536,"omap_allocated":0,"internal_metadata":56360960},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73004,"kb_used_data":14556,"kb_used_omap":0,"kb_used_meta":58432,"kb_avail":94298836,"statfs":{"total":96636764160,"available":96562008064,"internally_reserved":0,"allocated":14905344,"data_stored":224554674,"data_compressed":10646152,"data_compressed_allocated":14012416,"data_compressed_original":224198656,"omap_allocated":0,"internal_metadata":59834368},"hb_peers":[0,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48616,"kb_used_data":11608,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":11886592,"data_stored":173950627,"data_compressed":8242609,"data_compressed_allocated":10850304,"data_compressed_original":173522944,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10813440,"data_stored":172949528,"data_compressed":8212568,"data_compressed_allocated":10809344,"data_compressed_original":172949504,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13541376,"data_stored":216596504,"data_compressed":10285160,"data_compressed_allocated":13537280,"data_compressed_original":216596480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22913024,"data_stored":366608384,"data_compressed":17407784,"data_compressed_allocated":22913024,"data_compressed_original":366608384,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9695232,"data_stored":155058200,"data_compressed":7362992,"data_compressed_allocated":9691136,"data_compressed_original":155058176,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:56:55.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:56:55.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:55.210+0000 7fc610a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:55.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:55.223+0000 7fc610a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:55.582 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:56:55.582 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 1 pg inactive, 2 pgs peering","count":3},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2181/12069 objects degraded (18.071%), 10 pgs degraded","count":10},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":717,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":123,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473411,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":2},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":8},{"state_name":"stale+active+undersized+degraded","count":7},{"state_name":"peering","count":2},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"stale+active+undersized","count":2},{"state_name":"active+undersized","count":1},{"state_name":"active+recovery_wait+degraded","count":1},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"stale+active+clean","count":1}],"num_pgs":25,"num_pools":3,"num_objects":4023,"data_bytes":263914048,"bytes_used":254189568,"bytes_avail":386292867072,"bytes_total":386547056640,"inactive_pgs_ratio":0.079999998211860657,"degraded_objects":2181,"degraded_total":12069,"degraded_ratio":0.18071091225453642,"recovering_objects_per_sec":67,"recovering_bytes_per_sec":49138,"recovering_keys_per_sec":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":81},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:56:55.600 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:56:55.601 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:56:55.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:55.750+0000 7f2444351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:55.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:55.762+0000 7f2444351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:55.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:56:55.992 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:56:56.010 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":470,"stamp":"2024-09-16T07:56:54.443086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":263914048,"num_objects":4023,"num_object_clones":0,"num_object_copies":12069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2181,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12701,"num_write_kb":533524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":340,"num_bytes_recovered":1245184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12684,"ondisk_log_size":12684,"up":63,"acting":60,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248232,"kb_used_data":59752,"kb_used_omap":0,"kb_used_meta":188416,"kb_avail":377239128,"statfs":{"total":386547056640,"available":386292867072,"internally_reserved":0,"allocated":61186048,"data_stored":920168559,"data_compressed":43629371,"data_compressed_allocated":57430016,"data_compressed_original":918634496,"omap_allocated":0,"internal_metadata":192937984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-21364736,"num_objects":-326,"num_object_clones":0,"num_object_copies":-978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-323,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001089"},"pg_stats":[{"pgid":"6.f","version":"106'790","reported_seq":830,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.978698+0000","last_change":"2024-09-16T07:56:04.201034+0000","last_active":"2024-09-16T07:56:26.978698+0000","last_peered":"2024-09-16T07:56:26.978698+0000","last_clean":"2024-09-16T07:55:36.831185+0000","last_became_active":"2024-09-16T07:56:04.201034+0000","last_became_peered":"2024-09-16T07:56:04.201034+0000","last_unstale":"2024-09-16T07:56:50.042192+0000","last_undegraded":"2024-09-16T07:56:04.086716+0000","last_fullsized":"2024-09-16T07:56:04.085419+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17891328,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":273,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":273}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"106'822","reported_seq":863,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.713938+0000","last_change":"2024-09-16T07:56:04.234616+0000","last_active":"2024-09-16T07:56:26.713938+0000","last_peered":"2024-09-16T07:56:26.713938+0000","last_clean":"2024-09-16T07:55:36.894044+0000","last_became_active":"2024-09-16T07:56:04.234616+0000","last_became_peered":"2024-09-16T07:56:04.234616+0000","last_unstale":"2024-09-16T07:56:50.042195+0000","last_undegraded":"2024-09-16T07:56:04.095494+0000","last_fullsized":"2024-09-16T07:56:04.093963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":300}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"106'784","reported_seq":823,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-09-16T07:56:26.993304+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:56:26.993304+0000","last_peered":"2024-09-16T07:56:26.993304+0000","last_clean":"2024-09-16T07:56:26.993304+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:56:50.042197+0000","last_undegraded":"2024-09-16T07:56:26.993304+0000","last_fullsized":"2024-09-16T07:56:26.993304+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925272,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":784,"num_write_kb":32833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"109'850","reported_seq":901,"reported_epoch":110,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:56:33.056863+0000","last_change":"2024-09-16T07:56:31.196007+0000","last_active":"2024-09-16T07:56:33.056863+0000","last_peered":"2024-09-16T07:56:33.056863+0000","last_clean":"2024-09-16T07:55:36.958095+0000","last_became_active":"2024-09-16T07:56:31.113588+0000","last_became_peered":"2024-09-16T07:56:31.113588+0000","last_unstale":"2024-09-16T07:56:33.056863+0000","last_undegraded":"2024-09-16T07:56:30.612013+0000","last_fullsized":"2024-09-16T07:56:30.587298+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":296,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":850,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":215}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"106'765","reported_seq":796,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.802068+0000","last_change":"2024-09-16T07:56:04.188084+0000","last_active":"2024-09-16T07:56:26.802068+0000","last_peered":"2024-09-16T07:56:26.802068+0000","last_clean":"2024-09-16T07:55:37.016460+0000","last_became_active":"2024-09-16T07:56:04.188084+0000","last_became_peered":"2024-09-16T07:56:04.188084+0000","last_unstale":"2024-09-16T07:56:50.042199+0000","last_undegraded":"2024-09-16T07:56:04.099920+0000","last_fullsized":"2024-09-16T07:56:04.098703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":279,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":279}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"106'733","reported_seq":764,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:27.097568+0000","last_change":"2024-09-16T07:56:04.175306+0000","last_active":"2024-09-16T07:56:27.097568+0000","last_peered":"2024-09-16T07:56:27.097568+0000","last_clean":"2024-09-16T07:55:36.690514+0000","last_became_active":"2024-09-16T07:56:04.175306+0000","last_became_peered":"2024-09-16T07:56:04.175306+0000","last_unstale":"2024-09-16T07:56:50.042201+0000","last_undegraded":"2024-09-16T07:56:04.083289+0000","last_fullsized":"2024-09-16T07:56:04.081485+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":254,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":31552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":254}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.9","version":"109'847","reported_seq":893,"reported_epoch":110,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:56:33.055355+0000","last_change":"2024-09-16T07:56:31.242408+0000","last_active":"2024-09-16T07:56:33.055355+0000","last_peered":"2024-09-16T07:56:33.055355+0000","last_clean":"2024-09-16T07:55:37.019430+0000","last_became_active":"2024-09-16T07:56:31.227591+0000","last_became_peered":"2024-09-16T07:56:31.227591+0000","last_unstale":"2024-09-16T07:56:33.055355+0000","last_undegraded":"2024-09-16T07:56:30.634662+0000","last_fullsized":"2024-09-16T07:56:30.613321+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":200}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"110'817","reported_seq":1439,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.123346+0000","last_change":"2024-09-16T07:56:39.099974+0000","last_active":"2024-09-16T07:56:52.123346+0000","last_peered":"2024-09-16T07:56:52.123346+0000","last_clean":"2024-09-16T07:56:52.123346+0000","last_became_active":"2024-09-16T07:56:39.094850+0000","last_became_peered":"2024-09-16T07:56:39.094850+0000","last_unstale":"2024-09-16T07:56:52.123346+0000","last_undegraded":"2024-09-16T07:56:52.123346+0000","last_fullsized":"2024-09-16T07:56:52.123346+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"110'774","reported_seq":849,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.244861+0000","last_change":"2024-09-16T07:56:52.246248+0000","last_active":"2024-09-16T07:56:52.244861+0000","last_peered":"2024-09-16T07:56:52.244861+0000","last_clean":"2024-09-16T07:56:49.058981+0000","last_became_active":"2024-09-16T07:56:52.238011+0000","last_became_peered":"2024-09-16T07:56:52.238011+0000","last_unstale":"2024-09-16T07:56:52.244861+0000","last_undegraded":"2024-09-16T07:56:52.244861+0000","last_fullsized":"2024-09-16T07:56:52.244861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.054111+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:56:33.054111+0000","last_peered":"2024-09-16T07:56:33.054111+0000","last_clean":"2024-09-16T07:56:33.054111+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:56:33.054111+0000","last_undegraded":"2024-09-16T07:56:33.054111+0000","last_fullsized":"2024-09-16T07:56:33.054111+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":282,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:04.168624+0000","last_change":"2024-09-16T07:56:04.167227+0000","last_active":"2024-09-16T07:56:04.168624+0000","last_peered":"2024-09-16T07:56:04.168624+0000","last_clean":"2024-09-16T07:55:28.056115+0000","last_became_active":"2024-09-16T07:56:04.167227+0000","last_became_peered":"2024-09-16T07:56:04.167227+0000","last_unstale":"2024-09-16T07:56:50.042204+0000","last_undegraded":"2024-09-16T07:56:04.100204+0000","last_fullsized":"2024-09-16T07:56:04.098024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"110'800","reported_seq":852,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.066295+0000","last_change":"2024-09-16T07:55:24.512496+0000","last_active":"2024-09-16T07:56:33.066295+0000","last_peered":"2024-09-16T07:56:33.066295+0000","last_clean":"2024-09-16T07:56:33.066295+0000","last_became_active":"2024-09-16T07:55:24.193135+0000","last_became_peered":"2024-09-16T07:55:24.193135+0000","last_unstale":"2024-09-16T07:56:33.066295+0000","last_undegraded":"2024-09-16T07:56:33.066295+0000","last_fullsized":"2024-09-16T07:56:33.066295+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.223011+0000","last_change":"2024-09-16T07:56:52.225705+0000","last_active":"2024-09-16T07:56:52.223011+0000","last_peered":"2024-09-16T07:56:52.223011+0000","last_clean":"2024-09-16T07:56:49.056656+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:56:52.223011+0000","last_undegraded":"2024-09-16T07:56:52.223011+0000","last_fullsized":"2024-09-16T07:56:52.223011+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"109'854","reported_seq":1016,"reported_epoch":110,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T07:56:33.155656+0000","last_change":"2024-09-16T07:56:31.333217+0000","last_active":"2024-09-16T07:56:33.155656+0000","last_peered":"2024-09-16T07:56:33.155656+0000","last_clean":"2024-09-16T07:55:36.633330+0000","last_became_active":"2024-09-16T07:56:31.127951+0000","last_became_peered":"2024-09-16T07:56:31.127951+0000","last_unstale":"2024-09-16T07:56:33.155656+0000","last_undegraded":"2024-09-16T07:56:33.155656+0000","last_fullsized":"2024-09-16T07:56:30.640913+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14352384,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":853,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[{"shards":"0,3","objects":219}],"blocked_by":[],"up_primary":2,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.153952+0000","last_change":"2024-09-16T07:56:04.153196+0000","last_active":"2024-09-16T07:56:04.153952+0000","last_peered":"2024-09-16T07:56:04.153952+0000","last_clean":"2024-09-16T07:55:28.045293+0000","last_became_active":"2024-09-16T07:56:04.153196+0000","last_became_peered":"2024-09-16T07:56:04.153196+0000","last_unstale":"2024-09-16T07:56:50.042206+0000","last_undegraded":"2024-09-16T07:56:04.153952+0000","last_fullsized":"2024-09-16T07:56:04.074241+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"109'815","reported_seq":863,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.061359+0000","last_change":"2024-09-16T07:55:24.360283+0000","last_active":"2024-09-16T07:56:33.061359+0000","last_peered":"2024-09-16T07:56:33.061359+0000","last_clean":"2024-09-16T07:56:33.061359+0000","last_became_active":"2024-09-16T07:55:24.148057+0000","last_became_peered":"2024-09-16T07:55:24.148057+0000","last_unstale":"2024-09-16T07:56:33.061359+0000","last_undegraded":"2024-09-16T07:56:33.061359+0000","last_fullsized":"2024-09-16T07:56:33.061359+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.259755+0000","last_change":"2024-09-16T07:56:52.263340+0000","last_active":"2024-09-16T07:56:52.259755+0000","last_peered":"2024-09-16T07:56:52.259755+0000","last_clean":"2024-09-16T07:56:49.060679+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:56:52.259755+0000","last_undegraded":"2024-09-16T07:56:52.259755+0000","last_fullsized":"2024-09-16T07:56:52.259755+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"104'548","reported_seq":578,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:36.763272+0000","last_change":"2024-09-16T07:56:03.080305+0000","last_active":"2024-09-16T07:56:03.080305+0000","last_peered":"2024-09-16T07:55:36.763272+0000","last_clean":"2024-09-16T07:55:36.763272+0000","last_became_active":"2024-09-16T07:55:24.229040+0000","last_became_peered":"2024-09-16T07:55:24.229040+0000","last_unstale":"2024-09-16T07:55:36.763272+0000","last_undegraded":"2024-09-16T07:55:36.763272+0000","last_fullsized":"2024-09-16T07:55:36.763272+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35848192,"num_objects":547,"num_object_clones":0,"num_object_copies":1641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":35008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":266,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:24.068405+0000","last_change":"2024-09-16T07:55:22.119290+0000","last_active":"2024-09-16T07:55:22.119290+0000","last_peered":"2024-09-16T07:54:28.031314+0000","last_clean":"2024-09-16T07:54:28.031314+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:55:24.068405+0000","last_undegraded":"2024-09-16T07:55:24.068405+0000","last_fullsized":"2024-09-16T07:55:24.068405+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"106'788","reported_seq":819,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.810584+0000","last_change":"2024-09-16T07:56:04.233329+0000","last_active":"2024-09-16T07:56:26.810584+0000","last_peered":"2024-09-16T07:56:26.810584+0000","last_clean":"2024-09-16T07:55:36.614734+0000","last_became_active":"2024-09-16T07:56:04.233329+0000","last_became_peered":"2024-09-16T07:56:04.233329+0000","last_unstale":"2024-09-16T07:56:50.042213+0000","last_undegraded":"2024-09-16T07:56:04.094852+0000","last_fullsized":"2024-09-16T07:56:04.092743+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":241,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":241}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":266,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.056382+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:56:33.056382+0000","last_peered":"2024-09-16T07:56:33.056382+0000","last_clean":"2024-09-16T07:56:33.056382+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:56:33.056382+0000","last_undegraded":"2024-09-16T07:56:33.056382+0000","last_fullsized":"2024-09-16T07:56:33.056382+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"106'740","reported_seq":772,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.778896+0000","last_change":"2024-09-16T07:56:04.242962+0000","last_active":"2024-09-16T07:56:26.778896+0000","last_peered":"2024-09-16T07:56:26.778896+0000","last_clean":"2024-09-16T07:55:36.812189+0000","last_became_active":"2024-09-16T07:56:04.242962+0000","last_became_peered":"2024-09-16T07:56:04.242962+0000","last_unstale":"2024-09-16T07:56:50.042216+0000","last_undegraded":"2024-09-16T07:56:04.106106+0000","last_fullsized":"2024-09-16T07:56:04.103930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":236}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":272,"reported_epoch":106,"state":"active+undersized","last_fresh":"2024-09-16T07:56:04.169384+0000","last_change":"2024-09-16T07:56:04.168623+0000","last_active":"2024-09-16T07:56:04.169384+0000","last_peered":"2024-09-16T07:56:04.169384+0000","last_clean":"2024-09-16T07:54:28.024466+0000","last_became_active":"2024-09-16T07:56:04.168623+0000","last_became_peered":"2024-09-16T07:56:04.168623+0000","last_unstale":"2024-09-16T07:56:04.169384+0000","last_undegraded":"2024-09-16T07:56:04.169384+0000","last_fullsized":"2024-09-16T07:56:04.085808+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"110'902","reported_seq":978,"reported_epoch":121,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T07:56:52.265701+0000","last_change":"2024-09-16T07:56:52.268058+0000","last_active":"2024-09-16T07:56:52.265701+0000","last_peered":"2024-09-16T07:56:52.265701+0000","last_clean":"2024-09-16T07:56:49.061054+0000","last_became_active":"2024-09-16T07:56:52.254107+0000","last_became_peered":"2024-09-16T07:56:52.254107+0000","last_unstale":"2024-09-16T07:56:52.265701+0000","last_undegraded":"2024-09-16T07:56:52.160213+0000","last_fullsized":"2024-09-16T07:56:52.265701+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","3"],"object_location_counts":[{"shards":"0,1,3","objects":203}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":275,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.168913+0000","last_change":"2024-09-16T07:56:04.168188+0000","last_active":"2024-09-16T07:56:04.168913+0000","last_peered":"2024-09-16T07:56:04.168913+0000","last_clean":"2024-09-16T07:55:28.056128+0000","last_became_active":"2024-09-16T07:56:04.168188+0000","last_became_peered":"2024-09-16T07:56:04.168188+0000","last_unstale":"2024-09-16T07:56:50.042218+0000","last_undegraded":"2024-09-16T07:56:04.168913+0000","last_fullsized":"2024-09-16T07:56:04.078402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":263323672,"num_objects":4019,"num_object_clones":0,"num_object_copies":12057,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12621,"num_write_kb":532417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":339,"num_bytes_recovered":1245184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56963072,"data_stored":911212616,"data_compressed":43268504,"data_compressed_allocated":56950784,"data_compressed_original":911212544,"omap_allocated":0,"internal_metadata":0},"log_size":12629,"ondisk_log_size":12629,"up":41,"acting":38,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":19,"acting":19,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122197,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48800,"kb_used_data":10832,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94323040,"statfs":{"total":96636764160,"available":96586792960,"internally_reserved":0,"allocated":11091968,"data_stored":162831840,"data_compressed":7716681,"data_compressed_allocated":10158080,"data_compressed_original":162447360,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103436,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77812,"kb_used_data":22756,"kb_used_omap":0,"kb_used_meta":55040,"kb_avail":94294028,"statfs":{"total":96636764160,"available":96557084672,"internally_reserved":0,"allocated":23302144,"data_stored":358831418,"data_compressed":17023929,"data_compressed_allocated":22409216,"data_compressed_original":358465536,"omap_allocated":0,"internal_metadata":56360960},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73004,"kb_used_data":14556,"kb_used_omap":0,"kb_used_meta":58432,"kb_avail":94298836,"statfs":{"total":96636764160,"available":96562008064,"internally_reserved":0,"allocated":14905344,"data_stored":224554674,"data_compressed":10646152,"data_compressed_allocated":14012416,"data_compressed_original":224198656,"omap_allocated":0,"internal_metadata":59834368},"hb_peers":[0,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48616,"kb_used_data":11608,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":11886592,"data_stored":173950627,"data_compressed":8242609,"data_compressed_allocated":10850304,"data_compressed_original":173522944,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10813440,"data_stored":172949528,"data_compressed":8212568,"data_compressed_allocated":10809344,"data_compressed_original":172949504,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13541376,"data_stored":216596504,"data_compressed":10285160,"data_compressed_allocated":13537280,"data_compressed_original":216596480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22913024,"data_stored":366608384,"data_compressed":17407784,"data_compressed_allocated":22913024,"data_compressed_original":366608384,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9695232,"data_stored":155058200,"data_compressed":7362992,"data_compressed_allocated":9691136,"data_compressed_original":155058176,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:56:57.513 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:56:57.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:57.661+0000 7f6505591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:57.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:57.670+0000 7f6505591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:59.012 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:56:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:59.163+0000 7f5eccd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:59.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:59.176+0000 7f5eccd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:59.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:56:59.568 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:56:59.591 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":473,"stamp":"2024-09-16T07:56:58.444245+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":263914048,"num_objects":4023,"num_object_clones":0,"num_object_copies":12069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2181,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":12701,"num_write_kb":533524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":340,"num_bytes_recovered":1245184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12684,"ondisk_log_size":12684,"up":63,"acting":60,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248232,"kb_used_data":59752,"kb_used_omap":0,"kb_used_meta":188416,"kb_avail":377239128,"statfs":{"total":386547056640,"available":386292867072,"internally_reserved":0,"allocated":61186048,"data_stored":920168559,"data_compressed":43629371,"data_compressed_allocated":57430016,"data_compressed_original":918634496,"omap_allocated":0,"internal_metadata":192937984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001804"},"pg_stats":[{"pgid":"6.f","version":"106'790","reported_seq":830,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.978698+0000","last_change":"2024-09-16T07:56:04.201034+0000","last_active":"2024-09-16T07:56:26.978698+0000","last_peered":"2024-09-16T07:56:26.978698+0000","last_clean":"2024-09-16T07:55:36.831185+0000","last_became_active":"2024-09-16T07:56:04.201034+0000","last_became_peered":"2024-09-16T07:56:04.201034+0000","last_unstale":"2024-09-16T07:56:50.042192+0000","last_undegraded":"2024-09-16T07:56:04.086716+0000","last_fullsized":"2024-09-16T07:56:04.085419+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17891328,"num_objects":273,"num_object_clones":0,"num_object_copies":819,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":273,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":273}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"106'822","reported_seq":863,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.713938+0000","last_change":"2024-09-16T07:56:04.234616+0000","last_active":"2024-09-16T07:56:26.713938+0000","last_peered":"2024-09-16T07:56:26.713938+0000","last_clean":"2024-09-16T07:55:36.894044+0000","last_became_active":"2024-09-16T07:56:04.234616+0000","last_became_peered":"2024-09-16T07:56:04.234616+0000","last_unstale":"2024-09-16T07:56:50.042195+0000","last_undegraded":"2024-09-16T07:56:04.095494+0000","last_fullsized":"2024-09-16T07:56:04.093963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":300}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"106'784","reported_seq":823,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-09-16T07:56:26.993304+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:56:26.993304+0000","last_peered":"2024-09-16T07:56:26.993304+0000","last_clean":"2024-09-16T07:56:26.993304+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:56:50.042197+0000","last_undegraded":"2024-09-16T07:56:26.993304+0000","last_fullsized":"2024-09-16T07:56:26.993304+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925272,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":784,"num_write_kb":32833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"109'850","reported_seq":901,"reported_epoch":110,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:56:33.056863+0000","last_change":"2024-09-16T07:56:31.196007+0000","last_active":"2024-09-16T07:56:33.056863+0000","last_peered":"2024-09-16T07:56:33.056863+0000","last_clean":"2024-09-16T07:55:36.958095+0000","last_became_active":"2024-09-16T07:56:31.113588+0000","last_became_peered":"2024-09-16T07:56:31.113588+0000","last_unstale":"2024-09-16T07:56:33.056863+0000","last_undegraded":"2024-09-16T07:56:30.612013+0000","last_fullsized":"2024-09-16T07:56:30.587298+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":296,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":850,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":215}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"106'765","reported_seq":796,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.802068+0000","last_change":"2024-09-16T07:56:04.188084+0000","last_active":"2024-09-16T07:56:26.802068+0000","last_peered":"2024-09-16T07:56:26.802068+0000","last_clean":"2024-09-16T07:55:37.016460+0000","last_became_active":"2024-09-16T07:56:04.188084+0000","last_became_peered":"2024-09-16T07:56:04.188084+0000","last_unstale":"2024-09-16T07:56:50.042199+0000","last_undegraded":"2024-09-16T07:56:04.099920+0000","last_fullsized":"2024-09-16T07:56:04.098703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":279,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":279}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"106'733","reported_seq":764,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:27.097568+0000","last_change":"2024-09-16T07:56:04.175306+0000","last_active":"2024-09-16T07:56:27.097568+0000","last_peered":"2024-09-16T07:56:27.097568+0000","last_clean":"2024-09-16T07:55:36.690514+0000","last_became_active":"2024-09-16T07:56:04.175306+0000","last_became_peered":"2024-09-16T07:56:04.175306+0000","last_unstale":"2024-09-16T07:56:50.042201+0000","last_undegraded":"2024-09-16T07:56:04.083289+0000","last_fullsized":"2024-09-16T07:56:04.081485+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":254,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":31552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":254}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.9","version":"109'847","reported_seq":893,"reported_epoch":110,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:56:33.055355+0000","last_change":"2024-09-16T07:56:31.242408+0000","last_active":"2024-09-16T07:56:33.055355+0000","last_peered":"2024-09-16T07:56:33.055355+0000","last_clean":"2024-09-16T07:55:37.019430+0000","last_became_active":"2024-09-16T07:56:31.227591+0000","last_became_peered":"2024-09-16T07:56:31.227591+0000","last_unstale":"2024-09-16T07:56:33.055355+0000","last_undegraded":"2024-09-16T07:56:30.634662+0000","last_fullsized":"2024-09-16T07:56:30.613321+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":200}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"110'817","reported_seq":1439,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.123346+0000","last_change":"2024-09-16T07:56:39.099974+0000","last_active":"2024-09-16T07:56:52.123346+0000","last_peered":"2024-09-16T07:56:52.123346+0000","last_clean":"2024-09-16T07:56:52.123346+0000","last_became_active":"2024-09-16T07:56:39.094850+0000","last_became_peered":"2024-09-16T07:56:39.094850+0000","last_unstale":"2024-09-16T07:56:52.123346+0000","last_undegraded":"2024-09-16T07:56:52.123346+0000","last_fullsized":"2024-09-16T07:56:52.123346+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"110'774","reported_seq":849,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.244861+0000","last_change":"2024-09-16T07:56:52.246248+0000","last_active":"2024-09-16T07:56:52.244861+0000","last_peered":"2024-09-16T07:56:52.244861+0000","last_clean":"2024-09-16T07:56:49.058981+0000","last_became_active":"2024-09-16T07:56:52.238011+0000","last_became_peered":"2024-09-16T07:56:52.238011+0000","last_unstale":"2024-09-16T07:56:52.244861+0000","last_undegraded":"2024-09-16T07:56:52.244861+0000","last_fullsized":"2024-09-16T07:56:52.244861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.054111+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:56:33.054111+0000","last_peered":"2024-09-16T07:56:33.054111+0000","last_clean":"2024-09-16T07:56:33.054111+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:56:33.054111+0000","last_undegraded":"2024-09-16T07:56:33.054111+0000","last_fullsized":"2024-09-16T07:56:33.054111+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":282,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:04.168624+0000","last_change":"2024-09-16T07:56:04.167227+0000","last_active":"2024-09-16T07:56:04.168624+0000","last_peered":"2024-09-16T07:56:04.168624+0000","last_clean":"2024-09-16T07:55:28.056115+0000","last_became_active":"2024-09-16T07:56:04.167227+0000","last_became_peered":"2024-09-16T07:56:04.167227+0000","last_unstale":"2024-09-16T07:56:50.042204+0000","last_undegraded":"2024-09-16T07:56:04.100204+0000","last_fullsized":"2024-09-16T07:56:04.098024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"110'800","reported_seq":852,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.066295+0000","last_change":"2024-09-16T07:55:24.512496+0000","last_active":"2024-09-16T07:56:33.066295+0000","last_peered":"2024-09-16T07:56:33.066295+0000","last_clean":"2024-09-16T07:56:33.066295+0000","last_became_active":"2024-09-16T07:55:24.193135+0000","last_became_peered":"2024-09-16T07:55:24.193135+0000","last_unstale":"2024-09-16T07:56:33.066295+0000","last_undegraded":"2024-09-16T07:56:33.066295+0000","last_fullsized":"2024-09-16T07:56:33.066295+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.223011+0000","last_change":"2024-09-16T07:56:52.225705+0000","last_active":"2024-09-16T07:56:52.223011+0000","last_peered":"2024-09-16T07:56:52.223011+0000","last_clean":"2024-09-16T07:56:49.056656+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:56:52.223011+0000","last_undegraded":"2024-09-16T07:56:52.223011+0000","last_fullsized":"2024-09-16T07:56:52.223011+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"109'854","reported_seq":1016,"reported_epoch":110,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T07:56:33.155656+0000","last_change":"2024-09-16T07:56:31.333217+0000","last_active":"2024-09-16T07:56:33.155656+0000","last_peered":"2024-09-16T07:56:33.155656+0000","last_clean":"2024-09-16T07:55:36.633330+0000","last_became_active":"2024-09-16T07:56:31.127951+0000","last_became_peered":"2024-09-16T07:56:31.127951+0000","last_unstale":"2024-09-16T07:56:33.155656+0000","last_undegraded":"2024-09-16T07:56:33.155656+0000","last_fullsized":"2024-09-16T07:56:30.640913+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14352384,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":853,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[{"shards":"0,3","objects":219}],"blocked_by":[],"up_primary":2,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.153952+0000","last_change":"2024-09-16T07:56:04.153196+0000","last_active":"2024-09-16T07:56:04.153952+0000","last_peered":"2024-09-16T07:56:04.153952+0000","last_clean":"2024-09-16T07:55:28.045293+0000","last_became_active":"2024-09-16T07:56:04.153196+0000","last_became_peered":"2024-09-16T07:56:04.153196+0000","last_unstale":"2024-09-16T07:56:50.042206+0000","last_undegraded":"2024-09-16T07:56:04.153952+0000","last_fullsized":"2024-09-16T07:56:04.074241+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"109'815","reported_seq":863,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.061359+0000","last_change":"2024-09-16T07:55:24.360283+0000","last_active":"2024-09-16T07:56:33.061359+0000","last_peered":"2024-09-16T07:56:33.061359+0000","last_clean":"2024-09-16T07:56:33.061359+0000","last_became_active":"2024-09-16T07:55:24.148057+0000","last_became_peered":"2024-09-16T07:55:24.148057+0000","last_unstale":"2024-09-16T07:56:33.061359+0000","last_undegraded":"2024-09-16T07:56:33.061359+0000","last_fullsized":"2024-09-16T07:56:33.061359+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.259755+0000","last_change":"2024-09-16T07:56:52.263340+0000","last_active":"2024-09-16T07:56:52.259755+0000","last_peered":"2024-09-16T07:56:52.259755+0000","last_clean":"2024-09-16T07:56:49.060679+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:56:52.259755+0000","last_undegraded":"2024-09-16T07:56:52.259755+0000","last_fullsized":"2024-09-16T07:56:52.259755+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"104'548","reported_seq":578,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:36.763272+0000","last_change":"2024-09-16T07:56:03.080305+0000","last_active":"2024-09-16T07:56:03.080305+0000","last_peered":"2024-09-16T07:55:36.763272+0000","last_clean":"2024-09-16T07:55:36.763272+0000","last_became_active":"2024-09-16T07:55:24.229040+0000","last_became_peered":"2024-09-16T07:55:24.229040+0000","last_unstale":"2024-09-16T07:55:36.763272+0000","last_undegraded":"2024-09-16T07:55:36.763272+0000","last_fullsized":"2024-09-16T07:55:36.763272+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35848192,"num_objects":547,"num_object_clones":0,"num_object_copies":1641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":35008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":266,"reported_epoch":105,"state":"peering","last_fresh":"2024-09-16T07:55:24.068405+0000","last_change":"2024-09-16T07:55:22.119290+0000","last_active":"2024-09-16T07:55:22.119290+0000","last_peered":"2024-09-16T07:54:28.031314+0000","last_clean":"2024-09-16T07:54:28.031314+0000","last_became_active":"2024-09-16T07:54:04.176158+0000","last_became_peered":"2024-09-16T07:54:04.176158+0000","last_unstale":"2024-09-16T07:55:24.068405+0000","last_undegraded":"2024-09-16T07:55:24.068405+0000","last_fullsized":"2024-09-16T07:55:24.068405+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"106'788","reported_seq":819,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.810584+0000","last_change":"2024-09-16T07:56:04.233329+0000","last_active":"2024-09-16T07:56:26.810584+0000","last_peered":"2024-09-16T07:56:26.810584+0000","last_clean":"2024-09-16T07:55:36.614734+0000","last_became_active":"2024-09-16T07:56:04.233329+0000","last_became_peered":"2024-09-16T07:56:04.233329+0000","last_unstale":"2024-09-16T07:56:50.042213+0000","last_undegraded":"2024-09-16T07:56:04.094852+0000","last_fullsized":"2024-09-16T07:56:04.092743+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15794176,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":241,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":241}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":266,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.056382+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:56:33.056382+0000","last_peered":"2024-09-16T07:56:33.056382+0000","last_clean":"2024-09-16T07:56:33.056382+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:56:33.056382+0000","last_undegraded":"2024-09-16T07:56:33.056382+0000","last_fullsized":"2024-09-16T07:56:33.056382+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"106'740","reported_seq":772,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.778896+0000","last_change":"2024-09-16T07:56:04.242962+0000","last_active":"2024-09-16T07:56:26.778896+0000","last_peered":"2024-09-16T07:56:26.778896+0000","last_clean":"2024-09-16T07:55:36.812189+0000","last_became_active":"2024-09-16T07:56:04.242962+0000","last_became_peered":"2024-09-16T07:56:04.242962+0000","last_unstale":"2024-09-16T07:56:50.042216+0000","last_undegraded":"2024-09-16T07:56:04.106106+0000","last_fullsized":"2024-09-16T07:56:04.103930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":236}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":272,"reported_epoch":106,"state":"active+undersized","last_fresh":"2024-09-16T07:56:04.169384+0000","last_change":"2024-09-16T07:56:04.168623+0000","last_active":"2024-09-16T07:56:04.169384+0000","last_peered":"2024-09-16T07:56:04.169384+0000","last_clean":"2024-09-16T07:54:28.024466+0000","last_became_active":"2024-09-16T07:56:04.168623+0000","last_became_peered":"2024-09-16T07:56:04.168623+0000","last_unstale":"2024-09-16T07:56:04.169384+0000","last_undegraded":"2024-09-16T07:56:04.169384+0000","last_fullsized":"2024-09-16T07:56:04.085808+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"110'902","reported_seq":978,"reported_epoch":121,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T07:56:52.265701+0000","last_change":"2024-09-16T07:56:52.268058+0000","last_active":"2024-09-16T07:56:52.265701+0000","last_peered":"2024-09-16T07:56:52.265701+0000","last_clean":"2024-09-16T07:56:49.061054+0000","last_became_active":"2024-09-16T07:56:52.254107+0000","last_became_peered":"2024-09-16T07:56:52.254107+0000","last_unstale":"2024-09-16T07:56:52.265701+0000","last_undegraded":"2024-09-16T07:56:52.160213+0000","last_fullsized":"2024-09-16T07:56:52.265701+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","3"],"object_location_counts":[{"shards":"0,1,3","objects":203}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":275,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.168913+0000","last_change":"2024-09-16T07:56:04.168188+0000","last_active":"2024-09-16T07:56:04.168913+0000","last_peered":"2024-09-16T07:56:04.168913+0000","last_clean":"2024-09-16T07:55:28.056128+0000","last_became_active":"2024-09-16T07:56:04.168188+0000","last_became_peered":"2024-09-16T07:56:04.168188+0000","last_unstale":"2024-09-16T07:56:50.042218+0000","last_undegraded":"2024-09-16T07:56:04.168913+0000","last_fullsized":"2024-09-16T07:56:04.078402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":263323672,"num_objects":4019,"num_object_clones":0,"num_object_copies":12057,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12621,"num_write_kb":532417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":339,"num_bytes_recovered":1245184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":56963072,"data_stored":911212616,"data_compressed":43268504,"data_compressed_allocated":56950784,"data_compressed_original":911212544,"omap_allocated":0,"internal_metadata":0},"log_size":12629,"ondisk_log_size":12629,"up":41,"acting":38,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":19,"acting":19,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122197,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48800,"kb_used_data":10832,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94323040,"statfs":{"total":96636764160,"available":96586792960,"internally_reserved":0,"allocated":11091968,"data_stored":162831840,"data_compressed":7716681,"data_compressed_allocated":10158080,"data_compressed_original":162447360,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":58,"seq":249108103436,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77812,"kb_used_data":22756,"kb_used_omap":0,"kb_used_meta":55040,"kb_avail":94294028,"statfs":{"total":96636764160,"available":96557084672,"internally_reserved":0,"allocated":23302144,"data_stored":358831418,"data_compressed":17023929,"data_compressed_allocated":22409216,"data_compressed_original":358465536,"omap_allocated":0,"internal_metadata":56360960},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73004,"kb_used_data":14556,"kb_used_omap":0,"kb_used_meta":58432,"kb_avail":94298836,"statfs":{"total":96636764160,"available":96562008064,"internally_reserved":0,"allocated":14905344,"data_stored":224554674,"data_compressed":10646152,"data_compressed_allocated":14012416,"data_compressed_original":224198656,"omap_allocated":0,"internal_metadata":59834368},"hb_peers":[0,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48616,"kb_used_data":11608,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":11886592,"data_stored":173950627,"data_compressed":8242609,"data_compressed_allocated":10850304,"data_compressed_original":173522944,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10813440,"data_stored":172949528,"data_compressed":8212568,"data_compressed_allocated":10809344,"data_compressed_original":172949504,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13541376,"data_stored":216596504,"data_compressed":10285160,"data_compressed_allocated":13537280,"data_compressed_original":216596480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22913024,"data_stored":366608384,"data_compressed":17407784,"data_compressed_allocated":22913024,"data_compressed_original":366608384,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9695232,"data_stored":155058200,"data_compressed":7362992,"data_compressed_allocated":9691136,"data_compressed_original":155058176,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:56:59.592 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:56:59.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:59.760+0000 7f03aa791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:56:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:56:59.770+0000 7f03aa791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:00.148 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:00.148 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 1 pg inactive, 2 pgs peering","count":3},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2181/12069 objects degraded (18.071%), 10 pgs degraded","count":10},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":722,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":125,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473411,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":8},{"state_name":"stale+active+undersized+degraded","count":7},{"state_name":"peering","count":2},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"stale+active+undersized","count":2},{"state_name":"active+undersized","count":1},{"state_name":"active+recovery_wait+degraded","count":1},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"stale+active+clean","count":1}],"num_pgs":25,"num_pools":3,"num_objects":4023,"data_bytes":263914048,"bytes_used":254189568,"bytes_avail":386292867072,"bytes_total":386547056640,"inactive_pgs_ratio":0.079999998211860657,"degraded_objects":2181,"degraded_total":12069,"degraded_ratio":0.18071091225453642},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:57:00.167 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:57:00.168 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:00.262 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:57:00.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:00.325+0000 7fb5b7751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:00.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:00.337+0000 7fb5b7751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:00.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:00.400+0000 7fe7e5951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:00.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:00.411+0000 7fe7e5951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:00.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:00.609 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:00.630 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":475,"stamp":"2024-09-16T07:57:00.444820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":211419712,"num_objects":3222,"num_object_clones":0,"num_object_copies":9666,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":1413,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13504,"num_write_kb":533588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1437,"num_bytes_recovered":1441792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13492,"ondisk_log_size":13492,"up":69,"acting":67,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":210152,"kb_used_data":47576,"kb_used_omap":0,"kb_used_meta":162496,"kb_avail":377277208,"statfs":{"total":386547056640,"available":386331860992,"internally_reserved":0,"allocated":48717824,"data_stored":718127400,"data_compressed":34032706,"data_compressed_allocated":44797952,"data_compressed_original":716521472,"omap_allocated":0,"internal_metadata":166395904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52494336,"num_objects":-801,"num_object_clones":0,"num_object_copies":-2403,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":-768,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1097,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.353883"},"pg_stats":[{"pgid":"6.f","version":"124'910","reported_seq":1479,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.861866+0000","last_change":"2024-09-16T07:56:52.415843+0000","last_active":"2024-09-16T07:56:58.861866+0000","last_peered":"2024-09-16T07:56:58.861866+0000","last_clean":"2024-09-16T07:55:36.831185+0000","last_became_active":"2024-09-16T07:56:52.211353+0000","last_became_peered":"2024-09-16T07:56:52.211353+0000","last_unstale":"2024-09-16T07:56:58.861866+0000","last_undegraded":"2024-09-16T07:56:58.861866+0000","last_fullsized":"2024-09-16T07:56:58.861866+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":26,"num_objects_missing":26,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":154}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"106'822","reported_seq":863,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.713938+0000","last_change":"2024-09-16T07:56:04.234616+0000","last_active":"2024-09-16T07:56:26.713938+0000","last_peered":"2024-09-16T07:56:26.713938+0000","last_clean":"2024-09-16T07:55:36.894044+0000","last_became_active":"2024-09-16T07:56:04.234616+0000","last_became_peered":"2024-09-16T07:56:04.234616+0000","last_unstale":"2024-09-16T07:56:50.042195+0000","last_undegraded":"2024-09-16T07:56:04.095494+0000","last_fullsized":"2024-09-16T07:56:04.093963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":300}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"106'784","reported_seq":823,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-09-16T07:56:26.993304+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:56:26.993304+0000","last_peered":"2024-09-16T07:56:26.993304+0000","last_clean":"2024-09-16T07:56:26.993304+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:56:50.042197+0000","last_undegraded":"2024-09-16T07:56:26.993304+0000","last_fullsized":"2024-09-16T07:56:26.993304+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925272,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":784,"num_write_kb":32833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"109'850","reported_seq":901,"reported_epoch":110,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:56:33.056863+0000","last_change":"2024-09-16T07:56:31.196007+0000","last_active":"2024-09-16T07:56:33.056863+0000","last_peered":"2024-09-16T07:56:33.056863+0000","last_clean":"2024-09-16T07:55:36.958095+0000","last_became_active":"2024-09-16T07:56:31.113588+0000","last_became_peered":"2024-09-16T07:56:31.113588+0000","last_unstale":"2024-09-16T07:56:33.056863+0000","last_undegraded":"2024-09-16T07:56:30.612013+0000","last_fullsized":"2024-09-16T07:56:30.587298+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":296,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":850,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":215}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"106'765","reported_seq":796,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.802068+0000","last_change":"2024-09-16T07:56:04.188084+0000","last_active":"2024-09-16T07:56:26.802068+0000","last_peered":"2024-09-16T07:56:26.802068+0000","last_clean":"2024-09-16T07:55:37.016460+0000","last_became_active":"2024-09-16T07:56:04.188084+0000","last_became_peered":"2024-09-16T07:56:04.188084+0000","last_unstale":"2024-09-16T07:56:50.042199+0000","last_undegraded":"2024-09-16T07:56:04.099920+0000","last_fullsized":"2024-09-16T07:56:04.098703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":279,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":279}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"124'836","reported_seq":907,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.763000+0000","last_change":"2024-09-16T07:56:52.236220+0000","last_active":"2024-09-16T07:56:58.763000+0000","last_peered":"2024-09-16T07:56:58.763000+0000","last_clean":"2024-09-16T07:56:58.763000+0000","last_became_active":"2024-09-16T07:56:52.210769+0000","last_became_peered":"2024-09-16T07:56:52.210769+0000","last_unstale":"2024-09-16T07:56:58.763000+0000","last_undegraded":"2024-09-16T07:56:58.763000+0000","last_fullsized":"2024-09-16T07:56:58.763000+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":31552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"109'847","reported_seq":893,"reported_epoch":110,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:56:33.055355+0000","last_change":"2024-09-16T07:56:31.242408+0000","last_active":"2024-09-16T07:56:33.055355+0000","last_peered":"2024-09-16T07:56:33.055355+0000","last_clean":"2024-09-16T07:55:37.019430+0000","last_became_active":"2024-09-16T07:56:31.227591+0000","last_became_peered":"2024-09-16T07:56:31.227591+0000","last_unstale":"2024-09-16T07:56:33.055355+0000","last_undegraded":"2024-09-16T07:56:30.634662+0000","last_fullsized":"2024-09-16T07:56:30.613321+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":200}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"110'817","reported_seq":1439,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.123346+0000","last_change":"2024-09-16T07:56:39.099974+0000","last_active":"2024-09-16T07:56:52.123346+0000","last_peered":"2024-09-16T07:56:52.123346+0000","last_clean":"2024-09-16T07:56:52.123346+0000","last_became_active":"2024-09-16T07:56:39.094850+0000","last_became_peered":"2024-09-16T07:56:39.094850+0000","last_unstale":"2024-09-16T07:56:52.123346+0000","last_undegraded":"2024-09-16T07:56:52.123346+0000","last_fullsized":"2024-09-16T07:56:52.123346+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"110'774","reported_seq":849,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.244861+0000","last_change":"2024-09-16T07:56:52.246248+0000","last_active":"2024-09-16T07:56:52.244861+0000","last_peered":"2024-09-16T07:56:52.244861+0000","last_clean":"2024-09-16T07:56:49.058981+0000","last_became_active":"2024-09-16T07:56:52.238011+0000","last_became_peered":"2024-09-16T07:56:52.238011+0000","last_unstale":"2024-09-16T07:56:52.244861+0000","last_undegraded":"2024-09-16T07:56:52.244861+0000","last_fullsized":"2024-09-16T07:56:52.244861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.054111+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:56:33.054111+0000","last_peered":"2024-09-16T07:56:33.054111+0000","last_clean":"2024-09-16T07:56:33.054111+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:56:33.054111+0000","last_undegraded":"2024-09-16T07:56:33.054111+0000","last_fullsized":"2024-09-16T07:56:33.054111+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":282,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:04.168624+0000","last_change":"2024-09-16T07:56:04.167227+0000","last_active":"2024-09-16T07:56:04.168624+0000","last_peered":"2024-09-16T07:56:04.168624+0000","last_clean":"2024-09-16T07:55:28.056115+0000","last_became_active":"2024-09-16T07:56:04.167227+0000","last_became_peered":"2024-09-16T07:56:04.167227+0000","last_unstale":"2024-09-16T07:56:50.042204+0000","last_undegraded":"2024-09-16T07:56:04.100204+0000","last_fullsized":"2024-09-16T07:56:04.098024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"110'800","reported_seq":852,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.066295+0000","last_change":"2024-09-16T07:55:24.512496+0000","last_active":"2024-09-16T07:56:33.066295+0000","last_peered":"2024-09-16T07:56:33.066295+0000","last_clean":"2024-09-16T07:56:33.066295+0000","last_became_active":"2024-09-16T07:55:24.193135+0000","last_became_peered":"2024-09-16T07:55:24.193135+0000","last_unstale":"2024-09-16T07:56:33.066295+0000","last_undegraded":"2024-09-16T07:56:33.066295+0000","last_fullsized":"2024-09-16T07:56:33.066295+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.223011+0000","last_change":"2024-09-16T07:56:52.225705+0000","last_active":"2024-09-16T07:56:52.223011+0000","last_peered":"2024-09-16T07:56:52.223011+0000","last_clean":"2024-09-16T07:56:49.056656+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:56:52.223011+0000","last_undegraded":"2024-09-16T07:56:52.223011+0000","last_fullsized":"2024-09-16T07:56:52.223011+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"124'937","reported_seq":1213,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.860601+0000","last_change":"2024-09-16T07:56:39.095587+0000","last_active":"2024-09-16T07:56:58.860601+0000","last_peered":"2024-09-16T07:56:58.860601+0000","last_clean":"2024-09-16T07:56:58.860601+0000","last_became_active":"2024-09-16T07:56:39.090610+0000","last_became_peered":"2024-09-16T07:56:39.090610+0000","last_unstale":"2024-09-16T07:56:58.860601+0000","last_undegraded":"2024-09-16T07:56:58.860601+0000","last_fullsized":"2024-09-16T07:56:58.860601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":935,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.153952+0000","last_change":"2024-09-16T07:56:04.153196+0000","last_active":"2024-09-16T07:56:04.153952+0000","last_peered":"2024-09-16T07:56:04.153952+0000","last_clean":"2024-09-16T07:55:28.045293+0000","last_became_active":"2024-09-16T07:56:04.153196+0000","last_became_peered":"2024-09-16T07:56:04.153196+0000","last_unstale":"2024-09-16T07:56:50.042206+0000","last_undegraded":"2024-09-16T07:56:04.153952+0000","last_fullsized":"2024-09-16T07:56:04.074241+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"109'815","reported_seq":863,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.061359+0000","last_change":"2024-09-16T07:55:24.360283+0000","last_active":"2024-09-16T07:56:33.061359+0000","last_peered":"2024-09-16T07:56:33.061359+0000","last_clean":"2024-09-16T07:56:33.061359+0000","last_became_active":"2024-09-16T07:55:24.148057+0000","last_became_peered":"2024-09-16T07:55:24.148057+0000","last_unstale":"2024-09-16T07:56:33.061359+0000","last_undegraded":"2024-09-16T07:56:33.061359+0000","last_fullsized":"2024-09-16T07:56:33.061359+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.259755+0000","last_change":"2024-09-16T07:56:52.263340+0000","last_active":"2024-09-16T07:56:52.259755+0000","last_peered":"2024-09-16T07:56:52.259755+0000","last_clean":"2024-09-16T07:56:49.060679+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:56:52.259755+0000","last_undegraded":"2024-09-16T07:56:52.259755+0000","last_fullsized":"2024-09-16T07:56:52.259755+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"124'947","reported_seq":1033,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.777426+0000","last_change":"2024-09-16T07:56:43.081255+0000","last_active":"2024-09-16T07:56:58.777426+0000","last_peered":"2024-09-16T07:56:58.777426+0000","last_clean":"2024-09-16T07:56:58.777426+0000","last_became_active":"2024-09-16T07:56:43.075222+0000","last_became_peered":"2024-09-16T07:56:43.075222+0000","last_unstale":"2024-09-16T07:56:58.777426+0000","last_undegraded":"2024-09-16T07:56:58.777426+0000","last_fullsized":"2024-09-16T07:56:58.777426+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":947,"log_dups_size":0,"ondisk_log_size":947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.091990+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:56:58.091990+0000","last_peered":"2024-09-16T07:56:58.091990+0000","last_clean":"2024-09-16T07:56:58.091990+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:56:58.091990+0000","last_undegraded":"2024-09-16T07:56:58.091990+0000","last_fullsized":"2024-09-16T07:56:58.091990+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"124'891","reported_seq":1461,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.871398+0000","last_change":"2024-09-16T07:56:52.457538+0000","last_active":"2024-09-16T07:56:58.871398+0000","last_peered":"2024-09-16T07:56:58.871398+0000","last_clean":"2024-09-16T07:55:36.614734+0000","last_became_active":"2024-09-16T07:56:52.224076+0000","last_became_peered":"2024-09-16T07:56:52.224076+0000","last_unstale":"2024-09-16T07:56:58.871398+0000","last_undegraded":"2024-09-16T07:56:58.871398+0000","last_fullsized":"2024-09-16T07:56:58.871398+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":37,"num_objects_missing":37,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":889,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":253,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":139}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":266,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.056382+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:56:33.056382+0000","last_peered":"2024-09-16T07:56:33.056382+0000","last_clean":"2024-09-16T07:56:33.056382+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:56:33.056382+0000","last_undegraded":"2024-09-16T07:56:33.056382+0000","last_fullsized":"2024-09-16T07:56:33.056382+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"106'740","reported_seq":772,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.778896+0000","last_change":"2024-09-16T07:56:04.242962+0000","last_active":"2024-09-16T07:56:26.778896+0000","last_peered":"2024-09-16T07:56:26.778896+0000","last_clean":"2024-09-16T07:55:36.812189+0000","last_became_active":"2024-09-16T07:56:04.242962+0000","last_became_peered":"2024-09-16T07:56:04.242962+0000","last_unstale":"2024-09-16T07:56:50.042216+0000","last_undegraded":"2024-09-16T07:56:04.106106+0000","last_fullsized":"2024-09-16T07:56:04.103930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":236}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.089633+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:56:58.089633+0000","last_peered":"2024-09-16T07:56:58.089633+0000","last_clean":"2024-09-16T07:56:58.089633+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:56:58.089633+0000","last_undegraded":"2024-09-16T07:56:58.089633+0000","last_fullsized":"2024-09-16T07:56:58.089633+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"110'902","reported_seq":978,"reported_epoch":121,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T07:56:52.265701+0000","last_change":"2024-09-16T07:56:52.268058+0000","last_active":"2024-09-16T07:56:52.265701+0000","last_peered":"2024-09-16T07:56:52.265701+0000","last_clean":"2024-09-16T07:56:49.061054+0000","last_became_active":"2024-09-16T07:56:52.254107+0000","last_became_peered":"2024-09-16T07:56:52.254107+0000","last_unstale":"2024-09-16T07:56:52.265701+0000","last_undegraded":"2024-09-16T07:56:52.160213+0000","last_fullsized":"2024-09-16T07:56:52.265701+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","3"],"object_location_counts":[{"shards":"0,1,3","objects":203}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":275,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.168913+0000","last_change":"2024-09-16T07:56:04.168188+0000","last_active":"2024-09-16T07:56:04.168913+0000","last_peered":"2024-09-16T07:56:04.168913+0000","last_clean":"2024-09-16T07:55:28.056128+0000","last_became_active":"2024-09-16T07:56:04.168188+0000","last_became_peered":"2024-09-16T07:56:04.168188+0000","last_unstale":"2024-09-16T07:56:50.042218+0000","last_undegraded":"2024-09-16T07:56:04.168913+0000","last_fullsized":"2024-09-16T07:56:04.078402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":210829336,"num_objects":3218,"num_object_clones":0,"num_object_copies":9654,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":1412,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13424,"num_write_kb":532481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1436,"num_bytes_recovered":1441792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":43524096,"data_stored":696189000,"data_compressed":33058776,"data_compressed_allocated":43511808,"data_compressed_original":696188928,"omap_allocated":0,"internal_metadata":0},"log_size":13437,"ondisk_log_size":13437,"up":45,"acting":43,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":21,"acting":21,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122197,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48800,"kb_used_data":10832,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94323040,"statfs":{"total":96636764160,"available":96586792960,"internally_reserved":0,"allocated":11091968,"data_stored":162831840,"data_compressed":7716681,"data_compressed_allocated":10158080,"data_compressed_original":162447360,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500702,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39732,"kb_used_data":10580,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":10833920,"data_stored":156790259,"data_compressed":7427264,"data_compressed_allocated":9777152,"data_compressed_original":156352512,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73004,"kb_used_data":14556,"kb_used_omap":0,"kb_used_meta":58432,"kb_avail":94298836,"statfs":{"total":96636764160,"available":96562008064,"internally_reserved":0,"allocated":14905344,"data_stored":224554674,"data_compressed":10646152,"data_compressed_allocated":14012416,"data_compressed_original":224198656,"omap_allocated":0,"internal_metadata":59834368},"hb_peers":[0,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48616,"kb_used_data":11608,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":11886592,"data_stored":173950627,"data_compressed":8242609,"data_compressed_allocated":10850304,"data_compressed_original":173522944,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10813440,"data_stored":172949528,"data_compressed":8212568,"data_compressed_allocated":10809344,"data_compressed_original":172949504,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13541376,"data_stored":216596504,"data_compressed":10285160,"data_compressed_allocated":13537280,"data_compressed_original":216596480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9474048,"data_stored":151584768,"data_compressed":7198056,"data_compressed_allocated":9474048,"data_compressed_original":151584768,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9695232,"data_stored":155058200,"data_compressed":7362992,"data_compressed_allocated":9691136,"data_compressed_original":155058176,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:02.710 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:57:02.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:02.869+0000 7f32e9191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:02.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:02.880+0000 7f32e9191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:03.632 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:03.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:03.772+0000 7f9c32d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:03.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:03.786+0000 7f9c32d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:04.049 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:04.049 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:04.066 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":477,"stamp":"2024-09-16T07:57:02.445349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":211419712,"num_objects":3222,"num_object_clones":0,"num_object_copies":9666,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":1413,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13504,"num_write_kb":533588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1437,"num_bytes_recovered":1441792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13492,"ondisk_log_size":13492,"up":69,"acting":67,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":210152,"kb_used_data":47576,"kb_used_omap":0,"kb_used_meta":162496,"kb_avail":377277208,"statfs":{"total":386547056640,"available":386331860992,"internally_reserved":0,"allocated":48717824,"data_stored":718127400,"data_compressed":34032706,"data_compressed_allocated":44797952,"data_compressed_original":716521472,"omap_allocated":0,"internal_metadata":166395904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52494336,"num_objects":-801,"num_object_clones":0,"num_object_copies":-2403,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":-768,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1097,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001673"},"pg_stats":[{"pgid":"6.f","version":"124'910","reported_seq":1479,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.861866+0000","last_change":"2024-09-16T07:56:52.415843+0000","last_active":"2024-09-16T07:56:58.861866+0000","last_peered":"2024-09-16T07:56:58.861866+0000","last_clean":"2024-09-16T07:55:36.831185+0000","last_became_active":"2024-09-16T07:56:52.211353+0000","last_became_peered":"2024-09-16T07:56:52.211353+0000","last_unstale":"2024-09-16T07:56:58.861866+0000","last_undegraded":"2024-09-16T07:56:58.861866+0000","last_fullsized":"2024-09-16T07:56:58.861866+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":26,"num_objects_missing":26,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":154}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"106'822","reported_seq":863,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.713938+0000","last_change":"2024-09-16T07:56:04.234616+0000","last_active":"2024-09-16T07:56:26.713938+0000","last_peered":"2024-09-16T07:56:26.713938+0000","last_clean":"2024-09-16T07:55:36.894044+0000","last_became_active":"2024-09-16T07:56:04.234616+0000","last_became_peered":"2024-09-16T07:56:04.234616+0000","last_unstale":"2024-09-16T07:56:50.042195+0000","last_undegraded":"2024-09-16T07:56:04.095494+0000","last_fullsized":"2024-09-16T07:56:04.093963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":300}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"106'784","reported_seq":823,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-09-16T07:56:26.993304+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:56:26.993304+0000","last_peered":"2024-09-16T07:56:26.993304+0000","last_clean":"2024-09-16T07:56:26.993304+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:56:50.042197+0000","last_undegraded":"2024-09-16T07:56:26.993304+0000","last_fullsized":"2024-09-16T07:56:26.993304+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925272,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":784,"num_write_kb":32833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"109'850","reported_seq":901,"reported_epoch":110,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:56:33.056863+0000","last_change":"2024-09-16T07:56:31.196007+0000","last_active":"2024-09-16T07:56:33.056863+0000","last_peered":"2024-09-16T07:56:33.056863+0000","last_clean":"2024-09-16T07:55:36.958095+0000","last_became_active":"2024-09-16T07:56:31.113588+0000","last_became_peered":"2024-09-16T07:56:31.113588+0000","last_unstale":"2024-09-16T07:56:33.056863+0000","last_undegraded":"2024-09-16T07:56:30.612013+0000","last_fullsized":"2024-09-16T07:56:30.587298+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":296,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":850,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":215}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"106'765","reported_seq":796,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.802068+0000","last_change":"2024-09-16T07:56:04.188084+0000","last_active":"2024-09-16T07:56:26.802068+0000","last_peered":"2024-09-16T07:56:26.802068+0000","last_clean":"2024-09-16T07:55:37.016460+0000","last_became_active":"2024-09-16T07:56:04.188084+0000","last_became_peered":"2024-09-16T07:56:04.188084+0000","last_unstale":"2024-09-16T07:56:50.042199+0000","last_undegraded":"2024-09-16T07:56:04.099920+0000","last_fullsized":"2024-09-16T07:56:04.098703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":279,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":279}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"124'836","reported_seq":907,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.763000+0000","last_change":"2024-09-16T07:56:52.236220+0000","last_active":"2024-09-16T07:56:58.763000+0000","last_peered":"2024-09-16T07:56:58.763000+0000","last_clean":"2024-09-16T07:56:58.763000+0000","last_became_active":"2024-09-16T07:56:52.210769+0000","last_became_peered":"2024-09-16T07:56:52.210769+0000","last_unstale":"2024-09-16T07:56:58.763000+0000","last_undegraded":"2024-09-16T07:56:58.763000+0000","last_fullsized":"2024-09-16T07:56:58.763000+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":31552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"109'847","reported_seq":893,"reported_epoch":110,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T07:56:33.055355+0000","last_change":"2024-09-16T07:56:31.242408+0000","last_active":"2024-09-16T07:56:33.055355+0000","last_peered":"2024-09-16T07:56:33.055355+0000","last_clean":"2024-09-16T07:55:37.019430+0000","last_became_active":"2024-09-16T07:56:31.227591+0000","last_became_peered":"2024-09-16T07:56:31.227591+0000","last_unstale":"2024-09-16T07:56:33.055355+0000","last_undegraded":"2024-09-16T07:56:30.634662+0000","last_fullsized":"2024-09-16T07:56:30.613321+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":200}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"110'817","reported_seq":1439,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.123346+0000","last_change":"2024-09-16T07:56:39.099974+0000","last_active":"2024-09-16T07:56:52.123346+0000","last_peered":"2024-09-16T07:56:52.123346+0000","last_clean":"2024-09-16T07:56:52.123346+0000","last_became_active":"2024-09-16T07:56:39.094850+0000","last_became_peered":"2024-09-16T07:56:39.094850+0000","last_unstale":"2024-09-16T07:56:52.123346+0000","last_undegraded":"2024-09-16T07:56:52.123346+0000","last_fullsized":"2024-09-16T07:56:52.123346+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"110'774","reported_seq":849,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.244861+0000","last_change":"2024-09-16T07:56:52.246248+0000","last_active":"2024-09-16T07:56:52.244861+0000","last_peered":"2024-09-16T07:56:52.244861+0000","last_clean":"2024-09-16T07:56:49.058981+0000","last_became_active":"2024-09-16T07:56:52.238011+0000","last_became_peered":"2024-09-16T07:56:52.238011+0000","last_unstale":"2024-09-16T07:56:52.244861+0000","last_undegraded":"2024-09-16T07:56:52.244861+0000","last_fullsized":"2024-09-16T07:56:52.244861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.054111+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:56:33.054111+0000","last_peered":"2024-09-16T07:56:33.054111+0000","last_clean":"2024-09-16T07:56:33.054111+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:56:33.054111+0000","last_undegraded":"2024-09-16T07:56:33.054111+0000","last_fullsized":"2024-09-16T07:56:33.054111+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":282,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:04.168624+0000","last_change":"2024-09-16T07:56:04.167227+0000","last_active":"2024-09-16T07:56:04.168624+0000","last_peered":"2024-09-16T07:56:04.168624+0000","last_clean":"2024-09-16T07:55:28.056115+0000","last_became_active":"2024-09-16T07:56:04.167227+0000","last_became_peered":"2024-09-16T07:56:04.167227+0000","last_unstale":"2024-09-16T07:56:50.042204+0000","last_undegraded":"2024-09-16T07:56:04.100204+0000","last_fullsized":"2024-09-16T07:56:04.098024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"110'800","reported_seq":852,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.066295+0000","last_change":"2024-09-16T07:55:24.512496+0000","last_active":"2024-09-16T07:56:33.066295+0000","last_peered":"2024-09-16T07:56:33.066295+0000","last_clean":"2024-09-16T07:56:33.066295+0000","last_became_active":"2024-09-16T07:55:24.193135+0000","last_became_peered":"2024-09-16T07:55:24.193135+0000","last_unstale":"2024-09-16T07:56:33.066295+0000","last_undegraded":"2024-09-16T07:56:33.066295+0000","last_fullsized":"2024-09-16T07:56:33.066295+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":208,"num_object_clones":0,"num_object_copies":624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.223011+0000","last_change":"2024-09-16T07:56:52.225705+0000","last_active":"2024-09-16T07:56:52.223011+0000","last_peered":"2024-09-16T07:56:52.223011+0000","last_clean":"2024-09-16T07:56:49.056656+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:56:52.223011+0000","last_undegraded":"2024-09-16T07:56:52.223011+0000","last_fullsized":"2024-09-16T07:56:52.223011+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"124'937","reported_seq":1213,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.860601+0000","last_change":"2024-09-16T07:56:39.095587+0000","last_active":"2024-09-16T07:56:58.860601+0000","last_peered":"2024-09-16T07:56:58.860601+0000","last_clean":"2024-09-16T07:56:58.860601+0000","last_became_active":"2024-09-16T07:56:39.090610+0000","last_became_peered":"2024-09-16T07:56:39.090610+0000","last_unstale":"2024-09-16T07:56:58.860601+0000","last_undegraded":"2024-09-16T07:56:58.860601+0000","last_fullsized":"2024-09-16T07:56:58.860601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":935,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.153952+0000","last_change":"2024-09-16T07:56:04.153196+0000","last_active":"2024-09-16T07:56:04.153952+0000","last_peered":"2024-09-16T07:56:04.153952+0000","last_clean":"2024-09-16T07:55:28.045293+0000","last_became_active":"2024-09-16T07:56:04.153196+0000","last_became_peered":"2024-09-16T07:56:04.153196+0000","last_unstale":"2024-09-16T07:56:50.042206+0000","last_undegraded":"2024-09-16T07:56:04.153952+0000","last_fullsized":"2024-09-16T07:56:04.074241+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"109'815","reported_seq":863,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.061359+0000","last_change":"2024-09-16T07:55:24.360283+0000","last_active":"2024-09-16T07:56:33.061359+0000","last_peered":"2024-09-16T07:56:33.061359+0000","last_clean":"2024-09-16T07:56:33.061359+0000","last_became_active":"2024-09-16T07:55:24.148057+0000","last_became_peered":"2024-09-16T07:55:24.148057+0000","last_unstale":"2024-09-16T07:56:33.061359+0000","last_undegraded":"2024-09-16T07:56:33.061359+0000","last_fullsized":"2024-09-16T07:56:33.061359+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.259755+0000","last_change":"2024-09-16T07:56:52.263340+0000","last_active":"2024-09-16T07:56:52.259755+0000","last_peered":"2024-09-16T07:56:52.259755+0000","last_clean":"2024-09-16T07:56:49.060679+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:56:52.259755+0000","last_undegraded":"2024-09-16T07:56:52.259755+0000","last_fullsized":"2024-09-16T07:56:52.259755+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"124'947","reported_seq":1033,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.777426+0000","last_change":"2024-09-16T07:56:43.081255+0000","last_active":"2024-09-16T07:56:58.777426+0000","last_peered":"2024-09-16T07:56:58.777426+0000","last_clean":"2024-09-16T07:56:58.777426+0000","last_became_active":"2024-09-16T07:56:43.075222+0000","last_became_peered":"2024-09-16T07:56:43.075222+0000","last_unstale":"2024-09-16T07:56:58.777426+0000","last_undegraded":"2024-09-16T07:56:58.777426+0000","last_fullsized":"2024-09-16T07:56:58.777426+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":947,"log_dups_size":0,"ondisk_log_size":947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.091990+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:56:58.091990+0000","last_peered":"2024-09-16T07:56:58.091990+0000","last_clean":"2024-09-16T07:56:58.091990+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:56:58.091990+0000","last_undegraded":"2024-09-16T07:56:58.091990+0000","last_fullsized":"2024-09-16T07:56:58.091990+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"124'891","reported_seq":1461,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.871398+0000","last_change":"2024-09-16T07:56:52.457538+0000","last_active":"2024-09-16T07:56:58.871398+0000","last_peered":"2024-09-16T07:56:58.871398+0000","last_clean":"2024-09-16T07:55:36.614734+0000","last_became_active":"2024-09-16T07:56:52.224076+0000","last_became_peered":"2024-09-16T07:56:52.224076+0000","last_unstale":"2024-09-16T07:56:58.871398+0000","last_undegraded":"2024-09-16T07:56:58.871398+0000","last_fullsized":"2024-09-16T07:56:58.871398+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":37,"num_objects_missing":37,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":889,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":253,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":139}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":266,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-16T07:56:33.056382+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:56:33.056382+0000","last_peered":"2024-09-16T07:56:33.056382+0000","last_clean":"2024-09-16T07:56:33.056382+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:56:33.056382+0000","last_undegraded":"2024-09-16T07:56:33.056382+0000","last_fullsized":"2024-09-16T07:56:33.056382+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"106'740","reported_seq":772,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.778896+0000","last_change":"2024-09-16T07:56:04.242962+0000","last_active":"2024-09-16T07:56:26.778896+0000","last_peered":"2024-09-16T07:56:26.778896+0000","last_clean":"2024-09-16T07:55:36.812189+0000","last_became_active":"2024-09-16T07:56:04.242962+0000","last_became_peered":"2024-09-16T07:56:04.242962+0000","last_unstale":"2024-09-16T07:56:50.042216+0000","last_undegraded":"2024-09-16T07:56:04.106106+0000","last_fullsized":"2024-09-16T07:56:04.103930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":236}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.089633+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:56:58.089633+0000","last_peered":"2024-09-16T07:56:58.089633+0000","last_clean":"2024-09-16T07:56:58.089633+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:56:58.089633+0000","last_undegraded":"2024-09-16T07:56:58.089633+0000","last_fullsized":"2024-09-16T07:56:58.089633+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"110'902","reported_seq":978,"reported_epoch":121,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T07:56:52.265701+0000","last_change":"2024-09-16T07:56:52.268058+0000","last_active":"2024-09-16T07:56:52.265701+0000","last_peered":"2024-09-16T07:56:52.265701+0000","last_clean":"2024-09-16T07:56:49.061054+0000","last_became_active":"2024-09-16T07:56:52.254107+0000","last_became_peered":"2024-09-16T07:56:52.254107+0000","last_unstale":"2024-09-16T07:56:52.265701+0000","last_undegraded":"2024-09-16T07:56:52.160213+0000","last_fullsized":"2024-09-16T07:56:52.265701+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","3"],"object_location_counts":[{"shards":"0,1,3","objects":203}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":275,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.168913+0000","last_change":"2024-09-16T07:56:04.168188+0000","last_active":"2024-09-16T07:56:04.168913+0000","last_peered":"2024-09-16T07:56:04.168913+0000","last_clean":"2024-09-16T07:55:28.056128+0000","last_became_active":"2024-09-16T07:56:04.168188+0000","last_became_peered":"2024-09-16T07:56:04.168188+0000","last_unstale":"2024-09-16T07:56:50.042218+0000","last_undegraded":"2024-09-16T07:56:04.168913+0000","last_fullsized":"2024-09-16T07:56:04.078402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":210829336,"num_objects":3218,"num_object_clones":0,"num_object_copies":9654,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":1412,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13424,"num_write_kb":532481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1436,"num_bytes_recovered":1441792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":43524096,"data_stored":696189000,"data_compressed":33058776,"data_compressed_allocated":43511808,"data_compressed_original":696188928,"omap_allocated":0,"internal_metadata":0},"log_size":13437,"ondisk_log_size":13437,"up":45,"acting":43,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":21,"acting":21,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122197,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48800,"kb_used_data":10832,"kb_used_omap":0,"kb_used_meta":37952,"kb_avail":94323040,"statfs":{"total":96636764160,"available":96586792960,"internally_reserved":0,"allocated":11091968,"data_stored":162831840,"data_compressed":7716681,"data_compressed_allocated":10158080,"data_compressed_original":162447360,"omap_allocated":0,"internal_metadata":38862848},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500702,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39732,"kb_used_data":10580,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":10833920,"data_stored":156790259,"data_compressed":7427264,"data_compressed_allocated":9777152,"data_compressed_original":156352512,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73004,"kb_used_data":14556,"kb_used_omap":0,"kb_used_meta":58432,"kb_avail":94298836,"statfs":{"total":96636764160,"available":96562008064,"internally_reserved":0,"allocated":14905344,"data_stored":224554674,"data_compressed":10646152,"data_compressed_allocated":14012416,"data_compressed_original":224198656,"omap_allocated":0,"internal_metadata":59834368},"hb_peers":[0,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48616,"kb_used_data":11608,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":11886592,"data_stored":173950627,"data_compressed":8242609,"data_compressed_allocated":10850304,"data_compressed_original":173522944,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10813440,"data_stored":172949528,"data_compressed":8212568,"data_compressed_allocated":10809344,"data_compressed_original":172949504,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13541376,"data_stored":216596504,"data_compressed":10285160,"data_compressed_allocated":13537280,"data_compressed_original":216596480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9474048,"data_stored":151584768,"data_compressed":7198056,"data_compressed_allocated":9474048,"data_compressed_original":151584768,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9695232,"data_stored":155058200,"data_compressed":7362992,"data_compressed_allocated":9691136,"data_compressed_original":155058176,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:04.068 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:57:04.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:04.214+0000 7fc5aaad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:04.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:04.224+0000 7fc5aaad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:04.603 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:04.603 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1413/9666 objects degraded (14.618%), 7 pgs degraded","count":7},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":726,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":126,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473411,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":13},{"state_name":"stale+active+undersized+degraded","count":4},{"state_name":"active+recovering","count":2},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"stale+active+undersized","count":2},{"state_name":"active+recovery_wait+degraded","count":1},{"state_name":"stale+active+clean","count":1}],"num_pgs":25,"num_pools":3,"num_objects":3222,"data_bytes":211419712,"bytes_used":215195648,"bytes_avail":386331860992,"bytes_total":386547056640,"degraded_objects":1413,"degraded_total":9666,"degraded_ratio":0.14618249534450653,"recovering_objects_per_sec":182,"recovering_bytes_per_sec":32758,"recovering_keys_per_sec":0,"num_objects_recovered":1097,"num_bytes_recovered":196608,"num_keys_recovered":0,"write_bytes_sec":10919,"read_op_per_sec":0,"write_op_per_sec":133},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:57:04.618 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:57:04.619 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:04.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:04.776+0000 7f8b85b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:04.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:04.787+0000 7f8b85b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:05.173 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:05.173 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:05.191 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":478,"stamp":"2024-09-16T07:57:04.445858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":183566912,"num_objects":2797,"num_object_clones":0,"num_object_copies":8391,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":817,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13929,"num_write_kb":533588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2032,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13917,"ondisk_log_size":13917,"up":69,"acting":69,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":197188,"kb_used_data":42932,"kb_used_omap":0,"kb_used_meta":154176,"kb_avail":377290172,"statfs":{"total":386547056640,"available":386345136128,"internally_reserved":0,"allocated":43962368,"data_stored":639871835,"data_compressed":30313866,"data_compressed_allocated":39903232,"data_compressed_original":638205952,"omap_allocated":0,"internal_metadata":157876224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-80347136,"num_objects":-1226,"num_object_clones":0,"num_object_copies":-3678,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":-1364,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1228,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1692,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.406260"},"pg_stats":[{"pgid":"6.f","version":"124'910","reported_seq":1479,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.861866+0000","last_change":"2024-09-16T07:56:52.415843+0000","last_active":"2024-09-16T07:56:58.861866+0000","last_peered":"2024-09-16T07:56:58.861866+0000","last_clean":"2024-09-16T07:55:36.831185+0000","last_became_active":"2024-09-16T07:56:52.211353+0000","last_became_peered":"2024-09-16T07:56:52.211353+0000","last_unstale":"2024-09-16T07:56:58.861866+0000","last_undegraded":"2024-09-16T07:56:58.861866+0000","last_fullsized":"2024-09-16T07:56:58.861866+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":26,"num_objects_missing":26,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":154}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"106'822","reported_seq":863,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.713938+0000","last_change":"2024-09-16T07:56:04.234616+0000","last_active":"2024-09-16T07:56:26.713938+0000","last_peered":"2024-09-16T07:56:26.713938+0000","last_clean":"2024-09-16T07:55:36.894044+0000","last_became_active":"2024-09-16T07:56:04.234616+0000","last_became_peered":"2024-09-16T07:56:04.234616+0000","last_unstale":"2024-09-16T07:56:50.042195+0000","last_undegraded":"2024-09-16T07:56:04.095494+0000","last_fullsized":"2024-09-16T07:56:04.093963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":300}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"106'784","reported_seq":823,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-09-16T07:56:26.993304+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:56:26.993304+0000","last_peered":"2024-09-16T07:56:26.993304+0000","last_clean":"2024-09-16T07:56:26.993304+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:56:50.042197+0000","last_undegraded":"2024-09-16T07:56:26.993304+0000","last_fullsized":"2024-09-16T07:56:26.993304+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925272,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":784,"num_write_kb":32833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"126'954","reported_seq":1645,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.736259+0000","last_change":"2024-09-16T07:56:52.442416+0000","last_active":"2024-09-16T07:57:02.736259+0000","last_peered":"2024-09-16T07:57:02.736259+0000","last_clean":"2024-09-16T07:57:02.736259+0000","last_became_active":"2024-09-16T07:56:52.244859+0000","last_became_peered":"2024-09-16T07:56:52.244859+0000","last_unstale":"2024-09-16T07:57:02.736259+0000","last_undegraded":"2024-09-16T07:57:02.736259+0000","last_fullsized":"2024-09-16T07:57:02.736259+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":954,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"106'765","reported_seq":796,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.802068+0000","last_change":"2024-09-16T07:56:04.188084+0000","last_active":"2024-09-16T07:56:26.802068+0000","last_peered":"2024-09-16T07:56:26.802068+0000","last_clean":"2024-09-16T07:55:37.016460+0000","last_became_active":"2024-09-16T07:56:04.188084+0000","last_became_peered":"2024-09-16T07:56:04.188084+0000","last_unstale":"2024-09-16T07:56:50.042199+0000","last_undegraded":"2024-09-16T07:56:04.099920+0000","last_fullsized":"2024-09-16T07:56:04.098703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":279,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":279}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"124'836","reported_seq":907,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.763000+0000","last_change":"2024-09-16T07:56:52.236220+0000","last_active":"2024-09-16T07:56:58.763000+0000","last_peered":"2024-09-16T07:56:58.763000+0000","last_clean":"2024-09-16T07:56:58.763000+0000","last_became_active":"2024-09-16T07:56:52.210769+0000","last_became_peered":"2024-09-16T07:56:52.210769+0000","last_unstale":"2024-09-16T07:56:58.763000+0000","last_undegraded":"2024-09-16T07:56:58.763000+0000","last_fullsized":"2024-09-16T07:56:58.763000+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":31552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"126'958","reported_seq":1651,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.902907+0000","last_change":"2024-09-16T07:57:01.189928+0000","last_active":"2024-09-16T07:57:02.902907+0000","last_peered":"2024-09-16T07:57:02.902907+0000","last_clean":"2024-09-16T07:57:02.902907+0000","last_became_active":"2024-09-16T07:57:01.175598+0000","last_became_peered":"2024-09-16T07:57:01.175598+0000","last_unstale":"2024-09-16T07:57:02.902907+0000","last_undegraded":"2024-09-16T07:57:02.902907+0000","last_fullsized":"2024-09-16T07:57:02.902907+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"110'817","reported_seq":1439,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.123346+0000","last_change":"2024-09-16T07:56:39.099974+0000","last_active":"2024-09-16T07:56:52.123346+0000","last_peered":"2024-09-16T07:56:52.123346+0000","last_clean":"2024-09-16T07:56:52.123346+0000","last_became_active":"2024-09-16T07:56:39.094850+0000","last_became_peered":"2024-09-16T07:56:39.094850+0000","last_unstale":"2024-09-16T07:56:52.123346+0000","last_undegraded":"2024-09-16T07:56:52.123346+0000","last_fullsized":"2024-09-16T07:56:52.123346+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"110'774","reported_seq":849,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.244861+0000","last_change":"2024-09-16T07:56:52.246248+0000","last_active":"2024-09-16T07:56:52.244861+0000","last_peered":"2024-09-16T07:56:52.244861+0000","last_clean":"2024-09-16T07:56:49.058981+0000","last_became_active":"2024-09-16T07:56:52.238011+0000","last_became_peered":"2024-09-16T07:56:52.238011+0000","last_unstale":"2024-09-16T07:56:52.244861+0000","last_undegraded":"2024-09-16T07:56:52.244861+0000","last_fullsized":"2024-09-16T07:56:52.244861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":379,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.140645+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:01.140645+0000","last_peered":"2024-09-16T07:57:01.140645+0000","last_clean":"2024-09-16T07:57:01.140645+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:01.140645+0000","last_undegraded":"2024-09-16T07:57:01.140645+0000","last_fullsized":"2024-09-16T07:57:01.140645+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":282,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:04.168624+0000","last_change":"2024-09-16T07:56:04.167227+0000","last_active":"2024-09-16T07:56:04.168624+0000","last_peered":"2024-09-16T07:56:04.168624+0000","last_clean":"2024-09-16T07:55:28.056115+0000","last_became_active":"2024-09-16T07:56:04.167227+0000","last_became_peered":"2024-09-16T07:56:04.167227+0000","last_unstale":"2024-09-16T07:56:50.042204+0000","last_undegraded":"2024-09-16T07:56:04.100204+0000","last_fullsized":"2024-09-16T07:56:04.098024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"126'908","reported_seq":1012,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:03.006212+0000","last_change":"2024-09-16T07:56:59.704605+0000","last_active":"2024-09-16T07:57:03.006212+0000","last_peered":"2024-09-16T07:57:03.006212+0000","last_clean":"2024-09-16T07:57:03.006212+0000","last_became_active":"2024-09-16T07:56:52.289647+0000","last_became_peered":"2024-09-16T07:56:52.289647+0000","last_unstale":"2024-09-16T07:57:03.006212+0000","last_undegraded":"2024-09-16T07:57:03.006212+0000","last_fullsized":"2024-09-16T07:57:03.006212+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.223011+0000","last_change":"2024-09-16T07:56:52.225705+0000","last_active":"2024-09-16T07:56:52.223011+0000","last_peered":"2024-09-16T07:56:52.223011+0000","last_clean":"2024-09-16T07:56:49.056656+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:56:52.223011+0000","last_undegraded":"2024-09-16T07:56:52.223011+0000","last_fullsized":"2024-09-16T07:56:52.223011+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"124'937","reported_seq":1213,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.860601+0000","last_change":"2024-09-16T07:56:39.095587+0000","last_active":"2024-09-16T07:56:58.860601+0000","last_peered":"2024-09-16T07:56:58.860601+0000","last_clean":"2024-09-16T07:56:58.860601+0000","last_became_active":"2024-09-16T07:56:39.090610+0000","last_became_peered":"2024-09-16T07:56:39.090610+0000","last_unstale":"2024-09-16T07:56:58.860601+0000","last_undegraded":"2024-09-16T07:56:58.860601+0000","last_fullsized":"2024-09-16T07:56:58.860601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":935,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.153952+0000","last_change":"2024-09-16T07:56:04.153196+0000","last_active":"2024-09-16T07:56:04.153952+0000","last_peered":"2024-09-16T07:56:04.153952+0000","last_clean":"2024-09-16T07:55:28.045293+0000","last_became_active":"2024-09-16T07:56:04.153196+0000","last_became_peered":"2024-09-16T07:56:04.153196+0000","last_unstale":"2024-09-16T07:56:50.042206+0000","last_undegraded":"2024-09-16T07:56:04.153952+0000","last_fullsized":"2024-09-16T07:56:04.074241+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"126'917","reported_seq":1014,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.634659+0000","last_change":"2024-09-16T07:56:52.223936+0000","last_active":"2024-09-16T07:57:02.634659+0000","last_peered":"2024-09-16T07:57:02.634659+0000","last_clean":"2024-09-16T07:57:02.634659+0000","last_became_active":"2024-09-16T07:56:52.218070+0000","last_became_peered":"2024-09-16T07:56:52.218070+0000","last_unstale":"2024-09-16T07:57:02.634659+0000","last_undegraded":"2024-09-16T07:57:02.634659+0000","last_fullsized":"2024-09-16T07:57:02.634659+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.259755+0000","last_change":"2024-09-16T07:56:52.263340+0000","last_active":"2024-09-16T07:56:52.259755+0000","last_peered":"2024-09-16T07:56:52.259755+0000","last_clean":"2024-09-16T07:56:49.060679+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:56:52.259755+0000","last_undegraded":"2024-09-16T07:56:52.259755+0000","last_fullsized":"2024-09-16T07:56:52.259755+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"124'947","reported_seq":1033,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.777426+0000","last_change":"2024-09-16T07:56:43.081255+0000","last_active":"2024-09-16T07:56:58.777426+0000","last_peered":"2024-09-16T07:56:58.777426+0000","last_clean":"2024-09-16T07:56:58.777426+0000","last_became_active":"2024-09-16T07:56:43.075222+0000","last_became_peered":"2024-09-16T07:56:43.075222+0000","last_unstale":"2024-09-16T07:56:58.777426+0000","last_undegraded":"2024-09-16T07:56:58.777426+0000","last_fullsized":"2024-09-16T07:56:58.777426+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":947,"log_dups_size":0,"ondisk_log_size":947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.091990+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:56:58.091990+0000","last_peered":"2024-09-16T07:56:58.091990+0000","last_clean":"2024-09-16T07:56:58.091990+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:56:58.091990+0000","last_undegraded":"2024-09-16T07:56:58.091990+0000","last_fullsized":"2024-09-16T07:56:58.091990+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"124'891","reported_seq":1461,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.871398+0000","last_change":"2024-09-16T07:56:52.457538+0000","last_active":"2024-09-16T07:56:58.871398+0000","last_peered":"2024-09-16T07:56:58.871398+0000","last_clean":"2024-09-16T07:55:36.614734+0000","last_became_active":"2024-09-16T07:56:52.224076+0000","last_became_peered":"2024-09-16T07:56:52.224076+0000","last_unstale":"2024-09-16T07:56:58.871398+0000","last_undegraded":"2024-09-16T07:56:58.871398+0000","last_fullsized":"2024-09-16T07:56:58.871398+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":37,"num_objects_missing":37,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":889,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":253,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":139}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.138533+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:01.138533+0000","last_peered":"2024-09-16T07:57:01.138533+0000","last_clean":"2024-09-16T07:57:01.138533+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:01.138533+0000","last_undegraded":"2024-09-16T07:57:01.138533+0000","last_fullsized":"2024-09-16T07:57:01.138533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"106'740","reported_seq":772,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.778896+0000","last_change":"2024-09-16T07:56:04.242962+0000","last_active":"2024-09-16T07:56:26.778896+0000","last_peered":"2024-09-16T07:56:26.778896+0000","last_clean":"2024-09-16T07:55:36.812189+0000","last_became_active":"2024-09-16T07:56:04.242962+0000","last_became_peered":"2024-09-16T07:56:04.242962+0000","last_unstale":"2024-09-16T07:56:50.042216+0000","last_undegraded":"2024-09-16T07:56:04.106106+0000","last_fullsized":"2024-09-16T07:56:04.103930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":236}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.089633+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:56:58.089633+0000","last_peered":"2024-09-16T07:56:58.089633+0000","last_clean":"2024-09-16T07:56:58.089633+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:56:58.089633+0000","last_undegraded":"2024-09-16T07:56:58.089633+0000","last_fullsized":"2024-09-16T07:56:58.089633+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"110'902","reported_seq":978,"reported_epoch":121,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T07:56:52.265701+0000","last_change":"2024-09-16T07:56:52.268058+0000","last_active":"2024-09-16T07:56:52.265701+0000","last_peered":"2024-09-16T07:56:52.265701+0000","last_clean":"2024-09-16T07:56:49.061054+0000","last_became_active":"2024-09-16T07:56:52.254107+0000","last_became_peered":"2024-09-16T07:56:52.254107+0000","last_unstale":"2024-09-16T07:56:52.265701+0000","last_undegraded":"2024-09-16T07:56:52.160213+0000","last_fullsized":"2024-09-16T07:56:52.265701+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","3"],"object_location_counts":[{"shards":"0,1,3","objects":203}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":275,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.168913+0000","last_change":"2024-09-16T07:56:04.168188+0000","last_active":"2024-09-16T07:56:04.168913+0000","last_peered":"2024-09-16T07:56:04.168913+0000","last_clean":"2024-09-16T07:55:28.056128+0000","last_became_active":"2024-09-16T07:56:04.168188+0000","last_became_peered":"2024-09-16T07:56:04.168188+0000","last_unstale":"2024-09-16T07:56:50.042218+0000","last_undegraded":"2024-09-16T07:56:04.168913+0000","last_fullsized":"2024-09-16T07:56:04.078402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":182976536,"num_objects":2793,"num_object_clones":0,"num_object_copies":8379,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":816,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13849,"num_write_kb":532481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2031,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38645760,"data_stored":618135624,"data_compressed":29352384,"data_compressed_allocated":38633472,"data_compressed_original":618135552,"omap_allocated":0,"internal_metadata":0},"log_size":13862,"ondisk_log_size":13862,"up":45,"acting":45,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":21,"acting":21,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35836,"kb_used_data":6188,"kb_used_omap":0,"kb_used_meta":29632,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":6336512,"data_stored":84576275,"data_compressed":3997841,"data_compressed_allocated":5263360,"data_compressed_original":84131840,"omap_allocated":0,"internal_metadata":30343168},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500702,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39732,"kb_used_data":10580,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":10833920,"data_stored":156790259,"data_compressed":7427264,"data_compressed_allocated":9777152,"data_compressed_original":156352512,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73004,"kb_used_data":14556,"kb_used_omap":0,"kb_used_meta":58432,"kb_avail":94298836,"statfs":{"total":96636764160,"available":96562008064,"internally_reserved":0,"allocated":14905344,"data_stored":224554674,"data_compressed":10646152,"data_compressed_allocated":14012416,"data_compressed_original":224198656,"omap_allocated":0,"internal_metadata":59834368},"hb_peers":[0,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48616,"kb_used_data":11608,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":11886592,"data_stored":173950627,"data_compressed":8242609,"data_compressed_allocated":10850304,"data_compressed_original":173522944,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10813440,"data_stored":172949528,"data_compressed":8212568,"data_compressed_allocated":10809344,"data_compressed_original":172949504,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13541376,"data_stored":216596504,"data_compressed":10285160,"data_compressed_allocated":13537280,"data_compressed_original":216596480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9474048,"data_stored":151584768,"data_compressed":7198056,"data_compressed_allocated":9474048,"data_compressed_original":151584768,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4816896,"data_stored":77004824,"data_compressed":3656600,"data_compressed_allocated":4812800,"data_compressed_original":77004800,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:05.262 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:57:05.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:05.390+0000 7f88a7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:05.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:05.399+0000 7f88a7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:07.783 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:57:07.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:07.946+0000 7f1c36b48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:07.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:07.954+0000 7f1c36b48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:08.194 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:08.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:08.361+0000 7f4949351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:08.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:08.373+0000 7f4949351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:08.734 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:08.734 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:08.757 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":480,"stamp":"2024-09-16T07:57:08.446691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":183566912,"num_objects":2797,"num_object_clones":0,"num_object_copies":8391,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":817,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13929,"num_write_kb":533588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2032,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13917,"ondisk_log_size":13917,"up":69,"acting":69,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":197188,"kb_used_data":42932,"kb_used_omap":0,"kb_used_meta":154176,"kb_avail":377290172,"statfs":{"total":386547056640,"available":386345136128,"internally_reserved":0,"allocated":43962368,"data_stored":639871835,"data_compressed":30313866,"data_compressed_allocated":39903232,"data_compressed_original":638205952,"omap_allocated":0,"internal_metadata":157876224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27852800,"num_objects":-425,"num_object_clones":0,"num_object_copies":-1275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-596,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":595,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.322850"},"pg_stats":[{"pgid":"6.f","version":"124'910","reported_seq":1479,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.861866+0000","last_change":"2024-09-16T07:56:52.415843+0000","last_active":"2024-09-16T07:56:58.861866+0000","last_peered":"2024-09-16T07:56:58.861866+0000","last_clean":"2024-09-16T07:55:36.831185+0000","last_became_active":"2024-09-16T07:56:52.211353+0000","last_became_peered":"2024-09-16T07:56:52.211353+0000","last_unstale":"2024-09-16T07:56:58.861866+0000","last_undegraded":"2024-09-16T07:56:58.861866+0000","last_fullsized":"2024-09-16T07:56:58.861866+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":26,"num_objects_missing":26,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":154}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"106'822","reported_seq":863,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.713938+0000","last_change":"2024-09-16T07:56:04.234616+0000","last_active":"2024-09-16T07:56:26.713938+0000","last_peered":"2024-09-16T07:56:26.713938+0000","last_clean":"2024-09-16T07:55:36.894044+0000","last_became_active":"2024-09-16T07:56:04.234616+0000","last_became_peered":"2024-09-16T07:56:04.234616+0000","last_unstale":"2024-09-16T07:56:50.042195+0000","last_undegraded":"2024-09-16T07:56:04.095494+0000","last_fullsized":"2024-09-16T07:56:04.093963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":300}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"106'784","reported_seq":823,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-09-16T07:56:26.993304+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:56:26.993304+0000","last_peered":"2024-09-16T07:56:26.993304+0000","last_clean":"2024-09-16T07:56:26.993304+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:56:50.042197+0000","last_undegraded":"2024-09-16T07:56:26.993304+0000","last_fullsized":"2024-09-16T07:56:26.993304+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925272,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":784,"num_write_kb":32833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"126'954","reported_seq":1645,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.736259+0000","last_change":"2024-09-16T07:56:52.442416+0000","last_active":"2024-09-16T07:57:02.736259+0000","last_peered":"2024-09-16T07:57:02.736259+0000","last_clean":"2024-09-16T07:57:02.736259+0000","last_became_active":"2024-09-16T07:56:52.244859+0000","last_became_peered":"2024-09-16T07:56:52.244859+0000","last_unstale":"2024-09-16T07:57:02.736259+0000","last_undegraded":"2024-09-16T07:57:02.736259+0000","last_fullsized":"2024-09-16T07:57:02.736259+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":954,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"106'765","reported_seq":796,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.802068+0000","last_change":"2024-09-16T07:56:04.188084+0000","last_active":"2024-09-16T07:56:26.802068+0000","last_peered":"2024-09-16T07:56:26.802068+0000","last_clean":"2024-09-16T07:55:37.016460+0000","last_became_active":"2024-09-16T07:56:04.188084+0000","last_became_peered":"2024-09-16T07:56:04.188084+0000","last_unstale":"2024-09-16T07:56:50.042199+0000","last_undegraded":"2024-09-16T07:56:04.099920+0000","last_fullsized":"2024-09-16T07:56:04.098703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":279,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":279}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"124'836","reported_seq":907,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.763000+0000","last_change":"2024-09-16T07:56:52.236220+0000","last_active":"2024-09-16T07:56:58.763000+0000","last_peered":"2024-09-16T07:56:58.763000+0000","last_clean":"2024-09-16T07:56:58.763000+0000","last_became_active":"2024-09-16T07:56:52.210769+0000","last_became_peered":"2024-09-16T07:56:52.210769+0000","last_unstale":"2024-09-16T07:56:58.763000+0000","last_undegraded":"2024-09-16T07:56:58.763000+0000","last_fullsized":"2024-09-16T07:56:58.763000+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":31552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"126'958","reported_seq":1651,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.902907+0000","last_change":"2024-09-16T07:57:01.189928+0000","last_active":"2024-09-16T07:57:02.902907+0000","last_peered":"2024-09-16T07:57:02.902907+0000","last_clean":"2024-09-16T07:57:02.902907+0000","last_became_active":"2024-09-16T07:57:01.175598+0000","last_became_peered":"2024-09-16T07:57:01.175598+0000","last_unstale":"2024-09-16T07:57:02.902907+0000","last_undegraded":"2024-09-16T07:57:02.902907+0000","last_fullsized":"2024-09-16T07:57:02.902907+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"110'817","reported_seq":1439,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.123346+0000","last_change":"2024-09-16T07:56:39.099974+0000","last_active":"2024-09-16T07:56:52.123346+0000","last_peered":"2024-09-16T07:56:52.123346+0000","last_clean":"2024-09-16T07:56:52.123346+0000","last_became_active":"2024-09-16T07:56:39.094850+0000","last_became_peered":"2024-09-16T07:56:39.094850+0000","last_unstale":"2024-09-16T07:56:52.123346+0000","last_undegraded":"2024-09-16T07:56:52.123346+0000","last_fullsized":"2024-09-16T07:56:52.123346+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"110'774","reported_seq":849,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.244861+0000","last_change":"2024-09-16T07:56:52.246248+0000","last_active":"2024-09-16T07:56:52.244861+0000","last_peered":"2024-09-16T07:56:52.244861+0000","last_clean":"2024-09-16T07:56:49.058981+0000","last_became_active":"2024-09-16T07:56:52.238011+0000","last_became_peered":"2024-09-16T07:56:52.238011+0000","last_unstale":"2024-09-16T07:56:52.244861+0000","last_undegraded":"2024-09-16T07:56:52.244861+0000","last_fullsized":"2024-09-16T07:56:52.244861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":379,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.140645+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:01.140645+0000","last_peered":"2024-09-16T07:57:01.140645+0000","last_clean":"2024-09-16T07:57:01.140645+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:01.140645+0000","last_undegraded":"2024-09-16T07:57:01.140645+0000","last_fullsized":"2024-09-16T07:57:01.140645+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":282,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:04.168624+0000","last_change":"2024-09-16T07:56:04.167227+0000","last_active":"2024-09-16T07:56:04.168624+0000","last_peered":"2024-09-16T07:56:04.168624+0000","last_clean":"2024-09-16T07:55:28.056115+0000","last_became_active":"2024-09-16T07:56:04.167227+0000","last_became_peered":"2024-09-16T07:56:04.167227+0000","last_unstale":"2024-09-16T07:56:50.042204+0000","last_undegraded":"2024-09-16T07:56:04.100204+0000","last_fullsized":"2024-09-16T07:56:04.098024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"126'908","reported_seq":1012,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:03.006212+0000","last_change":"2024-09-16T07:56:59.704605+0000","last_active":"2024-09-16T07:57:03.006212+0000","last_peered":"2024-09-16T07:57:03.006212+0000","last_clean":"2024-09-16T07:57:03.006212+0000","last_became_active":"2024-09-16T07:56:52.289647+0000","last_became_peered":"2024-09-16T07:56:52.289647+0000","last_unstale":"2024-09-16T07:57:03.006212+0000","last_undegraded":"2024-09-16T07:57:03.006212+0000","last_fullsized":"2024-09-16T07:57:03.006212+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.223011+0000","last_change":"2024-09-16T07:56:52.225705+0000","last_active":"2024-09-16T07:56:52.223011+0000","last_peered":"2024-09-16T07:56:52.223011+0000","last_clean":"2024-09-16T07:56:49.056656+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:56:52.223011+0000","last_undegraded":"2024-09-16T07:56:52.223011+0000","last_fullsized":"2024-09-16T07:56:52.223011+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"124'937","reported_seq":1213,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.860601+0000","last_change":"2024-09-16T07:56:39.095587+0000","last_active":"2024-09-16T07:56:58.860601+0000","last_peered":"2024-09-16T07:56:58.860601+0000","last_clean":"2024-09-16T07:56:58.860601+0000","last_became_active":"2024-09-16T07:56:39.090610+0000","last_became_peered":"2024-09-16T07:56:39.090610+0000","last_unstale":"2024-09-16T07:56:58.860601+0000","last_undegraded":"2024-09-16T07:56:58.860601+0000","last_fullsized":"2024-09-16T07:56:58.860601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":935,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.153952+0000","last_change":"2024-09-16T07:56:04.153196+0000","last_active":"2024-09-16T07:56:04.153952+0000","last_peered":"2024-09-16T07:56:04.153952+0000","last_clean":"2024-09-16T07:55:28.045293+0000","last_became_active":"2024-09-16T07:56:04.153196+0000","last_became_peered":"2024-09-16T07:56:04.153196+0000","last_unstale":"2024-09-16T07:56:50.042206+0000","last_undegraded":"2024-09-16T07:56:04.153952+0000","last_fullsized":"2024-09-16T07:56:04.074241+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"126'917","reported_seq":1014,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.634659+0000","last_change":"2024-09-16T07:56:52.223936+0000","last_active":"2024-09-16T07:57:02.634659+0000","last_peered":"2024-09-16T07:57:02.634659+0000","last_clean":"2024-09-16T07:57:02.634659+0000","last_became_active":"2024-09-16T07:56:52.218070+0000","last_became_peered":"2024-09-16T07:56:52.218070+0000","last_unstale":"2024-09-16T07:57:02.634659+0000","last_undegraded":"2024-09-16T07:57:02.634659+0000","last_fullsized":"2024-09-16T07:57:02.634659+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.259755+0000","last_change":"2024-09-16T07:56:52.263340+0000","last_active":"2024-09-16T07:56:52.259755+0000","last_peered":"2024-09-16T07:56:52.259755+0000","last_clean":"2024-09-16T07:56:49.060679+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:56:52.259755+0000","last_undegraded":"2024-09-16T07:56:52.259755+0000","last_fullsized":"2024-09-16T07:56:52.259755+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"124'947","reported_seq":1033,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.777426+0000","last_change":"2024-09-16T07:56:43.081255+0000","last_active":"2024-09-16T07:56:58.777426+0000","last_peered":"2024-09-16T07:56:58.777426+0000","last_clean":"2024-09-16T07:56:58.777426+0000","last_became_active":"2024-09-16T07:56:43.075222+0000","last_became_peered":"2024-09-16T07:56:43.075222+0000","last_unstale":"2024-09-16T07:56:58.777426+0000","last_undegraded":"2024-09-16T07:56:58.777426+0000","last_fullsized":"2024-09-16T07:56:58.777426+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":947,"log_dups_size":0,"ondisk_log_size":947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.091990+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:56:58.091990+0000","last_peered":"2024-09-16T07:56:58.091990+0000","last_clean":"2024-09-16T07:56:58.091990+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:56:58.091990+0000","last_undegraded":"2024-09-16T07:56:58.091990+0000","last_fullsized":"2024-09-16T07:56:58.091990+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"124'891","reported_seq":1461,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.871398+0000","last_change":"2024-09-16T07:56:52.457538+0000","last_active":"2024-09-16T07:56:58.871398+0000","last_peered":"2024-09-16T07:56:58.871398+0000","last_clean":"2024-09-16T07:55:36.614734+0000","last_became_active":"2024-09-16T07:56:52.224076+0000","last_became_peered":"2024-09-16T07:56:52.224076+0000","last_unstale":"2024-09-16T07:56:58.871398+0000","last_undegraded":"2024-09-16T07:56:58.871398+0000","last_fullsized":"2024-09-16T07:56:58.871398+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":37,"num_objects_missing":37,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":889,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":253,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":139}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.138533+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:01.138533+0000","last_peered":"2024-09-16T07:57:01.138533+0000","last_clean":"2024-09-16T07:57:01.138533+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:01.138533+0000","last_undegraded":"2024-09-16T07:57:01.138533+0000","last_fullsized":"2024-09-16T07:57:01.138533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"106'740","reported_seq":772,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.778896+0000","last_change":"2024-09-16T07:56:04.242962+0000","last_active":"2024-09-16T07:56:26.778896+0000","last_peered":"2024-09-16T07:56:26.778896+0000","last_clean":"2024-09-16T07:55:36.812189+0000","last_became_active":"2024-09-16T07:56:04.242962+0000","last_became_peered":"2024-09-16T07:56:04.242962+0000","last_unstale":"2024-09-16T07:56:50.042216+0000","last_undegraded":"2024-09-16T07:56:04.106106+0000","last_fullsized":"2024-09-16T07:56:04.103930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":236}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.089633+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:56:58.089633+0000","last_peered":"2024-09-16T07:56:58.089633+0000","last_clean":"2024-09-16T07:56:58.089633+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:56:58.089633+0000","last_undegraded":"2024-09-16T07:56:58.089633+0000","last_fullsized":"2024-09-16T07:56:58.089633+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"110'902","reported_seq":978,"reported_epoch":121,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T07:56:52.265701+0000","last_change":"2024-09-16T07:56:52.268058+0000","last_active":"2024-09-16T07:56:52.265701+0000","last_peered":"2024-09-16T07:56:52.265701+0000","last_clean":"2024-09-16T07:56:49.061054+0000","last_became_active":"2024-09-16T07:56:52.254107+0000","last_became_peered":"2024-09-16T07:56:52.254107+0000","last_unstale":"2024-09-16T07:56:52.265701+0000","last_undegraded":"2024-09-16T07:56:52.160213+0000","last_fullsized":"2024-09-16T07:56:52.265701+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","3"],"object_location_counts":[{"shards":"0,1,3","objects":203}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":275,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.168913+0000","last_change":"2024-09-16T07:56:04.168188+0000","last_active":"2024-09-16T07:56:04.168913+0000","last_peered":"2024-09-16T07:56:04.168913+0000","last_clean":"2024-09-16T07:55:28.056128+0000","last_became_active":"2024-09-16T07:56:04.168188+0000","last_became_peered":"2024-09-16T07:56:04.168188+0000","last_unstale":"2024-09-16T07:56:50.042218+0000","last_undegraded":"2024-09-16T07:56:04.168913+0000","last_fullsized":"2024-09-16T07:56:04.078402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":182976536,"num_objects":2793,"num_object_clones":0,"num_object_copies":8379,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":816,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13849,"num_write_kb":532481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2031,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38645760,"data_stored":618135624,"data_compressed":29352384,"data_compressed_allocated":38633472,"data_compressed_original":618135552,"omap_allocated":0,"internal_metadata":0},"log_size":13862,"ondisk_log_size":13862,"up":45,"acting":45,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":21,"acting":21,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35836,"kb_used_data":6188,"kb_used_omap":0,"kb_used_meta":29632,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":6336512,"data_stored":84576275,"data_compressed":3997841,"data_compressed_allocated":5263360,"data_compressed_original":84131840,"omap_allocated":0,"internal_metadata":30343168},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500702,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39732,"kb_used_data":10580,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":10833920,"data_stored":156790259,"data_compressed":7427264,"data_compressed_allocated":9777152,"data_compressed_original":156352512,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73004,"kb_used_data":14556,"kb_used_omap":0,"kb_used_meta":58432,"kb_avail":94298836,"statfs":{"total":96636764160,"available":96562008064,"internally_reserved":0,"allocated":14905344,"data_stored":224554674,"data_compressed":10646152,"data_compressed_allocated":14012416,"data_compressed_original":224198656,"omap_allocated":0,"internal_metadata":59834368},"hb_peers":[0,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48616,"kb_used_data":11608,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":11886592,"data_stored":173950627,"data_compressed":8242609,"data_compressed_allocated":10850304,"data_compressed_original":173522944,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10813440,"data_stored":172949528,"data_compressed":8212568,"data_compressed_allocated":10809344,"data_compressed_original":172949504,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13541376,"data_stored":216596504,"data_compressed":10285160,"data_compressed_allocated":13537280,"data_compressed_original":216596480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9474048,"data_stored":151584768,"data_compressed":7198056,"data_compressed_allocated":9474048,"data_compressed_original":151584768,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4816896,"data_stored":77004824,"data_compressed":3656600,"data_compressed_allocated":4812800,"data_compressed_original":77004800,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:08.760 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:57:08.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:08.906+0000 7f98a9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:08.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:08.919+0000 7f98a9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:09.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:09.447 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 817/8391 objects degraded (9.737%), 5 pgs degraded, 6 pgs undersized","count":11},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":731,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":126,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473411,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":15},{"state_name":"stale+active+undersized+degraded","count":4},{"state_name":"active+recovering","count":2},{"state_name":"stale+active+undersized","count":2},{"state_name":"active+recovery_wait+degraded","count":1},{"state_name":"stale+active+clean","count":1}],"num_pgs":25,"num_pools":3,"num_objects":2797,"data_bytes":183566912,"bytes_used":201920512,"bytes_avail":386345136128,"bytes_total":386547056640,"degraded_objects":817,"degraded_total":8391,"degraded_ratio":0.097366225718031205,"recovering_objects_per_sec":71,"recovering_bytes_per_sec":15748,"recovering_keys_per_sec":0,"num_objects_recovered":595,"num_bytes_recovered":131072,"num_keys_recovered":0,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":51},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:57:09.465 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:57:09.466 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:09.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:09.599+0000 7fa6a6151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:09.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:09.611+0000 7fa6a6151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:09.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:09.855 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:09.870 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":480,"stamp":"2024-09-16T07:57:08.446691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":183566912,"num_objects":2797,"num_object_clones":0,"num_object_copies":8391,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":817,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13929,"num_write_kb":533588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2032,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13917,"ondisk_log_size":13917,"up":69,"acting":69,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":197188,"kb_used_data":42932,"kb_used_omap":0,"kb_used_meta":154176,"kb_avail":377290172,"statfs":{"total":386547056640,"available":386345136128,"internally_reserved":0,"allocated":43962368,"data_stored":639871835,"data_compressed":30313866,"data_compressed_allocated":39903232,"data_compressed_original":638205952,"omap_allocated":0,"internal_metadata":157876224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27852800,"num_objects":-425,"num_object_clones":0,"num_object_copies":-1275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-596,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":595,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.322850"},"pg_stats":[{"pgid":"6.f","version":"124'910","reported_seq":1479,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.861866+0000","last_change":"2024-09-16T07:56:52.415843+0000","last_active":"2024-09-16T07:56:58.861866+0000","last_peered":"2024-09-16T07:56:58.861866+0000","last_clean":"2024-09-16T07:55:36.831185+0000","last_became_active":"2024-09-16T07:56:52.211353+0000","last_became_peered":"2024-09-16T07:56:52.211353+0000","last_unstale":"2024-09-16T07:56:58.861866+0000","last_undegraded":"2024-09-16T07:56:58.861866+0000","last_fullsized":"2024-09-16T07:56:58.861866+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":26,"num_objects_missing":26,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":154}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"106'822","reported_seq":863,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.713938+0000","last_change":"2024-09-16T07:56:04.234616+0000","last_active":"2024-09-16T07:56:26.713938+0000","last_peered":"2024-09-16T07:56:26.713938+0000","last_clean":"2024-09-16T07:55:36.894044+0000","last_became_active":"2024-09-16T07:56:04.234616+0000","last_became_peered":"2024-09-16T07:56:04.234616+0000","last_unstale":"2024-09-16T07:56:50.042195+0000","last_undegraded":"2024-09-16T07:56:04.095494+0000","last_fullsized":"2024-09-16T07:56:04.093963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":300}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"106'784","reported_seq":823,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-09-16T07:56:26.993304+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:56:26.993304+0000","last_peered":"2024-09-16T07:56:26.993304+0000","last_clean":"2024-09-16T07:56:26.993304+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:56:50.042197+0000","last_undegraded":"2024-09-16T07:56:26.993304+0000","last_fullsized":"2024-09-16T07:56:26.993304+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925272,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":784,"num_write_kb":32833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"126'954","reported_seq":1645,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.736259+0000","last_change":"2024-09-16T07:56:52.442416+0000","last_active":"2024-09-16T07:57:02.736259+0000","last_peered":"2024-09-16T07:57:02.736259+0000","last_clean":"2024-09-16T07:57:02.736259+0000","last_became_active":"2024-09-16T07:56:52.244859+0000","last_became_peered":"2024-09-16T07:56:52.244859+0000","last_unstale":"2024-09-16T07:57:02.736259+0000","last_undegraded":"2024-09-16T07:57:02.736259+0000","last_fullsized":"2024-09-16T07:57:02.736259+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":954,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"106'765","reported_seq":796,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.802068+0000","last_change":"2024-09-16T07:56:04.188084+0000","last_active":"2024-09-16T07:56:26.802068+0000","last_peered":"2024-09-16T07:56:26.802068+0000","last_clean":"2024-09-16T07:55:37.016460+0000","last_became_active":"2024-09-16T07:56:04.188084+0000","last_became_peered":"2024-09-16T07:56:04.188084+0000","last_unstale":"2024-09-16T07:56:50.042199+0000","last_undegraded":"2024-09-16T07:56:04.099920+0000","last_fullsized":"2024-09-16T07:56:04.098703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":279,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":279}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"124'836","reported_seq":907,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.763000+0000","last_change":"2024-09-16T07:56:52.236220+0000","last_active":"2024-09-16T07:56:58.763000+0000","last_peered":"2024-09-16T07:56:58.763000+0000","last_clean":"2024-09-16T07:56:58.763000+0000","last_became_active":"2024-09-16T07:56:52.210769+0000","last_became_peered":"2024-09-16T07:56:52.210769+0000","last_unstale":"2024-09-16T07:56:58.763000+0000","last_undegraded":"2024-09-16T07:56:58.763000+0000","last_fullsized":"2024-09-16T07:56:58.763000+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":31552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"126'958","reported_seq":1651,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.902907+0000","last_change":"2024-09-16T07:57:01.189928+0000","last_active":"2024-09-16T07:57:02.902907+0000","last_peered":"2024-09-16T07:57:02.902907+0000","last_clean":"2024-09-16T07:57:02.902907+0000","last_became_active":"2024-09-16T07:57:01.175598+0000","last_became_peered":"2024-09-16T07:57:01.175598+0000","last_unstale":"2024-09-16T07:57:02.902907+0000","last_undegraded":"2024-09-16T07:57:02.902907+0000","last_fullsized":"2024-09-16T07:57:02.902907+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"110'817","reported_seq":1439,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.123346+0000","last_change":"2024-09-16T07:56:39.099974+0000","last_active":"2024-09-16T07:56:52.123346+0000","last_peered":"2024-09-16T07:56:52.123346+0000","last_clean":"2024-09-16T07:56:52.123346+0000","last_became_active":"2024-09-16T07:56:39.094850+0000","last_became_peered":"2024-09-16T07:56:39.094850+0000","last_unstale":"2024-09-16T07:56:52.123346+0000","last_undegraded":"2024-09-16T07:56:52.123346+0000","last_fullsized":"2024-09-16T07:56:52.123346+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"110'774","reported_seq":849,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.244861+0000","last_change":"2024-09-16T07:56:52.246248+0000","last_active":"2024-09-16T07:56:52.244861+0000","last_peered":"2024-09-16T07:56:52.244861+0000","last_clean":"2024-09-16T07:56:49.058981+0000","last_became_active":"2024-09-16T07:56:52.238011+0000","last_became_peered":"2024-09-16T07:56:52.238011+0000","last_unstale":"2024-09-16T07:56:52.244861+0000","last_undegraded":"2024-09-16T07:56:52.244861+0000","last_fullsized":"2024-09-16T07:56:52.244861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":379,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.140645+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:01.140645+0000","last_peered":"2024-09-16T07:57:01.140645+0000","last_clean":"2024-09-16T07:57:01.140645+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:01.140645+0000","last_undegraded":"2024-09-16T07:57:01.140645+0000","last_fullsized":"2024-09-16T07:57:01.140645+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":282,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:04.168624+0000","last_change":"2024-09-16T07:56:04.167227+0000","last_active":"2024-09-16T07:56:04.168624+0000","last_peered":"2024-09-16T07:56:04.168624+0000","last_clean":"2024-09-16T07:55:28.056115+0000","last_became_active":"2024-09-16T07:56:04.167227+0000","last_became_peered":"2024-09-16T07:56:04.167227+0000","last_unstale":"2024-09-16T07:56:50.042204+0000","last_undegraded":"2024-09-16T07:56:04.100204+0000","last_fullsized":"2024-09-16T07:56:04.098024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"126'908","reported_seq":1012,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:03.006212+0000","last_change":"2024-09-16T07:56:59.704605+0000","last_active":"2024-09-16T07:57:03.006212+0000","last_peered":"2024-09-16T07:57:03.006212+0000","last_clean":"2024-09-16T07:57:03.006212+0000","last_became_active":"2024-09-16T07:56:52.289647+0000","last_became_peered":"2024-09-16T07:56:52.289647+0000","last_unstale":"2024-09-16T07:57:03.006212+0000","last_undegraded":"2024-09-16T07:57:03.006212+0000","last_fullsized":"2024-09-16T07:57:03.006212+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.223011+0000","last_change":"2024-09-16T07:56:52.225705+0000","last_active":"2024-09-16T07:56:52.223011+0000","last_peered":"2024-09-16T07:56:52.223011+0000","last_clean":"2024-09-16T07:56:49.056656+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:56:52.223011+0000","last_undegraded":"2024-09-16T07:56:52.223011+0000","last_fullsized":"2024-09-16T07:56:52.223011+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"124'937","reported_seq":1213,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.860601+0000","last_change":"2024-09-16T07:56:39.095587+0000","last_active":"2024-09-16T07:56:58.860601+0000","last_peered":"2024-09-16T07:56:58.860601+0000","last_clean":"2024-09-16T07:56:58.860601+0000","last_became_active":"2024-09-16T07:56:39.090610+0000","last_became_peered":"2024-09-16T07:56:39.090610+0000","last_unstale":"2024-09-16T07:56:58.860601+0000","last_undegraded":"2024-09-16T07:56:58.860601+0000","last_fullsized":"2024-09-16T07:56:58.860601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":935,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.153952+0000","last_change":"2024-09-16T07:56:04.153196+0000","last_active":"2024-09-16T07:56:04.153952+0000","last_peered":"2024-09-16T07:56:04.153952+0000","last_clean":"2024-09-16T07:55:28.045293+0000","last_became_active":"2024-09-16T07:56:04.153196+0000","last_became_peered":"2024-09-16T07:56:04.153196+0000","last_unstale":"2024-09-16T07:56:50.042206+0000","last_undegraded":"2024-09-16T07:56:04.153952+0000","last_fullsized":"2024-09-16T07:56:04.074241+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"126'917","reported_seq":1014,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.634659+0000","last_change":"2024-09-16T07:56:52.223936+0000","last_active":"2024-09-16T07:57:02.634659+0000","last_peered":"2024-09-16T07:57:02.634659+0000","last_clean":"2024-09-16T07:57:02.634659+0000","last_became_active":"2024-09-16T07:56:52.218070+0000","last_became_peered":"2024-09-16T07:56:52.218070+0000","last_unstale":"2024-09-16T07:57:02.634659+0000","last_undegraded":"2024-09-16T07:57:02.634659+0000","last_fullsized":"2024-09-16T07:57:02.634659+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.259755+0000","last_change":"2024-09-16T07:56:52.263340+0000","last_active":"2024-09-16T07:56:52.259755+0000","last_peered":"2024-09-16T07:56:52.259755+0000","last_clean":"2024-09-16T07:56:49.060679+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:56:52.259755+0000","last_undegraded":"2024-09-16T07:56:52.259755+0000","last_fullsized":"2024-09-16T07:56:52.259755+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"124'947","reported_seq":1033,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.777426+0000","last_change":"2024-09-16T07:56:43.081255+0000","last_active":"2024-09-16T07:56:58.777426+0000","last_peered":"2024-09-16T07:56:58.777426+0000","last_clean":"2024-09-16T07:56:58.777426+0000","last_became_active":"2024-09-16T07:56:43.075222+0000","last_became_peered":"2024-09-16T07:56:43.075222+0000","last_unstale":"2024-09-16T07:56:58.777426+0000","last_undegraded":"2024-09-16T07:56:58.777426+0000","last_fullsized":"2024-09-16T07:56:58.777426+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":947,"log_dups_size":0,"ondisk_log_size":947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.091990+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:56:58.091990+0000","last_peered":"2024-09-16T07:56:58.091990+0000","last_clean":"2024-09-16T07:56:58.091990+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:56:58.091990+0000","last_undegraded":"2024-09-16T07:56:58.091990+0000","last_fullsized":"2024-09-16T07:56:58.091990+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"124'891","reported_seq":1461,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.871398+0000","last_change":"2024-09-16T07:56:52.457538+0000","last_active":"2024-09-16T07:56:58.871398+0000","last_peered":"2024-09-16T07:56:58.871398+0000","last_clean":"2024-09-16T07:55:36.614734+0000","last_became_active":"2024-09-16T07:56:52.224076+0000","last_became_peered":"2024-09-16T07:56:52.224076+0000","last_unstale":"2024-09-16T07:56:58.871398+0000","last_undegraded":"2024-09-16T07:56:58.871398+0000","last_fullsized":"2024-09-16T07:56:58.871398+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":37,"num_objects_missing":37,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":889,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":253,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":139}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.138533+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:01.138533+0000","last_peered":"2024-09-16T07:57:01.138533+0000","last_clean":"2024-09-16T07:57:01.138533+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:01.138533+0000","last_undegraded":"2024-09-16T07:57:01.138533+0000","last_fullsized":"2024-09-16T07:57:01.138533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"106'740","reported_seq":772,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.778896+0000","last_change":"2024-09-16T07:56:04.242962+0000","last_active":"2024-09-16T07:56:26.778896+0000","last_peered":"2024-09-16T07:56:26.778896+0000","last_clean":"2024-09-16T07:55:36.812189+0000","last_became_active":"2024-09-16T07:56:04.242962+0000","last_became_peered":"2024-09-16T07:56:04.242962+0000","last_unstale":"2024-09-16T07:56:50.042216+0000","last_undegraded":"2024-09-16T07:56:04.106106+0000","last_fullsized":"2024-09-16T07:56:04.103930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":236}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.089633+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:56:58.089633+0000","last_peered":"2024-09-16T07:56:58.089633+0000","last_clean":"2024-09-16T07:56:58.089633+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:56:58.089633+0000","last_undegraded":"2024-09-16T07:56:58.089633+0000","last_fullsized":"2024-09-16T07:56:58.089633+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"110'902","reported_seq":978,"reported_epoch":121,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T07:56:52.265701+0000","last_change":"2024-09-16T07:56:52.268058+0000","last_active":"2024-09-16T07:56:52.265701+0000","last_peered":"2024-09-16T07:56:52.265701+0000","last_clean":"2024-09-16T07:56:49.061054+0000","last_became_active":"2024-09-16T07:56:52.254107+0000","last_became_peered":"2024-09-16T07:56:52.254107+0000","last_unstale":"2024-09-16T07:56:52.265701+0000","last_undegraded":"2024-09-16T07:56:52.160213+0000","last_fullsized":"2024-09-16T07:56:52.265701+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","3"],"object_location_counts":[{"shards":"0,1,3","objects":203}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":275,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.168913+0000","last_change":"2024-09-16T07:56:04.168188+0000","last_active":"2024-09-16T07:56:04.168913+0000","last_peered":"2024-09-16T07:56:04.168913+0000","last_clean":"2024-09-16T07:55:28.056128+0000","last_became_active":"2024-09-16T07:56:04.168188+0000","last_became_peered":"2024-09-16T07:56:04.168188+0000","last_unstale":"2024-09-16T07:56:50.042218+0000","last_undegraded":"2024-09-16T07:56:04.168913+0000","last_fullsized":"2024-09-16T07:56:04.078402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":182976536,"num_objects":2793,"num_object_clones":0,"num_object_copies":8379,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":816,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13849,"num_write_kb":532481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2031,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38645760,"data_stored":618135624,"data_compressed":29352384,"data_compressed_allocated":38633472,"data_compressed_original":618135552,"omap_allocated":0,"internal_metadata":0},"log_size":13862,"ondisk_log_size":13862,"up":45,"acting":45,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":21,"acting":21,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35836,"kb_used_data":6188,"kb_used_omap":0,"kb_used_meta":29632,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":6336512,"data_stored":84576275,"data_compressed":3997841,"data_compressed_allocated":5263360,"data_compressed_original":84131840,"omap_allocated":0,"internal_metadata":30343168},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500702,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39732,"kb_used_data":10580,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":10833920,"data_stored":156790259,"data_compressed":7427264,"data_compressed_allocated":9777152,"data_compressed_original":156352512,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73004,"kb_used_data":14556,"kb_used_omap":0,"kb_used_meta":58432,"kb_avail":94298836,"statfs":{"total":96636764160,"available":96562008064,"internally_reserved":0,"allocated":14905344,"data_stored":224554674,"data_compressed":10646152,"data_compressed_allocated":14012416,"data_compressed_original":224198656,"omap_allocated":0,"internal_metadata":59834368},"hb_peers":[0,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48616,"kb_used_data":11608,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":11886592,"data_stored":173950627,"data_compressed":8242609,"data_compressed_allocated":10850304,"data_compressed_original":173522944,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10813440,"data_stored":172949528,"data_compressed":8212568,"data_compressed_allocated":10809344,"data_compressed_original":172949504,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13541376,"data_stored":216596504,"data_compressed":10285160,"data_compressed_allocated":13537280,"data_compressed_original":216596480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9474048,"data_stored":151584768,"data_compressed":7198056,"data_compressed_allocated":9474048,"data_compressed_original":151584768,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4816896,"data_stored":77004824,"data_compressed":3656600,"data_compressed_allocated":4812800,"data_compressed_original":77004800,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:10.221 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:57:10.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:10.377+0000 7fe38bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:10.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:10.385+0000 7fe38bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:12.867 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:57:12.872 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:13.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:13.031+0000 7fba8acfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:13.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:13.041+0000 7fba8acfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:13.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:13.073+0000 7f3171391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:13.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:13.088+0000 7f316bfff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:13.444 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:13.445 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:13.466 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":482,"stamp":"2024-09-16T07:57:12.447706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":183566912,"num_objects":2797,"num_object_clones":0,"num_object_copies":8391,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":817,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13929,"num_write_kb":533588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2032,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13917,"ondisk_log_size":13917,"up":69,"acting":69,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":197188,"kb_used_data":42932,"kb_used_omap":0,"kb_used_meta":154176,"kb_avail":377290172,"statfs":{"total":386547056640,"available":386345136128,"internally_reserved":0,"allocated":43962368,"data_stored":639871835,"data_compressed":30313866,"data_compressed_allocated":39903232,"data_compressed_original":638205952,"omap_allocated":0,"internal_metadata":157876224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27852800,"num_objects":-425,"num_object_clones":0,"num_object_copies":-1275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-596,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":595,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.322965"},"pg_stats":[{"pgid":"6.f","version":"124'910","reported_seq":1479,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.861866+0000","last_change":"2024-09-16T07:56:52.415843+0000","last_active":"2024-09-16T07:56:58.861866+0000","last_peered":"2024-09-16T07:56:58.861866+0000","last_clean":"2024-09-16T07:55:36.831185+0000","last_became_active":"2024-09-16T07:56:52.211353+0000","last_became_peered":"2024-09-16T07:56:52.211353+0000","last_unstale":"2024-09-16T07:56:58.861866+0000","last_undegraded":"2024-09-16T07:56:58.861866+0000","last_fullsized":"2024-09-16T07:56:58.861866+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":26,"num_objects_missing":26,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":154}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"106'822","reported_seq":863,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.713938+0000","last_change":"2024-09-16T07:56:04.234616+0000","last_active":"2024-09-16T07:56:26.713938+0000","last_peered":"2024-09-16T07:56:26.713938+0000","last_clean":"2024-09-16T07:55:36.894044+0000","last_became_active":"2024-09-16T07:56:04.234616+0000","last_became_peered":"2024-09-16T07:56:04.234616+0000","last_unstale":"2024-09-16T07:56:50.042195+0000","last_undegraded":"2024-09-16T07:56:04.095494+0000","last_fullsized":"2024-09-16T07:56:04.093963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":300}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"106'784","reported_seq":823,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-09-16T07:56:26.993304+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:56:26.993304+0000","last_peered":"2024-09-16T07:56:26.993304+0000","last_clean":"2024-09-16T07:56:26.993304+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:56:50.042197+0000","last_undegraded":"2024-09-16T07:56:26.993304+0000","last_fullsized":"2024-09-16T07:56:26.993304+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925272,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":784,"num_write_kb":32833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"126'954","reported_seq":1645,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.736259+0000","last_change":"2024-09-16T07:56:52.442416+0000","last_active":"2024-09-16T07:57:02.736259+0000","last_peered":"2024-09-16T07:57:02.736259+0000","last_clean":"2024-09-16T07:57:02.736259+0000","last_became_active":"2024-09-16T07:56:52.244859+0000","last_became_peered":"2024-09-16T07:56:52.244859+0000","last_unstale":"2024-09-16T07:57:02.736259+0000","last_undegraded":"2024-09-16T07:57:02.736259+0000","last_fullsized":"2024-09-16T07:57:02.736259+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":954,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"106'765","reported_seq":796,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.802068+0000","last_change":"2024-09-16T07:56:04.188084+0000","last_active":"2024-09-16T07:56:26.802068+0000","last_peered":"2024-09-16T07:56:26.802068+0000","last_clean":"2024-09-16T07:55:37.016460+0000","last_became_active":"2024-09-16T07:56:04.188084+0000","last_became_peered":"2024-09-16T07:56:04.188084+0000","last_unstale":"2024-09-16T07:56:50.042199+0000","last_undegraded":"2024-09-16T07:56:04.099920+0000","last_fullsized":"2024-09-16T07:56:04.098703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":279,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":279}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"124'836","reported_seq":907,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.763000+0000","last_change":"2024-09-16T07:56:52.236220+0000","last_active":"2024-09-16T07:56:58.763000+0000","last_peered":"2024-09-16T07:56:58.763000+0000","last_clean":"2024-09-16T07:56:58.763000+0000","last_became_active":"2024-09-16T07:56:52.210769+0000","last_became_peered":"2024-09-16T07:56:52.210769+0000","last_unstale":"2024-09-16T07:56:58.763000+0000","last_undegraded":"2024-09-16T07:56:58.763000+0000","last_fullsized":"2024-09-16T07:56:58.763000+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":31552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"126'958","reported_seq":1651,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.902907+0000","last_change":"2024-09-16T07:57:01.189928+0000","last_active":"2024-09-16T07:57:02.902907+0000","last_peered":"2024-09-16T07:57:02.902907+0000","last_clean":"2024-09-16T07:57:02.902907+0000","last_became_active":"2024-09-16T07:57:01.175598+0000","last_became_peered":"2024-09-16T07:57:01.175598+0000","last_unstale":"2024-09-16T07:57:02.902907+0000","last_undegraded":"2024-09-16T07:57:02.902907+0000","last_fullsized":"2024-09-16T07:57:02.902907+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"110'817","reported_seq":1439,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.123346+0000","last_change":"2024-09-16T07:56:39.099974+0000","last_active":"2024-09-16T07:56:52.123346+0000","last_peered":"2024-09-16T07:56:52.123346+0000","last_clean":"2024-09-16T07:56:52.123346+0000","last_became_active":"2024-09-16T07:56:39.094850+0000","last_became_peered":"2024-09-16T07:56:39.094850+0000","last_unstale":"2024-09-16T07:56:52.123346+0000","last_undegraded":"2024-09-16T07:56:52.123346+0000","last_fullsized":"2024-09-16T07:56:52.123346+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"110'774","reported_seq":849,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.244861+0000","last_change":"2024-09-16T07:56:52.246248+0000","last_active":"2024-09-16T07:56:52.244861+0000","last_peered":"2024-09-16T07:56:52.244861+0000","last_clean":"2024-09-16T07:56:49.058981+0000","last_became_active":"2024-09-16T07:56:52.238011+0000","last_became_peered":"2024-09-16T07:56:52.238011+0000","last_unstale":"2024-09-16T07:56:52.244861+0000","last_undegraded":"2024-09-16T07:56:52.244861+0000","last_fullsized":"2024-09-16T07:56:52.244861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":379,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.140645+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:01.140645+0000","last_peered":"2024-09-16T07:57:01.140645+0000","last_clean":"2024-09-16T07:57:01.140645+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:01.140645+0000","last_undegraded":"2024-09-16T07:57:01.140645+0000","last_fullsized":"2024-09-16T07:57:01.140645+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":282,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:04.168624+0000","last_change":"2024-09-16T07:56:04.167227+0000","last_active":"2024-09-16T07:56:04.168624+0000","last_peered":"2024-09-16T07:56:04.168624+0000","last_clean":"2024-09-16T07:55:28.056115+0000","last_became_active":"2024-09-16T07:56:04.167227+0000","last_became_peered":"2024-09-16T07:56:04.167227+0000","last_unstale":"2024-09-16T07:56:50.042204+0000","last_undegraded":"2024-09-16T07:56:04.100204+0000","last_fullsized":"2024-09-16T07:56:04.098024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"126'908","reported_seq":1012,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:03.006212+0000","last_change":"2024-09-16T07:56:59.704605+0000","last_active":"2024-09-16T07:57:03.006212+0000","last_peered":"2024-09-16T07:57:03.006212+0000","last_clean":"2024-09-16T07:57:03.006212+0000","last_became_active":"2024-09-16T07:56:52.289647+0000","last_became_peered":"2024-09-16T07:56:52.289647+0000","last_unstale":"2024-09-16T07:57:03.006212+0000","last_undegraded":"2024-09-16T07:57:03.006212+0000","last_fullsized":"2024-09-16T07:57:03.006212+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.223011+0000","last_change":"2024-09-16T07:56:52.225705+0000","last_active":"2024-09-16T07:56:52.223011+0000","last_peered":"2024-09-16T07:56:52.223011+0000","last_clean":"2024-09-16T07:56:49.056656+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:56:52.223011+0000","last_undegraded":"2024-09-16T07:56:52.223011+0000","last_fullsized":"2024-09-16T07:56:52.223011+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"124'937","reported_seq":1213,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.860601+0000","last_change":"2024-09-16T07:56:39.095587+0000","last_active":"2024-09-16T07:56:58.860601+0000","last_peered":"2024-09-16T07:56:58.860601+0000","last_clean":"2024-09-16T07:56:58.860601+0000","last_became_active":"2024-09-16T07:56:39.090610+0000","last_became_peered":"2024-09-16T07:56:39.090610+0000","last_unstale":"2024-09-16T07:56:58.860601+0000","last_undegraded":"2024-09-16T07:56:58.860601+0000","last_fullsized":"2024-09-16T07:56:58.860601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":935,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.153952+0000","last_change":"2024-09-16T07:56:04.153196+0000","last_active":"2024-09-16T07:56:04.153952+0000","last_peered":"2024-09-16T07:56:04.153952+0000","last_clean":"2024-09-16T07:55:28.045293+0000","last_became_active":"2024-09-16T07:56:04.153196+0000","last_became_peered":"2024-09-16T07:56:04.153196+0000","last_unstale":"2024-09-16T07:56:50.042206+0000","last_undegraded":"2024-09-16T07:56:04.153952+0000","last_fullsized":"2024-09-16T07:56:04.074241+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"126'917","reported_seq":1014,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.634659+0000","last_change":"2024-09-16T07:56:52.223936+0000","last_active":"2024-09-16T07:57:02.634659+0000","last_peered":"2024-09-16T07:57:02.634659+0000","last_clean":"2024-09-16T07:57:02.634659+0000","last_became_active":"2024-09-16T07:56:52.218070+0000","last_became_peered":"2024-09-16T07:56:52.218070+0000","last_unstale":"2024-09-16T07:57:02.634659+0000","last_undegraded":"2024-09-16T07:57:02.634659+0000","last_fullsized":"2024-09-16T07:57:02.634659+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.259755+0000","last_change":"2024-09-16T07:56:52.263340+0000","last_active":"2024-09-16T07:56:52.259755+0000","last_peered":"2024-09-16T07:56:52.259755+0000","last_clean":"2024-09-16T07:56:49.060679+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:56:52.259755+0000","last_undegraded":"2024-09-16T07:56:52.259755+0000","last_fullsized":"2024-09-16T07:56:52.259755+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"124'947","reported_seq":1033,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.777426+0000","last_change":"2024-09-16T07:56:43.081255+0000","last_active":"2024-09-16T07:56:58.777426+0000","last_peered":"2024-09-16T07:56:58.777426+0000","last_clean":"2024-09-16T07:56:58.777426+0000","last_became_active":"2024-09-16T07:56:43.075222+0000","last_became_peered":"2024-09-16T07:56:43.075222+0000","last_unstale":"2024-09-16T07:56:58.777426+0000","last_undegraded":"2024-09-16T07:56:58.777426+0000","last_fullsized":"2024-09-16T07:56:58.777426+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":947,"log_dups_size":0,"ondisk_log_size":947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.091990+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:56:58.091990+0000","last_peered":"2024-09-16T07:56:58.091990+0000","last_clean":"2024-09-16T07:56:58.091990+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:56:58.091990+0000","last_undegraded":"2024-09-16T07:56:58.091990+0000","last_fullsized":"2024-09-16T07:56:58.091990+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"124'891","reported_seq":1461,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.871398+0000","last_change":"2024-09-16T07:56:52.457538+0000","last_active":"2024-09-16T07:56:58.871398+0000","last_peered":"2024-09-16T07:56:58.871398+0000","last_clean":"2024-09-16T07:55:36.614734+0000","last_became_active":"2024-09-16T07:56:52.224076+0000","last_became_peered":"2024-09-16T07:56:52.224076+0000","last_unstale":"2024-09-16T07:56:58.871398+0000","last_undegraded":"2024-09-16T07:56:58.871398+0000","last_fullsized":"2024-09-16T07:56:58.871398+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":37,"num_objects_missing":37,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":889,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":253,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":139}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.138533+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:01.138533+0000","last_peered":"2024-09-16T07:57:01.138533+0000","last_clean":"2024-09-16T07:57:01.138533+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:01.138533+0000","last_undegraded":"2024-09-16T07:57:01.138533+0000","last_fullsized":"2024-09-16T07:57:01.138533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"106'740","reported_seq":772,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.778896+0000","last_change":"2024-09-16T07:56:04.242962+0000","last_active":"2024-09-16T07:56:26.778896+0000","last_peered":"2024-09-16T07:56:26.778896+0000","last_clean":"2024-09-16T07:55:36.812189+0000","last_became_active":"2024-09-16T07:56:04.242962+0000","last_became_peered":"2024-09-16T07:56:04.242962+0000","last_unstale":"2024-09-16T07:56:50.042216+0000","last_undegraded":"2024-09-16T07:56:04.106106+0000","last_fullsized":"2024-09-16T07:56:04.103930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":236}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.089633+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:56:58.089633+0000","last_peered":"2024-09-16T07:56:58.089633+0000","last_clean":"2024-09-16T07:56:58.089633+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:56:58.089633+0000","last_undegraded":"2024-09-16T07:56:58.089633+0000","last_fullsized":"2024-09-16T07:56:58.089633+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"110'902","reported_seq":978,"reported_epoch":121,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T07:56:52.265701+0000","last_change":"2024-09-16T07:56:52.268058+0000","last_active":"2024-09-16T07:56:52.265701+0000","last_peered":"2024-09-16T07:56:52.265701+0000","last_clean":"2024-09-16T07:56:49.061054+0000","last_became_active":"2024-09-16T07:56:52.254107+0000","last_became_peered":"2024-09-16T07:56:52.254107+0000","last_unstale":"2024-09-16T07:56:52.265701+0000","last_undegraded":"2024-09-16T07:56:52.160213+0000","last_fullsized":"2024-09-16T07:56:52.265701+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","3"],"object_location_counts":[{"shards":"0,1,3","objects":203}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":275,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.168913+0000","last_change":"2024-09-16T07:56:04.168188+0000","last_active":"2024-09-16T07:56:04.168913+0000","last_peered":"2024-09-16T07:56:04.168913+0000","last_clean":"2024-09-16T07:55:28.056128+0000","last_became_active":"2024-09-16T07:56:04.168188+0000","last_became_peered":"2024-09-16T07:56:04.168188+0000","last_unstale":"2024-09-16T07:56:50.042218+0000","last_undegraded":"2024-09-16T07:56:04.168913+0000","last_fullsized":"2024-09-16T07:56:04.078402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":182976536,"num_objects":2793,"num_object_clones":0,"num_object_copies":8379,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":816,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13849,"num_write_kb":532481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2031,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38645760,"data_stored":618135624,"data_compressed":29352384,"data_compressed_allocated":38633472,"data_compressed_original":618135552,"omap_allocated":0,"internal_metadata":0},"log_size":13862,"ondisk_log_size":13862,"up":45,"acting":45,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":21,"acting":21,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35836,"kb_used_data":6188,"kb_used_omap":0,"kb_used_meta":29632,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":6336512,"data_stored":84576275,"data_compressed":3997841,"data_compressed_allocated":5263360,"data_compressed_original":84131840,"omap_allocated":0,"internal_metadata":30343168},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500702,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39732,"kb_used_data":10580,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":10833920,"data_stored":156790259,"data_compressed":7427264,"data_compressed_allocated":9777152,"data_compressed_original":156352512,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73004,"kb_used_data":14556,"kb_used_omap":0,"kb_used_meta":58432,"kb_avail":94298836,"statfs":{"total":96636764160,"available":96562008064,"internally_reserved":0,"allocated":14905344,"data_stored":224554674,"data_compressed":10646152,"data_compressed_allocated":14012416,"data_compressed_original":224198656,"omap_allocated":0,"internal_metadata":59834368},"hb_peers":[0,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48616,"kb_used_data":11608,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":11886592,"data_stored":173950627,"data_compressed":8242609,"data_compressed_allocated":10850304,"data_compressed_original":173522944,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10813440,"data_stored":172949528,"data_compressed":8212568,"data_compressed_allocated":10809344,"data_compressed_original":172949504,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13541376,"data_stored":216596504,"data_compressed":10285160,"data_compressed_allocated":13537280,"data_compressed_original":216596480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9474048,"data_stored":151584768,"data_compressed":7198056,"data_compressed_allocated":9474048,"data_compressed_original":151584768,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4816896,"data_stored":77004824,"data_compressed":3656600,"data_compressed_allocated":4812800,"data_compressed_original":77004800,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:13.467 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:57:13.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:13.603+0000 7f0c1cf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:13.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:13.613+0000 7f0c1cf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:14.100 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:14.100 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 817/8391 objects degraded (9.737%), 5 pgs degraded, 6 pgs undersized","count":11},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":736,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":126,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473411,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":15},{"state_name":"stale+active+undersized+degraded","count":4},{"state_name":"active+recovering","count":2},{"state_name":"stale+active+undersized","count":2},{"state_name":"active+recovery_wait+degraded","count":1},{"state_name":"stale+active+clean","count":1}],"num_pgs":25,"num_pools":3,"num_objects":2797,"data_bytes":183566912,"bytes_used":201920512,"bytes_avail":386345136128,"bytes_total":386547056640,"degraded_objects":817,"degraded_total":8391,"degraded_ratio":0.097366225718031205,"recovering_objects_per_sec":52,"recovering_bytes_per_sec":11575,"recovering_keys_per_sec":0,"num_objects_recovered":595,"num_bytes_recovered":131072,"num_keys_recovered":0,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":37},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:57:14.122 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:57:14.122 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:14.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:14.254+0000 7f3a6a6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:14.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:14.265+0000 7f3a6a6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:14.392 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Removed 8328 objects 2024-09-16T07:57:14.392 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Clean up completed and total clean up time :69.189 2024-09-16T07:57:14.493 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:14.493 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:14.507 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":483,"stamp":"2024-09-16T07:57:14.448221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":183566912,"num_objects":2797,"num_object_clones":0,"num_object_copies":8391,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":817,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13929,"num_write_kb":533588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2032,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13917,"ondisk_log_size":13917,"up":69,"acting":69,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":197188,"kb_used_data":42932,"kb_used_omap":0,"kb_used_meta":154176,"kb_avail":377290172,"statfs":{"total":386547056640,"available":386345136128,"internally_reserved":0,"allocated":43962368,"data_stored":639871835,"data_compressed":30313866,"data_compressed_allocated":39903232,"data_compressed_original":638205952,"omap_allocated":0,"internal_metadata":157876224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27852800,"num_objects":-425,"num_object_clones":0,"num_object_copies":-1275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-596,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":595,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002871"},"pg_stats":[{"pgid":"6.f","version":"124'910","reported_seq":1479,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.861866+0000","last_change":"2024-09-16T07:56:52.415843+0000","last_active":"2024-09-16T07:56:58.861866+0000","last_peered":"2024-09-16T07:56:58.861866+0000","last_clean":"2024-09-16T07:55:36.831185+0000","last_became_active":"2024-09-16T07:56:52.211353+0000","last_became_peered":"2024-09-16T07:56:52.211353+0000","last_unstale":"2024-09-16T07:56:58.861866+0000","last_undegraded":"2024-09-16T07:56:58.861866+0000","last_fullsized":"2024-09-16T07:56:58.861866+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":26,"num_objects_missing":26,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":154}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"106'822","reported_seq":863,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.713938+0000","last_change":"2024-09-16T07:56:04.234616+0000","last_active":"2024-09-16T07:56:26.713938+0000","last_peered":"2024-09-16T07:56:26.713938+0000","last_clean":"2024-09-16T07:55:36.894044+0000","last_became_active":"2024-09-16T07:56:04.234616+0000","last_became_peered":"2024-09-16T07:56:04.234616+0000","last_unstale":"2024-09-16T07:56:50.042195+0000","last_undegraded":"2024-09-16T07:56:04.095494+0000","last_fullsized":"2024-09-16T07:56:04.093963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":300}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"106'784","reported_seq":823,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-09-16T07:56:26.993304+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:56:26.993304+0000","last_peered":"2024-09-16T07:56:26.993304+0000","last_clean":"2024-09-16T07:56:26.993304+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:56:50.042197+0000","last_undegraded":"2024-09-16T07:56:26.993304+0000","last_fullsized":"2024-09-16T07:56:26.993304+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925272,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":784,"num_write_kb":32833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"126'954","reported_seq":1645,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.736259+0000","last_change":"2024-09-16T07:56:52.442416+0000","last_active":"2024-09-16T07:57:02.736259+0000","last_peered":"2024-09-16T07:57:02.736259+0000","last_clean":"2024-09-16T07:57:02.736259+0000","last_became_active":"2024-09-16T07:56:52.244859+0000","last_became_peered":"2024-09-16T07:56:52.244859+0000","last_unstale":"2024-09-16T07:57:02.736259+0000","last_undegraded":"2024-09-16T07:57:02.736259+0000","last_fullsized":"2024-09-16T07:57:02.736259+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":954,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"106'765","reported_seq":796,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.802068+0000","last_change":"2024-09-16T07:56:04.188084+0000","last_active":"2024-09-16T07:56:26.802068+0000","last_peered":"2024-09-16T07:56:26.802068+0000","last_clean":"2024-09-16T07:55:37.016460+0000","last_became_active":"2024-09-16T07:56:04.188084+0000","last_became_peered":"2024-09-16T07:56:04.188084+0000","last_unstale":"2024-09-16T07:56:50.042199+0000","last_undegraded":"2024-09-16T07:56:04.099920+0000","last_fullsized":"2024-09-16T07:56:04.098703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":279,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":279}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"124'836","reported_seq":907,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.763000+0000","last_change":"2024-09-16T07:56:52.236220+0000","last_active":"2024-09-16T07:56:58.763000+0000","last_peered":"2024-09-16T07:56:58.763000+0000","last_clean":"2024-09-16T07:56:58.763000+0000","last_became_active":"2024-09-16T07:56:52.210769+0000","last_became_peered":"2024-09-16T07:56:52.210769+0000","last_unstale":"2024-09-16T07:56:58.763000+0000","last_undegraded":"2024-09-16T07:56:58.763000+0000","last_fullsized":"2024-09-16T07:56:58.763000+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":31552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"126'958","reported_seq":1651,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.902907+0000","last_change":"2024-09-16T07:57:01.189928+0000","last_active":"2024-09-16T07:57:02.902907+0000","last_peered":"2024-09-16T07:57:02.902907+0000","last_clean":"2024-09-16T07:57:02.902907+0000","last_became_active":"2024-09-16T07:57:01.175598+0000","last_became_peered":"2024-09-16T07:57:01.175598+0000","last_unstale":"2024-09-16T07:57:02.902907+0000","last_undegraded":"2024-09-16T07:57:02.902907+0000","last_fullsized":"2024-09-16T07:57:02.902907+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"110'817","reported_seq":1439,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.123346+0000","last_change":"2024-09-16T07:56:39.099974+0000","last_active":"2024-09-16T07:56:52.123346+0000","last_peered":"2024-09-16T07:56:52.123346+0000","last_clean":"2024-09-16T07:56:52.123346+0000","last_became_active":"2024-09-16T07:56:39.094850+0000","last_became_peered":"2024-09-16T07:56:39.094850+0000","last_unstale":"2024-09-16T07:56:52.123346+0000","last_undegraded":"2024-09-16T07:56:52.123346+0000","last_fullsized":"2024-09-16T07:56:52.123346+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"110'774","reported_seq":849,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.244861+0000","last_change":"2024-09-16T07:56:52.246248+0000","last_active":"2024-09-16T07:56:52.244861+0000","last_peered":"2024-09-16T07:56:52.244861+0000","last_clean":"2024-09-16T07:56:49.058981+0000","last_became_active":"2024-09-16T07:56:52.238011+0000","last_became_peered":"2024-09-16T07:56:52.238011+0000","last_unstale":"2024-09-16T07:56:52.244861+0000","last_undegraded":"2024-09-16T07:56:52.244861+0000","last_fullsized":"2024-09-16T07:56:52.244861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":379,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.140645+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:01.140645+0000","last_peered":"2024-09-16T07:57:01.140645+0000","last_clean":"2024-09-16T07:57:01.140645+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:01.140645+0000","last_undegraded":"2024-09-16T07:57:01.140645+0000","last_fullsized":"2024-09-16T07:57:01.140645+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":282,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:04.168624+0000","last_change":"2024-09-16T07:56:04.167227+0000","last_active":"2024-09-16T07:56:04.168624+0000","last_peered":"2024-09-16T07:56:04.168624+0000","last_clean":"2024-09-16T07:55:28.056115+0000","last_became_active":"2024-09-16T07:56:04.167227+0000","last_became_peered":"2024-09-16T07:56:04.167227+0000","last_unstale":"2024-09-16T07:56:50.042204+0000","last_undegraded":"2024-09-16T07:56:04.100204+0000","last_fullsized":"2024-09-16T07:56:04.098024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"126'908","reported_seq":1012,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:03.006212+0000","last_change":"2024-09-16T07:56:59.704605+0000","last_active":"2024-09-16T07:57:03.006212+0000","last_peered":"2024-09-16T07:57:03.006212+0000","last_clean":"2024-09-16T07:57:03.006212+0000","last_became_active":"2024-09-16T07:56:52.289647+0000","last_became_peered":"2024-09-16T07:56:52.289647+0000","last_unstale":"2024-09-16T07:57:03.006212+0000","last_undegraded":"2024-09-16T07:57:03.006212+0000","last_fullsized":"2024-09-16T07:57:03.006212+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.223011+0000","last_change":"2024-09-16T07:56:52.225705+0000","last_active":"2024-09-16T07:56:52.223011+0000","last_peered":"2024-09-16T07:56:52.223011+0000","last_clean":"2024-09-16T07:56:49.056656+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:56:52.223011+0000","last_undegraded":"2024-09-16T07:56:52.223011+0000","last_fullsized":"2024-09-16T07:56:52.223011+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"124'937","reported_seq":1213,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.860601+0000","last_change":"2024-09-16T07:56:39.095587+0000","last_active":"2024-09-16T07:56:58.860601+0000","last_peered":"2024-09-16T07:56:58.860601+0000","last_clean":"2024-09-16T07:56:58.860601+0000","last_became_active":"2024-09-16T07:56:39.090610+0000","last_became_peered":"2024-09-16T07:56:39.090610+0000","last_unstale":"2024-09-16T07:56:58.860601+0000","last_undegraded":"2024-09-16T07:56:58.860601+0000","last_fullsized":"2024-09-16T07:56:58.860601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":935,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.153952+0000","last_change":"2024-09-16T07:56:04.153196+0000","last_active":"2024-09-16T07:56:04.153952+0000","last_peered":"2024-09-16T07:56:04.153952+0000","last_clean":"2024-09-16T07:55:28.045293+0000","last_became_active":"2024-09-16T07:56:04.153196+0000","last_became_peered":"2024-09-16T07:56:04.153196+0000","last_unstale":"2024-09-16T07:56:50.042206+0000","last_undegraded":"2024-09-16T07:56:04.153952+0000","last_fullsized":"2024-09-16T07:56:04.074241+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"126'917","reported_seq":1014,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.634659+0000","last_change":"2024-09-16T07:56:52.223936+0000","last_active":"2024-09-16T07:57:02.634659+0000","last_peered":"2024-09-16T07:57:02.634659+0000","last_clean":"2024-09-16T07:57:02.634659+0000","last_became_active":"2024-09-16T07:56:52.218070+0000","last_became_peered":"2024-09-16T07:56:52.218070+0000","last_unstale":"2024-09-16T07:57:02.634659+0000","last_undegraded":"2024-09-16T07:57:02.634659+0000","last_fullsized":"2024-09-16T07:57:02.634659+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.259755+0000","last_change":"2024-09-16T07:56:52.263340+0000","last_active":"2024-09-16T07:56:52.259755+0000","last_peered":"2024-09-16T07:56:52.259755+0000","last_clean":"2024-09-16T07:56:49.060679+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:56:52.259755+0000","last_undegraded":"2024-09-16T07:56:52.259755+0000","last_fullsized":"2024-09-16T07:56:52.259755+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"124'947","reported_seq":1033,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.777426+0000","last_change":"2024-09-16T07:56:43.081255+0000","last_active":"2024-09-16T07:56:58.777426+0000","last_peered":"2024-09-16T07:56:58.777426+0000","last_clean":"2024-09-16T07:56:58.777426+0000","last_became_active":"2024-09-16T07:56:43.075222+0000","last_became_peered":"2024-09-16T07:56:43.075222+0000","last_unstale":"2024-09-16T07:56:58.777426+0000","last_undegraded":"2024-09-16T07:56:58.777426+0000","last_fullsized":"2024-09-16T07:56:58.777426+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":947,"log_dups_size":0,"ondisk_log_size":947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.091990+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:56:58.091990+0000","last_peered":"2024-09-16T07:56:58.091990+0000","last_clean":"2024-09-16T07:56:58.091990+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:56:58.091990+0000","last_undegraded":"2024-09-16T07:56:58.091990+0000","last_fullsized":"2024-09-16T07:56:58.091990+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"124'891","reported_seq":1461,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.871398+0000","last_change":"2024-09-16T07:56:52.457538+0000","last_active":"2024-09-16T07:56:58.871398+0000","last_peered":"2024-09-16T07:56:58.871398+0000","last_clean":"2024-09-16T07:55:36.614734+0000","last_became_active":"2024-09-16T07:56:52.224076+0000","last_became_peered":"2024-09-16T07:56:52.224076+0000","last_unstale":"2024-09-16T07:56:58.871398+0000","last_undegraded":"2024-09-16T07:56:58.871398+0000","last_fullsized":"2024-09-16T07:56:58.871398+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":37,"num_objects_missing":37,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":889,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":253,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":139}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.138533+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:01.138533+0000","last_peered":"2024-09-16T07:57:01.138533+0000","last_clean":"2024-09-16T07:57:01.138533+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:01.138533+0000","last_undegraded":"2024-09-16T07:57:01.138533+0000","last_fullsized":"2024-09-16T07:57:01.138533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"106'740","reported_seq":772,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.778896+0000","last_change":"2024-09-16T07:56:04.242962+0000","last_active":"2024-09-16T07:56:26.778896+0000","last_peered":"2024-09-16T07:56:26.778896+0000","last_clean":"2024-09-16T07:55:36.812189+0000","last_became_active":"2024-09-16T07:56:04.242962+0000","last_became_peered":"2024-09-16T07:56:04.242962+0000","last_unstale":"2024-09-16T07:56:50.042216+0000","last_undegraded":"2024-09-16T07:56:04.106106+0000","last_fullsized":"2024-09-16T07:56:04.103930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":236}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.089633+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:56:58.089633+0000","last_peered":"2024-09-16T07:56:58.089633+0000","last_clean":"2024-09-16T07:56:58.089633+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:56:58.089633+0000","last_undegraded":"2024-09-16T07:56:58.089633+0000","last_fullsized":"2024-09-16T07:56:58.089633+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"110'902","reported_seq":978,"reported_epoch":121,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T07:56:52.265701+0000","last_change":"2024-09-16T07:56:52.268058+0000","last_active":"2024-09-16T07:56:52.265701+0000","last_peered":"2024-09-16T07:56:52.265701+0000","last_clean":"2024-09-16T07:56:49.061054+0000","last_became_active":"2024-09-16T07:56:52.254107+0000","last_became_peered":"2024-09-16T07:56:52.254107+0000","last_unstale":"2024-09-16T07:56:52.265701+0000","last_undegraded":"2024-09-16T07:56:52.160213+0000","last_fullsized":"2024-09-16T07:56:52.265701+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","3"],"object_location_counts":[{"shards":"0,1,3","objects":203}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":275,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.168913+0000","last_change":"2024-09-16T07:56:04.168188+0000","last_active":"2024-09-16T07:56:04.168913+0000","last_peered":"2024-09-16T07:56:04.168913+0000","last_clean":"2024-09-16T07:55:28.056128+0000","last_became_active":"2024-09-16T07:56:04.168188+0000","last_became_peered":"2024-09-16T07:56:04.168188+0000","last_unstale":"2024-09-16T07:56:50.042218+0000","last_undegraded":"2024-09-16T07:56:04.168913+0000","last_fullsized":"2024-09-16T07:56:04.078402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":182976536,"num_objects":2793,"num_object_clones":0,"num_object_copies":8379,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":816,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13849,"num_write_kb":532481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2031,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38645760,"data_stored":618135624,"data_compressed":29352384,"data_compressed_allocated":38633472,"data_compressed_original":618135552,"omap_allocated":0,"internal_metadata":0},"log_size":13862,"ondisk_log_size":13862,"up":45,"acting":45,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":21,"acting":21,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35836,"kb_used_data":6188,"kb_used_omap":0,"kb_used_meta":29632,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":6336512,"data_stored":84576275,"data_compressed":3997841,"data_compressed_allocated":5263360,"data_compressed_original":84131840,"omap_allocated":0,"internal_metadata":30343168},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500702,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39732,"kb_used_data":10580,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":10833920,"data_stored":156790259,"data_compressed":7427264,"data_compressed_allocated":9777152,"data_compressed_original":156352512,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73004,"kb_used_data":14556,"kb_used_omap":0,"kb_used_meta":58432,"kb_avail":94298836,"statfs":{"total":96636764160,"available":96562008064,"internally_reserved":0,"allocated":14905344,"data_stored":224554674,"data_compressed":10646152,"data_compressed_allocated":14012416,"data_compressed_original":224198656,"omap_allocated":0,"internal_metadata":59834368},"hb_peers":[0,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48616,"kb_used_data":11608,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":11886592,"data_stored":173950627,"data_compressed":8242609,"data_compressed_allocated":10850304,"data_compressed_original":173522944,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10813440,"data_stored":172949528,"data_compressed":8212568,"data_compressed_allocated":10809344,"data_compressed_original":172949504,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13541376,"data_stored":216596504,"data_compressed":10285160,"data_compressed_allocated":13537280,"data_compressed_original":216596480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9474048,"data_stored":151584768,"data_compressed":7198056,"data_compressed_allocated":9474048,"data_compressed_original":151584768,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4816896,"data_stored":77004824,"data_compressed":3656600,"data_compressed_allocated":4812800,"data_compressed_original":77004800,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:15.477 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:57:15.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:15.617+0000 7f1b1bb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:15.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:15.623+0000 7f1b1bb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:17.510 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:17.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:17.634+0000 7f0967391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:17.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:17.643+0000 7f0967391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:17.723 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:57:17.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:17.833+0000 7f2c790a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:17.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:17.839+0000 7f2c790a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:17.849 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:17.850 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:17.865 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":486,"stamp":"2024-09-16T07:57:16.512070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":183566912,"num_objects":2797,"num_object_clones":0,"num_object_copies":8391,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":817,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13929,"num_write_kb":533588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2032,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13917,"ondisk_log_size":13917,"up":69,"acting":69,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":197188,"kb_used_data":42932,"kb_used_omap":0,"kb_used_meta":154176,"kb_avail":377290172,"statfs":{"total":386547056640,"available":386345136128,"internally_reserved":0,"allocated":43962368,"data_stored":639871835,"data_compressed":30313866,"data_compressed_allocated":39903232,"data_compressed_original":638205952,"omap_allocated":0,"internal_metadata":157876224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.065379"},"pg_stats":[{"pgid":"6.f","version":"124'910","reported_seq":1479,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.861866+0000","last_change":"2024-09-16T07:56:52.415843+0000","last_active":"2024-09-16T07:56:58.861866+0000","last_peered":"2024-09-16T07:56:58.861866+0000","last_clean":"2024-09-16T07:55:36.831185+0000","last_became_active":"2024-09-16T07:56:52.211353+0000","last_became_peered":"2024-09-16T07:56:52.211353+0000","last_unstale":"2024-09-16T07:56:58.861866+0000","last_undegraded":"2024-09-16T07:56:58.861866+0000","last_fullsized":"2024-09-16T07:56:58.861866+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":26,"num_objects_missing":26,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":154}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"106'822","reported_seq":863,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.713938+0000","last_change":"2024-09-16T07:56:04.234616+0000","last_active":"2024-09-16T07:56:26.713938+0000","last_peered":"2024-09-16T07:56:26.713938+0000","last_clean":"2024-09-16T07:55:36.894044+0000","last_became_active":"2024-09-16T07:56:04.234616+0000","last_became_peered":"2024-09-16T07:56:04.234616+0000","last_unstale":"2024-09-16T07:56:50.042195+0000","last_undegraded":"2024-09-16T07:56:04.095494+0000","last_fullsized":"2024-09-16T07:56:04.093963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":300}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"106'784","reported_seq":823,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-09-16T07:56:26.993304+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:56:26.993304+0000","last_peered":"2024-09-16T07:56:26.993304+0000","last_clean":"2024-09-16T07:56:26.993304+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:56:50.042197+0000","last_undegraded":"2024-09-16T07:56:26.993304+0000","last_fullsized":"2024-09-16T07:56:26.993304+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925272,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":784,"num_write_kb":32833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"126'954","reported_seq":1645,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.736259+0000","last_change":"2024-09-16T07:56:52.442416+0000","last_active":"2024-09-16T07:57:02.736259+0000","last_peered":"2024-09-16T07:57:02.736259+0000","last_clean":"2024-09-16T07:57:02.736259+0000","last_became_active":"2024-09-16T07:56:52.244859+0000","last_became_peered":"2024-09-16T07:56:52.244859+0000","last_unstale":"2024-09-16T07:57:02.736259+0000","last_undegraded":"2024-09-16T07:57:02.736259+0000","last_fullsized":"2024-09-16T07:57:02.736259+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":954,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"106'765","reported_seq":796,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.802068+0000","last_change":"2024-09-16T07:56:04.188084+0000","last_active":"2024-09-16T07:56:26.802068+0000","last_peered":"2024-09-16T07:56:26.802068+0000","last_clean":"2024-09-16T07:55:37.016460+0000","last_became_active":"2024-09-16T07:56:04.188084+0000","last_became_peered":"2024-09-16T07:56:04.188084+0000","last_unstale":"2024-09-16T07:56:50.042199+0000","last_undegraded":"2024-09-16T07:56:04.099920+0000","last_fullsized":"2024-09-16T07:56:04.098703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":279,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":279}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"124'836","reported_seq":907,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.763000+0000","last_change":"2024-09-16T07:56:52.236220+0000","last_active":"2024-09-16T07:56:58.763000+0000","last_peered":"2024-09-16T07:56:58.763000+0000","last_clean":"2024-09-16T07:56:58.763000+0000","last_became_active":"2024-09-16T07:56:52.210769+0000","last_became_peered":"2024-09-16T07:56:52.210769+0000","last_unstale":"2024-09-16T07:56:58.763000+0000","last_undegraded":"2024-09-16T07:56:58.763000+0000","last_fullsized":"2024-09-16T07:56:58.763000+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":31552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"126'958","reported_seq":1651,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.902907+0000","last_change":"2024-09-16T07:57:01.189928+0000","last_active":"2024-09-16T07:57:02.902907+0000","last_peered":"2024-09-16T07:57:02.902907+0000","last_clean":"2024-09-16T07:57:02.902907+0000","last_became_active":"2024-09-16T07:57:01.175598+0000","last_became_peered":"2024-09-16T07:57:01.175598+0000","last_unstale":"2024-09-16T07:57:02.902907+0000","last_undegraded":"2024-09-16T07:57:02.902907+0000","last_fullsized":"2024-09-16T07:57:02.902907+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"110'817","reported_seq":1439,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.123346+0000","last_change":"2024-09-16T07:56:39.099974+0000","last_active":"2024-09-16T07:56:52.123346+0000","last_peered":"2024-09-16T07:56:52.123346+0000","last_clean":"2024-09-16T07:56:52.123346+0000","last_became_active":"2024-09-16T07:56:39.094850+0000","last_became_peered":"2024-09-16T07:56:39.094850+0000","last_unstale":"2024-09-16T07:56:52.123346+0000","last_undegraded":"2024-09-16T07:56:52.123346+0000","last_fullsized":"2024-09-16T07:56:52.123346+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"110'774","reported_seq":849,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.244861+0000","last_change":"2024-09-16T07:56:52.246248+0000","last_active":"2024-09-16T07:56:52.244861+0000","last_peered":"2024-09-16T07:56:52.244861+0000","last_clean":"2024-09-16T07:56:49.058981+0000","last_became_active":"2024-09-16T07:56:52.238011+0000","last_became_peered":"2024-09-16T07:56:52.238011+0000","last_unstale":"2024-09-16T07:56:52.244861+0000","last_undegraded":"2024-09-16T07:56:52.244861+0000","last_fullsized":"2024-09-16T07:56:52.244861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":379,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.140645+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:01.140645+0000","last_peered":"2024-09-16T07:57:01.140645+0000","last_clean":"2024-09-16T07:57:01.140645+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:01.140645+0000","last_undegraded":"2024-09-16T07:57:01.140645+0000","last_fullsized":"2024-09-16T07:57:01.140645+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":282,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:04.168624+0000","last_change":"2024-09-16T07:56:04.167227+0000","last_active":"2024-09-16T07:56:04.168624+0000","last_peered":"2024-09-16T07:56:04.168624+0000","last_clean":"2024-09-16T07:55:28.056115+0000","last_became_active":"2024-09-16T07:56:04.167227+0000","last_became_peered":"2024-09-16T07:56:04.167227+0000","last_unstale":"2024-09-16T07:56:50.042204+0000","last_undegraded":"2024-09-16T07:56:04.100204+0000","last_fullsized":"2024-09-16T07:56:04.098024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"126'908","reported_seq":1012,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:03.006212+0000","last_change":"2024-09-16T07:56:59.704605+0000","last_active":"2024-09-16T07:57:03.006212+0000","last_peered":"2024-09-16T07:57:03.006212+0000","last_clean":"2024-09-16T07:57:03.006212+0000","last_became_active":"2024-09-16T07:56:52.289647+0000","last_became_peered":"2024-09-16T07:56:52.289647+0000","last_unstale":"2024-09-16T07:57:03.006212+0000","last_undegraded":"2024-09-16T07:57:03.006212+0000","last_fullsized":"2024-09-16T07:57:03.006212+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.223011+0000","last_change":"2024-09-16T07:56:52.225705+0000","last_active":"2024-09-16T07:56:52.223011+0000","last_peered":"2024-09-16T07:56:52.223011+0000","last_clean":"2024-09-16T07:56:49.056656+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:56:52.223011+0000","last_undegraded":"2024-09-16T07:56:52.223011+0000","last_fullsized":"2024-09-16T07:56:52.223011+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"124'937","reported_seq":1213,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.860601+0000","last_change":"2024-09-16T07:56:39.095587+0000","last_active":"2024-09-16T07:56:58.860601+0000","last_peered":"2024-09-16T07:56:58.860601+0000","last_clean":"2024-09-16T07:56:58.860601+0000","last_became_active":"2024-09-16T07:56:39.090610+0000","last_became_peered":"2024-09-16T07:56:39.090610+0000","last_unstale":"2024-09-16T07:56:58.860601+0000","last_undegraded":"2024-09-16T07:56:58.860601+0000","last_fullsized":"2024-09-16T07:56:58.860601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":935,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.153952+0000","last_change":"2024-09-16T07:56:04.153196+0000","last_active":"2024-09-16T07:56:04.153952+0000","last_peered":"2024-09-16T07:56:04.153952+0000","last_clean":"2024-09-16T07:55:28.045293+0000","last_became_active":"2024-09-16T07:56:04.153196+0000","last_became_peered":"2024-09-16T07:56:04.153196+0000","last_unstale":"2024-09-16T07:56:50.042206+0000","last_undegraded":"2024-09-16T07:56:04.153952+0000","last_fullsized":"2024-09-16T07:56:04.074241+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"126'917","reported_seq":1014,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.634659+0000","last_change":"2024-09-16T07:56:52.223936+0000","last_active":"2024-09-16T07:57:02.634659+0000","last_peered":"2024-09-16T07:57:02.634659+0000","last_clean":"2024-09-16T07:57:02.634659+0000","last_became_active":"2024-09-16T07:56:52.218070+0000","last_became_peered":"2024-09-16T07:56:52.218070+0000","last_unstale":"2024-09-16T07:57:02.634659+0000","last_undegraded":"2024-09-16T07:57:02.634659+0000","last_fullsized":"2024-09-16T07:57:02.634659+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.259755+0000","last_change":"2024-09-16T07:56:52.263340+0000","last_active":"2024-09-16T07:56:52.259755+0000","last_peered":"2024-09-16T07:56:52.259755+0000","last_clean":"2024-09-16T07:56:49.060679+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:56:52.259755+0000","last_undegraded":"2024-09-16T07:56:52.259755+0000","last_fullsized":"2024-09-16T07:56:52.259755+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"124'947","reported_seq":1033,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.777426+0000","last_change":"2024-09-16T07:56:43.081255+0000","last_active":"2024-09-16T07:56:58.777426+0000","last_peered":"2024-09-16T07:56:58.777426+0000","last_clean":"2024-09-16T07:56:58.777426+0000","last_became_active":"2024-09-16T07:56:43.075222+0000","last_became_peered":"2024-09-16T07:56:43.075222+0000","last_unstale":"2024-09-16T07:56:58.777426+0000","last_undegraded":"2024-09-16T07:56:58.777426+0000","last_fullsized":"2024-09-16T07:56:58.777426+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":947,"log_dups_size":0,"ondisk_log_size":947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.091990+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:56:58.091990+0000","last_peered":"2024-09-16T07:56:58.091990+0000","last_clean":"2024-09-16T07:56:58.091990+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:56:58.091990+0000","last_undegraded":"2024-09-16T07:56:58.091990+0000","last_fullsized":"2024-09-16T07:56:58.091990+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"124'891","reported_seq":1461,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.871398+0000","last_change":"2024-09-16T07:56:52.457538+0000","last_active":"2024-09-16T07:56:58.871398+0000","last_peered":"2024-09-16T07:56:58.871398+0000","last_clean":"2024-09-16T07:55:36.614734+0000","last_became_active":"2024-09-16T07:56:52.224076+0000","last_became_peered":"2024-09-16T07:56:52.224076+0000","last_unstale":"2024-09-16T07:56:58.871398+0000","last_undegraded":"2024-09-16T07:56:58.871398+0000","last_fullsized":"2024-09-16T07:56:58.871398+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":37,"num_objects_missing":37,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":889,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":253,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":139}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.138533+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:01.138533+0000","last_peered":"2024-09-16T07:57:01.138533+0000","last_clean":"2024-09-16T07:57:01.138533+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:01.138533+0000","last_undegraded":"2024-09-16T07:57:01.138533+0000","last_fullsized":"2024-09-16T07:57:01.138533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"106'740","reported_seq":772,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.778896+0000","last_change":"2024-09-16T07:56:04.242962+0000","last_active":"2024-09-16T07:56:26.778896+0000","last_peered":"2024-09-16T07:56:26.778896+0000","last_clean":"2024-09-16T07:55:36.812189+0000","last_became_active":"2024-09-16T07:56:04.242962+0000","last_became_peered":"2024-09-16T07:56:04.242962+0000","last_unstale":"2024-09-16T07:56:50.042216+0000","last_undegraded":"2024-09-16T07:56:04.106106+0000","last_fullsized":"2024-09-16T07:56:04.103930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":236}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.089633+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:56:58.089633+0000","last_peered":"2024-09-16T07:56:58.089633+0000","last_clean":"2024-09-16T07:56:58.089633+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:56:58.089633+0000","last_undegraded":"2024-09-16T07:56:58.089633+0000","last_fullsized":"2024-09-16T07:56:58.089633+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"110'902","reported_seq":978,"reported_epoch":121,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T07:56:52.265701+0000","last_change":"2024-09-16T07:56:52.268058+0000","last_active":"2024-09-16T07:56:52.265701+0000","last_peered":"2024-09-16T07:56:52.265701+0000","last_clean":"2024-09-16T07:56:49.061054+0000","last_became_active":"2024-09-16T07:56:52.254107+0000","last_became_peered":"2024-09-16T07:56:52.254107+0000","last_unstale":"2024-09-16T07:56:52.265701+0000","last_undegraded":"2024-09-16T07:56:52.160213+0000","last_fullsized":"2024-09-16T07:56:52.265701+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","3"],"object_location_counts":[{"shards":"0,1,3","objects":203}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":275,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.168913+0000","last_change":"2024-09-16T07:56:04.168188+0000","last_active":"2024-09-16T07:56:04.168913+0000","last_peered":"2024-09-16T07:56:04.168913+0000","last_clean":"2024-09-16T07:55:28.056128+0000","last_became_active":"2024-09-16T07:56:04.168188+0000","last_became_peered":"2024-09-16T07:56:04.168188+0000","last_unstale":"2024-09-16T07:56:50.042218+0000","last_undegraded":"2024-09-16T07:56:04.168913+0000","last_fullsized":"2024-09-16T07:56:04.078402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":182976536,"num_objects":2793,"num_object_clones":0,"num_object_copies":8379,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":816,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13849,"num_write_kb":532481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2031,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38645760,"data_stored":618135624,"data_compressed":29352384,"data_compressed_allocated":38633472,"data_compressed_original":618135552,"omap_allocated":0,"internal_metadata":0},"log_size":13862,"ondisk_log_size":13862,"up":45,"acting":45,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":21,"acting":21,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35836,"kb_used_data":6188,"kb_used_omap":0,"kb_used_meta":29632,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":6336512,"data_stored":84576275,"data_compressed":3997841,"data_compressed_allocated":5263360,"data_compressed_original":84131840,"omap_allocated":0,"internal_metadata":30343168},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500702,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39732,"kb_used_data":10580,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":10833920,"data_stored":156790259,"data_compressed":7427264,"data_compressed_allocated":9777152,"data_compressed_original":156352512,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73004,"kb_used_data":14556,"kb_used_omap":0,"kb_used_meta":58432,"kb_avail":94298836,"statfs":{"total":96636764160,"available":96562008064,"internally_reserved":0,"allocated":14905344,"data_stored":224554674,"data_compressed":10646152,"data_compressed_allocated":14012416,"data_compressed_original":224198656,"omap_allocated":0,"internal_metadata":59834368},"hb_peers":[0,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48616,"kb_used_data":11608,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":11886592,"data_stored":173950627,"data_compressed":8242609,"data_compressed_allocated":10850304,"data_compressed_original":173522944,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10813440,"data_stored":172949528,"data_compressed":8212568,"data_compressed_allocated":10809344,"data_compressed_original":172949504,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13541376,"data_stored":216596504,"data_compressed":10285160,"data_compressed_allocated":13537280,"data_compressed_original":216596480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9474048,"data_stored":151584768,"data_compressed":7198056,"data_compressed_allocated":9474048,"data_compressed_original":151584768,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4816896,"data_stored":77004824,"data_compressed":3656600,"data_compressed_allocated":4812800,"data_compressed_original":77004800,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:17.867 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:57:17.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:17.981+0000 7f75f969c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:17.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:17.988+0000 7f75f969c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:18.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:18.256 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 817/8391 objects degraded (9.737%), 5 pgs degraded, 6 pgs undersized","count":11},"muted":false}},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":740,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":128,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473411,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":15},{"state_name":"stale+active+undersized+degraded","count":4},{"state_name":"active+recovering","count":2},{"state_name":"stale+active+undersized","count":2},{"state_name":"active+recovery_wait+degraded","count":1},{"state_name":"stale+active+clean","count":1}],"num_pgs":25,"num_pools":3,"num_objects":2797,"data_bytes":183566912,"bytes_used":201920512,"bytes_avail":386345136128,"bytes_total":386547056640,"degraded_objects":817,"degraded_total":8391,"degraded_ratio":0.097366225718031205},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:57:18.269 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:57:18.269 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:18.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:18.420+0000 7fc2a5c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:18.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:18.428+0000 7fc2a5c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:18.624 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:18.625 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:18.637 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2024-09-16T07:57:18.449143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":183566912,"num_objects":2797,"num_object_clones":0,"num_object_copies":8391,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":817,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13929,"num_write_kb":533588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2032,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13917,"ondisk_log_size":13917,"up":69,"acting":69,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":197188,"kb_used_data":42932,"kb_used_omap":0,"kb_used_meta":154176,"kb_avail":377290172,"statfs":{"total":386547056640,"available":386345136128,"internally_reserved":0,"allocated":43962368,"data_stored":639871835,"data_compressed":30313866,"data_compressed_allocated":39903232,"data_compressed_original":638205952,"omap_allocated":0,"internal_metadata":157876224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002015"},"pg_stats":[{"pgid":"6.f","version":"124'910","reported_seq":1479,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.861866+0000","last_change":"2024-09-16T07:56:52.415843+0000","last_active":"2024-09-16T07:56:58.861866+0000","last_peered":"2024-09-16T07:56:58.861866+0000","last_clean":"2024-09-16T07:55:36.831185+0000","last_became_active":"2024-09-16T07:56:52.211353+0000","last_became_peered":"2024-09-16T07:56:52.211353+0000","last_unstale":"2024-09-16T07:56:58.861866+0000","last_undegraded":"2024-09-16T07:56:58.861866+0000","last_fullsized":"2024-09-16T07:56:58.861866+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10092544,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":26,"num_objects_missing":26,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":154}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"106'822","reported_seq":863,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.713938+0000","last_change":"2024-09-16T07:56:04.234616+0000","last_active":"2024-09-16T07:56:26.713938+0000","last_peered":"2024-09-16T07:56:26.713938+0000","last_clean":"2024-09-16T07:55:36.894044+0000","last_became_active":"2024-09-16T07:56:04.234616+0000","last_became_peered":"2024-09-16T07:56:04.234616+0000","last_unstale":"2024-09-16T07:56:50.042195+0000","last_undegraded":"2024-09-16T07:56:04.095494+0000","last_fullsized":"2024-09-16T07:56:04.093963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":300,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":300}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"106'784","reported_seq":823,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-09-16T07:56:26.993304+0000","last_change":"2024-09-16T07:55:24.540185+0000","last_active":"2024-09-16T07:56:26.993304+0000","last_peered":"2024-09-16T07:56:26.993304+0000","last_clean":"2024-09-16T07:56:26.993304+0000","last_became_active":"2024-09-16T07:55:24.195785+0000","last_became_peered":"2024-09-16T07:55:24.195785+0000","last_unstale":"2024-09-16T07:56:50.042197+0000","last_undegraded":"2024-09-16T07:56:26.993304+0000","last_fullsized":"2024-09-16T07:56:26.993304+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925272,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":784,"num_write_kb":32833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"126'954","reported_seq":1645,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.736259+0000","last_change":"2024-09-16T07:56:52.442416+0000","last_active":"2024-09-16T07:57:02.736259+0000","last_peered":"2024-09-16T07:57:02.736259+0000","last_clean":"2024-09-16T07:57:02.736259+0000","last_became_active":"2024-09-16T07:56:52.244859+0000","last_became_peered":"2024-09-16T07:56:52.244859+0000","last_unstale":"2024-09-16T07:57:02.736259+0000","last_undegraded":"2024-09-16T07:57:02.736259+0000","last_fullsized":"2024-09-16T07:57:02.736259+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":954,"log_dups_size":0,"ondisk_log_size":954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":954,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"106'765","reported_seq":796,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.802068+0000","last_change":"2024-09-16T07:56:04.188084+0000","last_active":"2024-09-16T07:56:26.802068+0000","last_peered":"2024-09-16T07:56:26.802068+0000","last_clean":"2024-09-16T07:55:37.016460+0000","last_became_active":"2024-09-16T07:56:04.188084+0000","last_became_peered":"2024-09-16T07:56:04.188084+0000","last_unstale":"2024-09-16T07:56:50.042199+0000","last_undegraded":"2024-09-16T07:56:04.099920+0000","last_fullsized":"2024-09-16T07:56:04.098703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":279,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":33408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":279}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"124'836","reported_seq":907,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.763000+0000","last_change":"2024-09-16T07:56:52.236220+0000","last_active":"2024-09-16T07:56:58.763000+0000","last_peered":"2024-09-16T07:56:58.763000+0000","last_clean":"2024-09-16T07:56:58.763000+0000","last_became_active":"2024-09-16T07:56:52.210769+0000","last_became_peered":"2024-09-16T07:56:52.210769+0000","last_unstale":"2024-09-16T07:56:58.763000+0000","last_undegraded":"2024-09-16T07:56:58.763000+0000","last_fullsized":"2024-09-16T07:56:58.763000+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9961472,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":31552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"126'958","reported_seq":1651,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.902907+0000","last_change":"2024-09-16T07:57:01.189928+0000","last_active":"2024-09-16T07:57:02.902907+0000","last_peered":"2024-09-16T07:57:02.902907+0000","last_clean":"2024-09-16T07:57:02.902907+0000","last_became_active":"2024-09-16T07:57:01.175598+0000","last_became_peered":"2024-09-16T07:57:01.175598+0000","last_unstale":"2024-09-16T07:57:02.902907+0000","last_undegraded":"2024-09-16T07:57:02.902907+0000","last_fullsized":"2024-09-16T07:57:02.902907+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":958,"log_dups_size":0,"ondisk_log_size":958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":958,"num_write_kb":33536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"110'817","reported_seq":1439,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.123346+0000","last_change":"2024-09-16T07:56:39.099974+0000","last_active":"2024-09-16T07:56:52.123346+0000","last_peered":"2024-09-16T07:56:52.123346+0000","last_clean":"2024-09-16T07:56:52.123346+0000","last_became_active":"2024-09-16T07:56:39.094850+0000","last_became_peered":"2024-09-16T07:56:39.094850+0000","last_unstale":"2024-09-16T07:56:52.123346+0000","last_undegraded":"2024-09-16T07:56:52.123346+0000","last_fullsized":"2024-09-16T07:56:52.123346+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":269,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"110'774","reported_seq":849,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.244861+0000","last_change":"2024-09-16T07:56:52.246248+0000","last_active":"2024-09-16T07:56:52.244861+0000","last_peered":"2024-09-16T07:56:52.244861+0000","last_clean":"2024-09-16T07:56:49.058981+0000","last_became_active":"2024-09-16T07:56:52.238011+0000","last_became_peered":"2024-09-16T07:56:52.238011+0000","last_unstale":"2024-09-16T07:56:52.244861+0000","last_undegraded":"2024-09-16T07:56:52.244861+0000","last_fullsized":"2024-09-16T07:56:52.244861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":379,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.140645+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:01.140645+0000","last_peered":"2024-09-16T07:57:01.140645+0000","last_clean":"2024-09-16T07:57:01.140645+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:01.140645+0000","last_undegraded":"2024-09-16T07:57:01.140645+0000","last_fullsized":"2024-09-16T07:57:01.140645+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":282,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:04.168624+0000","last_change":"2024-09-16T07:56:04.167227+0000","last_active":"2024-09-16T07:56:04.168624+0000","last_peered":"2024-09-16T07:56:04.168624+0000","last_clean":"2024-09-16T07:55:28.056115+0000","last_became_active":"2024-09-16T07:56:04.167227+0000","last_became_peered":"2024-09-16T07:56:04.167227+0000","last_unstale":"2024-09-16T07:56:50.042204+0000","last_undegraded":"2024-09-16T07:56:04.100204+0000","last_fullsized":"2024-09-16T07:56:04.098024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"126'908","reported_seq":1012,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:03.006212+0000","last_change":"2024-09-16T07:56:59.704605+0000","last_active":"2024-09-16T07:57:03.006212+0000","last_peered":"2024-09-16T07:57:03.006212+0000","last_clean":"2024-09-16T07:57:03.006212+0000","last_became_active":"2024-09-16T07:56:52.289647+0000","last_became_peered":"2024-09-16T07:56:52.289647+0000","last_unstale":"2024-09-16T07:57:03.006212+0000","last_undegraded":"2024-09-16T07:57:03.006212+0000","last_fullsized":"2024-09-16T07:57:03.006212+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":32256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":196608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.223011+0000","last_change":"2024-09-16T07:56:52.225705+0000","last_active":"2024-09-16T07:56:52.223011+0000","last_peered":"2024-09-16T07:56:52.223011+0000","last_clean":"2024-09-16T07:56:49.056656+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:56:52.223011+0000","last_undegraded":"2024-09-16T07:56:52.223011+0000","last_fullsized":"2024-09-16T07:56:52.223011+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"124'937","reported_seq":1213,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.860601+0000","last_change":"2024-09-16T07:56:39.095587+0000","last_active":"2024-09-16T07:56:58.860601+0000","last_peered":"2024-09-16T07:56:58.860601+0000","last_clean":"2024-09-16T07:56:58.860601+0000","last_became_active":"2024-09-16T07:56:39.090610+0000","last_became_peered":"2024-09-16T07:56:39.090610+0000","last_unstale":"2024-09-16T07:56:58.860601+0000","last_undegraded":"2024-09-16T07:56:58.860601+0000","last_fullsized":"2024-09-16T07:56:58.860601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":937,"log_dups_size":0,"ondisk_log_size":937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":935,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":90,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":263,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.153952+0000","last_change":"2024-09-16T07:56:04.153196+0000","last_active":"2024-09-16T07:56:04.153952+0000","last_peered":"2024-09-16T07:56:04.153952+0000","last_clean":"2024-09-16T07:55:28.045293+0000","last_became_active":"2024-09-16T07:56:04.153196+0000","last_became_peered":"2024-09-16T07:56:04.153196+0000","last_unstale":"2024-09-16T07:56:50.042206+0000","last_undegraded":"2024-09-16T07:56:04.153952+0000","last_fullsized":"2024-09-16T07:56:04.074241+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"126'917","reported_seq":1014,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:02.634659+0000","last_change":"2024-09-16T07:56:52.223936+0000","last_active":"2024-09-16T07:57:02.634659+0000","last_peered":"2024-09-16T07:57:02.634659+0000","last_clean":"2024-09-16T07:57:02.634659+0000","last_became_active":"2024-09-16T07:56:52.218070+0000","last_became_peered":"2024-09-16T07:56:52.218070+0000","last_unstale":"2024-09-16T07:57:02.634659+0000","last_undegraded":"2024-09-16T07:57:02.634659+0000","last_fullsized":"2024-09-16T07:57:02.634659+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":917,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.259755+0000","last_change":"2024-09-16T07:56:52.263340+0000","last_active":"2024-09-16T07:56:52.259755+0000","last_peered":"2024-09-16T07:56:52.259755+0000","last_clean":"2024-09-16T07:56:49.060679+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:56:52.259755+0000","last_undegraded":"2024-09-16T07:56:52.259755+0000","last_fullsized":"2024-09-16T07:56:52.259755+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"124'947","reported_seq":1033,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.777426+0000","last_change":"2024-09-16T07:56:43.081255+0000","last_active":"2024-09-16T07:56:58.777426+0000","last_peered":"2024-09-16T07:56:58.777426+0000","last_clean":"2024-09-16T07:56:58.777426+0000","last_became_active":"2024-09-16T07:56:43.075222+0000","last_became_peered":"2024-09-16T07:56:43.075222+0000","last_unstale":"2024-09-16T07:56:58.777426+0000","last_undegraded":"2024-09-16T07:56:58.777426+0000","last_fullsized":"2024-09-16T07:56:58.777426+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":947,"log_dups_size":0,"ondisk_log_size":947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9895936,"num_objects":151,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":305,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.091990+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:56:58.091990+0000","last_peered":"2024-09-16T07:56:58.091990+0000","last_clean":"2024-09-16T07:56:58.091990+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:56:58.091990+0000","last_undegraded":"2024-09-16T07:56:58.091990+0000","last_fullsized":"2024-09-16T07:56:58.091990+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"124'891","reported_seq":1461,"reported_epoch":124,"state":"active+recovering","last_fresh":"2024-09-16T07:56:58.871398+0000","last_change":"2024-09-16T07:56:52.457538+0000","last_active":"2024-09-16T07:56:58.871398+0000","last_peered":"2024-09-16T07:56:58.871398+0000","last_clean":"2024-09-16T07:55:36.614734+0000","last_became_active":"2024-09-16T07:56:52.224076+0000","last_became_peered":"2024-09-16T07:56:52.224076+0000","last_unstale":"2024-09-16T07:56:58.871398+0000","last_undegraded":"2024-09-16T07:56:58.871398+0000","last_fullsized":"2024-09-16T07:56:58.871398+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":37,"num_objects_missing":37,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":889,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":253,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1,2","objects":139}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.138533+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:01.138533+0000","last_peered":"2024-09-16T07:57:01.138533+0000","last_clean":"2024-09-16T07:57:01.138533+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:01.138533+0000","last_undegraded":"2024-09-16T07:57:01.138533+0000","last_fullsized":"2024-09-16T07:57:01.138533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"106'740","reported_seq":772,"reported_epoch":106,"state":"stale+active+undersized+degraded","last_fresh":"2024-09-16T07:56:26.778896+0000","last_change":"2024-09-16T07:56:04.242962+0000","last_active":"2024-09-16T07:56:26.778896+0000","last_peered":"2024-09-16T07:56:26.778896+0000","last_clean":"2024-09-16T07:55:36.812189+0000","last_became_active":"2024-09-16T07:56:04.242962+0000","last_became_peered":"2024-09-16T07:56:04.242962+0000","last_unstale":"2024-09-16T07:56:50.042216+0000","last_undegraded":"2024-09-16T07:56:04.106106+0000","last_fullsized":"2024-09-16T07:56:04.103930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":236,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[{"shards":"0,1","objects":236}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.089633+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:56:58.089633+0000","last_peered":"2024-09-16T07:56:58.089633+0000","last_clean":"2024-09-16T07:56:58.089633+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:56:58.089633+0000","last_undegraded":"2024-09-16T07:56:58.089633+0000","last_fullsized":"2024-09-16T07:56:58.089633+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"110'902","reported_seq":978,"reported_epoch":121,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T07:56:52.265701+0000","last_change":"2024-09-16T07:56:52.268058+0000","last_active":"2024-09-16T07:56:52.265701+0000","last_peered":"2024-09-16T07:56:52.265701+0000","last_clean":"2024-09-16T07:56:49.061054+0000","last_became_active":"2024-09-16T07:56:52.254107+0000","last_became_peered":"2024-09-16T07:56:52.254107+0000","last_unstale":"2024-09-16T07:56:52.265701+0000","last_undegraded":"2024-09-16T07:56:52.160213+0000","last_fullsized":"2024-09-16T07:56:52.265701+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:26.065928+0000","last_clean_scrub_stamp":"2024-09-16T07:54:26.065928+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13303808,"num_objects":203,"num_object_clones":0,"num_object_copies":609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","3"],"object_location_counts":[{"shards":"0,1,3","objects":203}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":275,"reported_epoch":106,"state":"stale+active+undersized","last_fresh":"2024-09-16T07:56:04.168913+0000","last_change":"2024-09-16T07:56:04.168188+0000","last_active":"2024-09-16T07:56:04.168913+0000","last_peered":"2024-09-16T07:56:04.168913+0000","last_clean":"2024-09-16T07:55:28.056128+0000","last_became_active":"2024-09-16T07:56:04.168188+0000","last_became_peered":"2024-09-16T07:56:04.168188+0000","last_unstale":"2024-09-16T07:56:50.042218+0000","last_undegraded":"2024-09-16T07:56:04.168913+0000","last_fullsized":"2024-09-16T07:56:04.078402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":182976536,"num_objects":2793,"num_object_clones":0,"num_object_copies":8379,"num_objects_missing_on_primary":63,"num_objects_missing":63,"num_objects_degraded":816,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13849,"num_write_kb":532481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2031,"num_bytes_recovered":1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38645760,"data_stored":618135624,"data_compressed":29352384,"data_compressed_allocated":38633472,"data_compressed_original":618135552,"omap_allocated":0,"internal_metadata":0},"log_size":13862,"ondisk_log_size":13862,"up":45,"acting":45,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":21,"acting":21,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35836,"kb_used_data":6188,"kb_used_omap":0,"kb_used_meta":29632,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":6336512,"data_stored":84576275,"data_compressed":3997841,"data_compressed_allocated":5263360,"data_compressed_original":84131840,"omap_allocated":0,"internal_metadata":30343168},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500702,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39732,"kb_used_data":10580,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":10833920,"data_stored":156790259,"data_compressed":7427264,"data_compressed_allocated":9777152,"data_compressed_original":156352512,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":73,"seq":313532612876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73004,"kb_used_data":14556,"kb_used_omap":0,"kb_used_meta":58432,"kb_avail":94298836,"statfs":{"total":96636764160,"available":96562008064,"internally_reserved":0,"allocated":14905344,"data_stored":224554674,"data_compressed":10646152,"data_compressed_allocated":14012416,"data_compressed_original":224198656,"omap_allocated":0,"internal_metadata":59834368},"hb_peers":[0,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48616,"kb_used_data":11608,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":11886592,"data_stored":173950627,"data_compressed":8242609,"data_compressed_allocated":10850304,"data_compressed_original":173522944,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10813440,"data_stored":172949528,"data_compressed":8212568,"data_compressed_allocated":10809344,"data_compressed_original":172949504,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13541376,"data_stored":216596504,"data_compressed":10285160,"data_compressed_allocated":13537280,"data_compressed_original":216596480,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9474048,"data_stored":151584768,"data_compressed":7198056,"data_compressed_allocated":9474048,"data_compressed_original":151584768,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4816896,"data_stored":77004824,"data_compressed":3656600,"data_compressed_allocated":4812800,"data_compressed_original":77004800,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:18.937 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_3 2024-09-16T07:57:18.938 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2024-09-16T07:57:19.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:19.051+0000 7f3923288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:19.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:19.065+0000 7f3923288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:19.518 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'unique_pool_3' removed 2024-09-16T07:57:19.539 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T07:57:19.540 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T07:57:19.540 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_4 2024-09-16T07:57:19.540 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_4 16 2024-09-16T07:57:19.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:19.687+0000 7f38b98fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:19.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:19.704+0000 7f38b98fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:19.949 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:57:20.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:20.059+0000 7fd207991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:20.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:20.066+0000 7fd207991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:20.522 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'unique_pool_4' created 2024-09-16T07:57:20.546 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2024-09-16T07:57:20.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:20.677+0000 7f91f5a7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:20.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:20.691+0000 7f91f5a7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:21.526 INFO:teuthology.orchestra.run.smithi003.stderr:enabled application 'rados' on pool 'unique_pool_4' 2024-09-16T07:57:21.640 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:21.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:21.783+0000 7efe53093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:21.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:21.794+0000 7efe53093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:21.992 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:22.042 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:22.043 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":491,"stamp":"2024-09-16T07:57:21.528981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":166524,"kb_used_data":29420,"kb_used_omap":0,"kb_used_meta":137024,"kb_avail":377320836,"statfs":{"total":386547056640,"available":386376536064,"internally_reserved":0,"allocated":30126080,"data_stored":415751288,"data_compressed":19667714,"data_compressed_allocated":25890816,"data_compressed_original":414007296,"omap_allocated":0,"internal_metadata":140312576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-182976536,"num_objects":-2793,"num_object_clones":0,"num_object_copies":-8379,"num_objects_missing_on_primary":-63,"num_objects_missing":-63,"num_objects_degraded":-817,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-13849,"num_write_kb":-532481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2031,"num_bytes_recovered":-1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.080346"},"pg_stats":[{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":379,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.140645+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:01.140645+0000","last_peered":"2024-09-16T07:57:01.140645+0000","last_clean":"2024-09-16T07:57:01.140645+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:01.140645+0000","last_undegraded":"2024-09-16T07:57:01.140645+0000","last_fullsized":"2024-09-16T07:57:01.140645+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":325,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.542967+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:19.542967+0000","last_peered":"2024-09-16T07:57:19.542967+0000","last_clean":"2024-09-16T07:57:19.542967+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:19.542967+0000","last_undegraded":"2024-09-16T07:57:19.542967+0000","last_fullsized":"2024-09-16T07:57:19.542967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.223011+0000","last_change":"2024-09-16T07:56:52.225705+0000","last_active":"2024-09-16T07:56:52.223011+0000","last_peered":"2024-09-16T07:56:52.223011+0000","last_clean":"2024-09-16T07:56:49.056656+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:56:52.223011+0000","last_undegraded":"2024-09-16T07:56:52.223011+0000","last_fullsized":"2024-09-16T07:56:52.223011+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":306,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.586957+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:19.586957+0000","last_peered":"2024-09-16T07:57:19.586957+0000","last_clean":"2024-09-16T07:57:19.586957+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:19.586957+0000","last_undegraded":"2024-09-16T07:57:19.586957+0000","last_fullsized":"2024-09-16T07:57:19.586957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":192,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-16T07:56:52.259755+0000","last_change":"2024-09-16T07:56:52.263340+0000","last_active":"2024-09-16T07:56:52.259755+0000","last_peered":"2024-09-16T07:56:52.259755+0000","last_clean":"2024-09-16T07:56:49.060679+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:56:52.259755+0000","last_undegraded":"2024-09-16T07:56:52.259755+0000","last_fullsized":"2024-09-16T07:56:52.259755+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.091990+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:56:58.091990+0000","last_peered":"2024-09-16T07:56:58.091990+0000","last_clean":"2024-09-16T07:56:58.091990+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:56:58.091990+0000","last_undegraded":"2024-09-16T07:56:58.091990+0000","last_fullsized":"2024-09-16T07:56:58.091990+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.138533+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:01.138533+0000","last_peered":"2024-09-16T07:57:01.138533+0000","last_clean":"2024-09-16T07:57:01.138533+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:01.138533+0000","last_undegraded":"2024-09-16T07:57:01.138533+0000","last_fullsized":"2024-09-16T07:57:01.138533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.089633+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:56:58.089633+0000","last_peered":"2024-09-16T07:56:58.089633+0000","last_clean":"2024-09-16T07:56:58.089633+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:56:58.089633+0000","last_undegraded":"2024-09-16T07:56:58.089633+0000","last_fullsized":"2024-09-16T07:56:58.089633+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":318,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.556141+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:19.556141+0000","last_peered":"2024-09-16T07:57:19.556141+0000","last_clean":"2024-09-16T07:57:19.556141+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:19.556141+0000","last_undegraded":"2024-09-16T07:57:19.556141+0000","last_fullsized":"2024-09-16T07:57:19.556141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35836,"kb_used_data":6188,"kb_used_omap":0,"kb_used_meta":29632,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":6336512,"data_stored":84576275,"data_compressed":3997841,"data_compressed_allocated":5263360,"data_compressed_original":84131840,"omap_allocated":0,"internal_metadata":30343168},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500702,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39732,"kb_used_data":10580,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":10833920,"data_stored":156790259,"data_compressed":7427264,"data_compressed_allocated":9777152,"data_compressed_original":156352512,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42340,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":1069056,"data_stored":434127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664281,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48616,"kb_used_data":11608,"kb_used_omap":0,"kb_used_meta":36992,"kb_avail":94323224,"statfs":{"total":96636764160,"available":96586981376,"internally_reserved":0,"allocated":11886592,"data_stored":173950627,"data_compressed":8242609,"data_compressed_allocated":10850304,"data_compressed_original":173522944,"omap_allocated":0,"internal_metadata":37879808},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:22.045 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:57:22.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:22.155+0000 7fd777791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:22.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:22.163+0000 7fd777791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:22.165 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:57:22.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:22.275+0000 7f88f4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:22.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:22.281+0000 7f88f4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:22.439 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:22.440 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":744,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":131,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473411,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":9}],"num_pgs":9,"num_pools":2,"num_objects":4,"data_bytes":590376,"bytes_used":170520576,"bytes_avail":386376536064,"bytes_total":386547056640},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:57:22.454 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:57:22.454 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:22.553 DEBUG:teuthology.orchestra.run.smithi003:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_4 bench 90 write' 2024-09-16T07:57:22.556 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T07:57:22.556 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T07:57:22.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:22.576+0000 7f3b3eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:22.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:22.585+0000 7f3b3eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:22.622 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:hints = 1 2024-09-16T07:57:22.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T07:57:22.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Object prefix: benchmark_data_smithi003_49564 2024-09-16T07:57:22.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:57:22.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 0 0 0 0 0 0 - 0 2024-09-16T07:57:22.860 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:22.860 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:22.878 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":493,"stamp":"2024-09-16T07:57:22.532449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":147728,"kb_used_data":18944,"kb_used_omap":0,"kb_used_meta":128704,"kb_avail":377339632,"statfs":{"total":386547056640,"available":386395783168,"internally_reserved":0,"allocated":19398656,"data_stored":242835745,"data_compressed":11455146,"data_compressed_allocated":15081472,"data_compressed_original":241057792,"omap_allocated":0,"internal_metadata":131792896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-182976536,"num_objects":-2793,"num_object_clones":0,"num_object_copies":-8379,"num_objects_missing_on_primary":-63,"num_objects_missing":-63,"num_objects_degraded":-817,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-13849,"num_write_kb":-532481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2031,"num_bytes_recovered":-1572864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.083305"},"pg_stats":[{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":379,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.140645+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:01.140645+0000","last_peered":"2024-09-16T07:57:01.140645+0000","last_clean":"2024-09-16T07:57:01.140645+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:01.140645+0000","last_undegraded":"2024-09-16T07:57:01.140645+0000","last_fullsized":"2024-09-16T07:57:01.140645+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":325,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.542967+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:19.542967+0000","last_peered":"2024-09-16T07:57:19.542967+0000","last_clean":"2024-09-16T07:57:19.542967+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:19.542967+0000","last_undegraded":"2024-09-16T07:57:19.542967+0000","last_fullsized":"2024-09-16T07:57:19.542967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.544627+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:21.544627+0000","last_peered":"2024-09-16T07:57:21.544627+0000","last_clean":"2024-09-16T07:57:21.544627+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:21.544627+0000","last_undegraded":"2024-09-16T07:57:21.544627+0000","last_fullsized":"2024-09-16T07:57:21.544627+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":306,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.586957+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:19.586957+0000","last_peered":"2024-09-16T07:57:19.586957+0000","last_clean":"2024-09-16T07:57:19.586957+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:19.586957+0000","last_undegraded":"2024-09-16T07:57:19.586957+0000","last_fullsized":"2024-09-16T07:57:19.586957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.557127+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:21.557127+0000","last_peered":"2024-09-16T07:57:21.557127+0000","last_clean":"2024-09-16T07:57:21.557127+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:21.557127+0000","last_undegraded":"2024-09-16T07:57:21.557127+0000","last_fullsized":"2024-09-16T07:57:21.557127+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.682216+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:21.682216+0000","last_peered":"2024-09-16T07:57:21.682216+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:21.682216+0000","last_undegraded":"2024-09-16T07:57:21.682216+0000","last_fullsized":"2024-09-16T07:57:21.682216+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.091990+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:56:58.091990+0000","last_peered":"2024-09-16T07:56:58.091990+0000","last_clean":"2024-09-16T07:56:58.091990+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:56:58.091990+0000","last_undegraded":"2024-09-16T07:56:58.091990+0000","last_fullsized":"2024-09-16T07:56:58.091990+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.138533+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:01.138533+0000","last_peered":"2024-09-16T07:57:01.138533+0000","last_clean":"2024-09-16T07:57:01.138533+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:01.138533+0000","last_undegraded":"2024-09-16T07:57:01.138533+0000","last_fullsized":"2024-09-16T07:57:01.138533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.089633+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:56:58.089633+0000","last_peered":"2024-09-16T07:56:58.089633+0000","last_clean":"2024-09-16T07:56:58.089633+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:56:58.089633+0000","last_undegraded":"2024-09-16T07:56:58.089633+0000","last_fullsized":"2024-09-16T07:56:58.089633+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":318,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.556141+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:19.556141+0000","last_peered":"2024-09-16T07:57:19.556141+0000","last_clean":"2024-09-16T07:57:19.556141+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:19.556141+0000","last_undegraded":"2024-09-16T07:57:19.556141+0000","last_fullsized":"2024-09-16T07:57:19.556141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35836,"kb_used_data":6188,"kb_used_omap":0,"kb_used_meta":29632,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":6336512,"data_stored":84576275,"data_compressed":3997841,"data_compressed_allocated":5263360,"data_compressed_original":84131840,"omap_allocated":0,"internal_metadata":30343168},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500702,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39732,"kb_used_data":10580,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":10833920,"data_stored":156790259,"data_compressed":7427264,"data_compressed_allocated":9777152,"data_compressed_original":156352512,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42340,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":1069056,"data_stored":434127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29820,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94342020,"statfs":{"total":96636764160,"available":96606228480,"internally_reserved":0,"allocated":1159168,"data_stored":1035084,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:23.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 1 16 209 193 12.0619 12.0625 0.0565645 0.0787942 2024-09-16T07:57:24.383 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:57:24.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:24.531+0000 7fe855711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:24.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:24.542+0000 7fe855711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:24.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 2 16 414 398 12.4366 12.8125 0.0684091 0.0790311 2024-09-16T07:57:25.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 3 16 603 587 12.2284 11.8125 0.101935 0.0804993 2024-09-16T07:57:25.881 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:26.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:26.028+0000 7fd100791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:26.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:26.040+0000 7fd100791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:26.288 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:26.289 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:26.307 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":494,"stamp":"2024-09-16T07:57:24.450363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":147728,"kb_used_data":18944,"kb_used_omap":0,"kb_used_meta":128704,"kb_avail":377339632,"statfs":{"total":386547056640,"available":386395783168,"internally_reserved":0,"allocated":19398656,"data_stored":242835745,"data_compressed":11455146,"data_compressed_allocated":15081472,"data_compressed_original":241057792,"omap_allocated":0,"internal_metadata":131792896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.930257"},"pg_stats":[{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":379,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.140645+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:01.140645+0000","last_peered":"2024-09-16T07:57:01.140645+0000","last_clean":"2024-09-16T07:57:01.140645+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:01.140645+0000","last_undegraded":"2024-09-16T07:57:01.140645+0000","last_fullsized":"2024-09-16T07:57:01.140645+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":325,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.542967+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:19.542967+0000","last_peered":"2024-09-16T07:57:19.542967+0000","last_clean":"2024-09-16T07:57:19.542967+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:19.542967+0000","last_undegraded":"2024-09-16T07:57:19.542967+0000","last_fullsized":"2024-09-16T07:57:19.542967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.544627+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:21.544627+0000","last_peered":"2024-09-16T07:57:21.544627+0000","last_clean":"2024-09-16T07:57:21.544627+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:21.544627+0000","last_undegraded":"2024-09-16T07:57:21.544627+0000","last_fullsized":"2024-09-16T07:57:21.544627+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":306,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.586957+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:19.586957+0000","last_peered":"2024-09-16T07:57:19.586957+0000","last_clean":"2024-09-16T07:57:19.586957+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:19.586957+0000","last_undegraded":"2024-09-16T07:57:19.586957+0000","last_fullsized":"2024-09-16T07:57:19.586957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.557127+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:21.557127+0000","last_peered":"2024-09-16T07:57:21.557127+0000","last_clean":"2024-09-16T07:57:21.557127+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:21.557127+0000","last_undegraded":"2024-09-16T07:57:21.557127+0000","last_fullsized":"2024-09-16T07:57:21.557127+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.682216+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:21.682216+0000","last_peered":"2024-09-16T07:57:21.682216+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:21.682216+0000","last_undegraded":"2024-09-16T07:57:21.682216+0000","last_fullsized":"2024-09-16T07:57:21.682216+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.091990+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:56:58.091990+0000","last_peered":"2024-09-16T07:56:58.091990+0000","last_clean":"2024-09-16T07:56:58.091990+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:56:58.091990+0000","last_undegraded":"2024-09-16T07:56:58.091990+0000","last_fullsized":"2024-09-16T07:56:58.091990+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.138533+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:01.138533+0000","last_peered":"2024-09-16T07:57:01.138533+0000","last_clean":"2024-09-16T07:57:01.138533+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:01.138533+0000","last_undegraded":"2024-09-16T07:57:01.138533+0000","last_fullsized":"2024-09-16T07:57:01.138533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.089633+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:56:58.089633+0000","last_peered":"2024-09-16T07:56:58.089633+0000","last_clean":"2024-09-16T07:56:58.089633+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:56:58.089633+0000","last_undegraded":"2024-09-16T07:56:58.089633+0000","last_fullsized":"2024-09-16T07:56:58.089633+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":318,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.556141+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:19.556141+0000","last_peered":"2024-09-16T07:57:19.556141+0000","last_clean":"2024-09-16T07:57:19.556141+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:19.556141+0000","last_undegraded":"2024-09-16T07:57:19.556141+0000","last_fullsized":"2024-09-16T07:57:19.556141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35836,"kb_used_data":6188,"kb_used_omap":0,"kb_used_meta":29632,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":6336512,"data_stored":84576275,"data_compressed":3997841,"data_compressed_allocated":5263360,"data_compressed_original":84131840,"omap_allocated":0,"internal_metadata":30343168},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500702,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39732,"kb_used_data":10580,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":10833920,"data_stored":156790259,"data_compressed":7427264,"data_compressed_allocated":9777152,"data_compressed_original":156352512,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42340,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":1069056,"data_stored":434127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29820,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94342020,"statfs":{"total":96636764160,"available":96606228480,"internally_reserved":0,"allocated":1159168,"data_stored":1035084,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:26.308 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:57:26.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:26.460+0000 7f644f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:26.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:26.472+0000 7f644f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:26.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 4 16 799 783 12.2335 12.25 0.090853 0.0808037 2024-09-16T07:57:26.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:26.850 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":748,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":132,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473411,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":15},{"state_name":"active+clean","count":10}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590376,"bytes_used":151273472,"bytes_avail":386395783168,"bytes_total":386547056640,"unknown_pgs_ratio":0.60000002384185791},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:57:26.869 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:57:26.869 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:26.912 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:57:27.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:27.017+0000 7fc237b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:27.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:27.029+0000 7fc237b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:27.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:27.059+0000 7f8ab6591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:27.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:27.068+0000 7f8ab6591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:27.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:27.313 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:27.335 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":495,"stamp":"2024-09-16T07:57:26.450819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":147728,"kb_used_data":18944,"kb_used_omap":0,"kb_used_meta":128704,"kb_avail":377339632,"statfs":{"total":386547056640,"available":386395783168,"internally_reserved":0,"allocated":19398656,"data_stored":242835745,"data_compressed":11455146,"data_compressed_allocated":15081472,"data_compressed_original":241057792,"omap_allocated":0,"internal_metadata":131792896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001187"},"pg_stats":[{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":379,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.140645+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:01.140645+0000","last_peered":"2024-09-16T07:57:01.140645+0000","last_clean":"2024-09-16T07:57:01.140645+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:01.140645+0000","last_undegraded":"2024-09-16T07:57:01.140645+0000","last_fullsized":"2024-09-16T07:57:01.140645+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":325,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.542967+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:19.542967+0000","last_peered":"2024-09-16T07:57:19.542967+0000","last_clean":"2024-09-16T07:57:19.542967+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:19.542967+0000","last_undegraded":"2024-09-16T07:57:19.542967+0000","last_fullsized":"2024-09-16T07:57:19.542967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.544627+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:21.544627+0000","last_peered":"2024-09-16T07:57:21.544627+0000","last_clean":"2024-09-16T07:57:21.544627+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:21.544627+0000","last_undegraded":"2024-09-16T07:57:21.544627+0000","last_fullsized":"2024-09-16T07:57:21.544627+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":306,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.586957+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:19.586957+0000","last_peered":"2024-09-16T07:57:19.586957+0000","last_clean":"2024-09-16T07:57:19.586957+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:19.586957+0000","last_undegraded":"2024-09-16T07:57:19.586957+0000","last_fullsized":"2024-09-16T07:57:19.586957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.557127+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:21.557127+0000","last_peered":"2024-09-16T07:57:21.557127+0000","last_clean":"2024-09-16T07:57:21.557127+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:21.557127+0000","last_undegraded":"2024-09-16T07:57:21.557127+0000","last_fullsized":"2024-09-16T07:57:21.557127+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.682216+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:21.682216+0000","last_peered":"2024-09-16T07:57:21.682216+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:21.682216+0000","last_undegraded":"2024-09-16T07:57:21.682216+0000","last_fullsized":"2024-09-16T07:57:21.682216+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.091990+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:56:58.091990+0000","last_peered":"2024-09-16T07:56:58.091990+0000","last_clean":"2024-09-16T07:56:58.091990+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:56:58.091990+0000","last_undegraded":"2024-09-16T07:56:58.091990+0000","last_fullsized":"2024-09-16T07:56:58.091990+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.138533+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:01.138533+0000","last_peered":"2024-09-16T07:57:01.138533+0000","last_clean":"2024-09-16T07:57:01.138533+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:01.138533+0000","last_undegraded":"2024-09-16T07:57:01.138533+0000","last_fullsized":"2024-09-16T07:57:01.138533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":332,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-16T07:56:58.089633+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:56:58.089633+0000","last_peered":"2024-09-16T07:56:58.089633+0000","last_clean":"2024-09-16T07:56:58.089633+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:56:58.089633+0000","last_undegraded":"2024-09-16T07:56:58.089633+0000","last_fullsized":"2024-09-16T07:56:58.089633+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":318,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.556141+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:19.556141+0000","last_peered":"2024-09-16T07:57:19.556141+0000","last_clean":"2024-09-16T07:57:19.556141+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:19.556141+0000","last_undegraded":"2024-09-16T07:57:19.556141+0000","last_fullsized":"2024-09-16T07:57:19.556141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35836,"kb_used_data":6188,"kb_used_omap":0,"kb_used_meta":29632,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":6336512,"data_stored":84576275,"data_compressed":3997841,"data_compressed_allocated":5263360,"data_compressed_original":84131840,"omap_allocated":0,"internal_metadata":30343168},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500702,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39732,"kb_used_data":10580,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94332108,"statfs":{"total":96636764160,"available":96596078592,"internally_reserved":0,"allocated":10833920,"data_stored":156790259,"data_compressed":7427264,"data_compressed_allocated":9777152,"data_compressed_original":156352512,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42340,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":1069056,"data_stored":434127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29820,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94342020,"statfs":{"total":96636764160,"available":96606228480,"internally_reserved":0,"allocated":1159168,"data_stored":1035084,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:27.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 5 16 997 981 12.2616 12.375 0.0690383 0.080901 2024-09-16T07:57:28.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 6 16 1191 1175 12.2387 12.125 0.0587527 0.0811696 2024-09-16T07:57:29.475 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:57:29.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 7 16 1391 1375 12.2759 12.5 0.0842709 0.080989 2024-09-16T07:57:29.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:29.635+0000 7f19c8991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:29.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:29.645+0000 7f19c8991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:30.338 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:30.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:30.475+0000 7fabc9f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:30.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:30.486+0000 7fabc9f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:30.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 8 16 1574 1558 12.1709 11.4375 0.0784743 0.0818115 2024-09-16T07:57:30.748 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:30.748 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:30.766 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":497,"stamp":"2024-09-16T07:57:30.451712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26673704,"num_objects":402,"num_object_clones":0,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":478,"num_write_kb":26579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":453,"ondisk_log_size":453,"up":45,"acting":45,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":141056,"kb_used_data":12280,"kb_used_omap":0,"kb_used_meta":128704,"kb_avail":377346304,"statfs":{"total":386547056640,"available":386402615296,"internally_reserved":0,"allocated":12574720,"data_stored":132566188,"data_compressed":6217009,"data_compressed_allocated":8187904,"data_compressed_original":130760704,"omap_allocated":0,"internal_metadata":131792896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26083328,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":25472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.922731"},"pg_stats":[{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"132'83","reported_seq":95,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.659615+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:28.659615+0000","last_peered":"2024-09-16T07:57:28.659615+0000","last_clean":"2024-09-16T07:57:28.659615+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:28.659615+0000","last_undegraded":"2024-09-16T07:57:28.659615+0000","last_fullsized":"2024-09-16T07:57:28.659615+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'79","reported_seq":91,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.752077+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:28.752077+0000","last_peered":"2024-09-16T07:57:28.752077+0000","last_clean":"2024-09-16T07:57:28.752077+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:28.752077+0000","last_undegraded":"2024-09-16T07:57:28.752077+0000","last_fullsized":"2024-09-16T07:57:28.752077+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"132'84","reported_seq":96,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.656905+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:28.656905+0000","last_peered":"2024-09-16T07:57:28.656905+0000","last_clean":"2024-09-16T07:57:28.656905+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:28.656905+0000","last_undegraded":"2024-09-16T07:57:28.656905+0000","last_fullsized":"2024-09-16T07:57:28.656905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":379,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.140645+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:01.140645+0000","last_peered":"2024-09-16T07:57:01.140645+0000","last_clean":"2024-09-16T07:57:01.140645+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:01.140645+0000","last_undegraded":"2024-09-16T07:57:01.140645+0000","last_fullsized":"2024-09-16T07:57:01.140645+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":325,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.542967+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:19.542967+0000","last_peered":"2024-09-16T07:57:19.542967+0000","last_clean":"2024-09-16T07:57:19.542967+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:19.542967+0000","last_undegraded":"2024-09-16T07:57:19.542967+0000","last_fullsized":"2024-09-16T07:57:19.542967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.544627+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:21.544627+0000","last_peered":"2024-09-16T07:57:21.544627+0000","last_clean":"2024-09-16T07:57:21.544627+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:21.544627+0000","last_undegraded":"2024-09-16T07:57:21.544627+0000","last_fullsized":"2024-09-16T07:57:21.544627+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'93","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.722433+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:28.722433+0000","last_peered":"2024-09-16T07:57:28.722433+0000","last_clean":"2024-09-16T07:57:28.722433+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:28.722433+0000","last_undegraded":"2024-09-16T07:57:28.722433+0000","last_fullsized":"2024-09-16T07:57:28.722433+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":306,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.586957+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:19.586957+0000","last_peered":"2024-09-16T07:57:19.586957+0000","last_clean":"2024-09-16T07:57:19.586957+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:19.586957+0000","last_undegraded":"2024-09-16T07:57:19.586957+0000","last_fullsized":"2024-09-16T07:57:19.586957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.557127+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:21.557127+0000","last_peered":"2024-09-16T07:57:21.557127+0000","last_clean":"2024-09-16T07:57:21.557127+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:21.557127+0000","last_undegraded":"2024-09-16T07:57:21.557127+0000","last_fullsized":"2024-09-16T07:57:21.557127+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.682216+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:21.682216+0000","last_peered":"2024-09-16T07:57:21.682216+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:21.682216+0000","last_undegraded":"2024-09-16T07:57:21.682216+0000","last_fullsized":"2024-09-16T07:57:21.682216+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'59","reported_seq":71,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.670887+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:28.670887+0000","last_peered":"2024-09-16T07:57:28.670887+0000","last_clean":"2024-09-16T07:57:28.670887+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:28.670887+0000","last_undegraded":"2024-09-16T07:57:28.670887+0000","last_fullsized":"2024-09-16T07:57:28.670887+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.138533+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:01.138533+0000","last_peered":"2024-09-16T07:57:01.138533+0000","last_clean":"2024-09-16T07:57:01.138533+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:01.138533+0000","last_undegraded":"2024-09-16T07:57:01.138533+0000","last_fullsized":"2024-09-16T07:57:01.138533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":318,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.556141+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:19.556141+0000","last_peered":"2024-09-16T07:57:19.556141+0000","last_clean":"2024-09-16T07:57:19.556141+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:19.556141+0000","last_undegraded":"2024-09-16T07:57:19.556141+0000","last_fullsized":"2024-09-16T07:57:19.556141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":26083328,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":25472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0},"log_size":398,"ondisk_log_size":398,"up":18,"acting":18,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35836,"kb_used_data":6188,"kb_used_omap":0,"kb_used_meta":29632,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":6336512,"data_stored":84576275,"data_compressed":3997841,"data_compressed_allocated":5263360,"data_compressed_original":84131840,"omap_allocated":0,"internal_metadata":30343168},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33060,"kb_used_data":3916,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":4009984,"data_stored":46520702,"data_compressed":2189127,"data_compressed_allocated":2883584,"data_compressed_original":46055424,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42340,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":1069056,"data_stored":434127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29820,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94342020,"statfs":{"total":96636764160,"available":96606228480,"internally_reserved":0,"allocated":1159168,"data_stored":1035084,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:30.768 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:57:30.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:30.906+0000 7fe38ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:30.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:30.916+0000 7fe38ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:31.290 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:31.290 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":753,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":132,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473411,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":15},{"state_name":"unknown","count":10}],"num_pgs":25,"num_pools":3,"num_objects":402,"data_bytes":26673704,"bytes_used":144441344,"bytes_avail":386402615296,"bytes_total":386547056640,"unknown_pgs_ratio":0.40000000596046448,"write_bytes_sec":2923244,"read_op_per_sec":0,"write_op_per_sec":44},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:57:31.308 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:57:31.308 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:31.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:31.455+0000 7f7ff7d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:31.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:31.469+0000 7f7ff7d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:31.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 9 16 1771 1755 12.1865 12.3125 0.0870671 0.0816869 2024-09-16T07:57:31.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:31.762 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:31.780 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":497,"stamp":"2024-09-16T07:57:30.451712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26673704,"num_objects":402,"num_object_clones":0,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":478,"num_write_kb":26579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":453,"ondisk_log_size":453,"up":45,"acting":45,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":141056,"kb_used_data":12280,"kb_used_omap":0,"kb_used_meta":128704,"kb_avail":377346304,"statfs":{"total":386547056640,"available":386402615296,"internally_reserved":0,"allocated":12574720,"data_stored":132566188,"data_compressed":6217009,"data_compressed_allocated":8187904,"data_compressed_original":130760704,"omap_allocated":0,"internal_metadata":131792896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":26083328,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":25472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.922731"},"pg_stats":[{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"132'83","reported_seq":95,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.659615+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:28.659615+0000","last_peered":"2024-09-16T07:57:28.659615+0000","last_clean":"2024-09-16T07:57:28.659615+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:28.659615+0000","last_undegraded":"2024-09-16T07:57:28.659615+0000","last_fullsized":"2024-09-16T07:57:28.659615+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'79","reported_seq":91,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.752077+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:28.752077+0000","last_peered":"2024-09-16T07:57:28.752077+0000","last_clean":"2024-09-16T07:57:28.752077+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:28.752077+0000","last_undegraded":"2024-09-16T07:57:28.752077+0000","last_fullsized":"2024-09-16T07:57:28.752077+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"132'84","reported_seq":96,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.656905+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:28.656905+0000","last_peered":"2024-09-16T07:57:28.656905+0000","last_clean":"2024-09-16T07:57:28.656905+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:28.656905+0000","last_undegraded":"2024-09-16T07:57:28.656905+0000","last_fullsized":"2024-09-16T07:57:28.656905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":379,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.140645+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:01.140645+0000","last_peered":"2024-09-16T07:57:01.140645+0000","last_clean":"2024-09-16T07:57:01.140645+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:01.140645+0000","last_undegraded":"2024-09-16T07:57:01.140645+0000","last_fullsized":"2024-09-16T07:57:01.140645+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":325,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.542967+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:19.542967+0000","last_peered":"2024-09-16T07:57:19.542967+0000","last_clean":"2024-09-16T07:57:19.542967+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:19.542967+0000","last_undegraded":"2024-09-16T07:57:19.542967+0000","last_fullsized":"2024-09-16T07:57:19.542967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.544627+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:21.544627+0000","last_peered":"2024-09-16T07:57:21.544627+0000","last_clean":"2024-09-16T07:57:21.544627+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:21.544627+0000","last_undegraded":"2024-09-16T07:57:21.544627+0000","last_fullsized":"2024-09-16T07:57:21.544627+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'93","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.722433+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:28.722433+0000","last_peered":"2024-09-16T07:57:28.722433+0000","last_clean":"2024-09-16T07:57:28.722433+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:28.722433+0000","last_undegraded":"2024-09-16T07:57:28.722433+0000","last_fullsized":"2024-09-16T07:57:28.722433+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":306,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.586957+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:19.586957+0000","last_peered":"2024-09-16T07:57:19.586957+0000","last_clean":"2024-09-16T07:57:19.586957+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:19.586957+0000","last_undegraded":"2024-09-16T07:57:19.586957+0000","last_fullsized":"2024-09-16T07:57:19.586957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.557127+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:21.557127+0000","last_peered":"2024-09-16T07:57:21.557127+0000","last_clean":"2024-09-16T07:57:21.557127+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:21.557127+0000","last_undegraded":"2024-09-16T07:57:21.557127+0000","last_fullsized":"2024-09-16T07:57:21.557127+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.682216+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:21.682216+0000","last_peered":"2024-09-16T07:57:21.682216+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:21.682216+0000","last_undegraded":"2024-09-16T07:57:21.682216+0000","last_fullsized":"2024-09-16T07:57:21.682216+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'59","reported_seq":71,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.670887+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:28.670887+0000","last_peered":"2024-09-16T07:57:28.670887+0000","last_clean":"2024-09-16T07:57:28.670887+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:28.670887+0000","last_undegraded":"2024-09-16T07:57:28.670887+0000","last_fullsized":"2024-09-16T07:57:28.670887+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":314,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-16T07:57:01.138533+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:01.138533+0000","last_peered":"2024-09-16T07:57:01.138533+0000","last_clean":"2024-09-16T07:57:01.138533+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:01.138533+0000","last_undegraded":"2024-09-16T07:57:01.138533+0000","last_fullsized":"2024-09-16T07:57:01.138533+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":318,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.556141+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:19.556141+0000","last_peered":"2024-09-16T07:57:19.556141+0000","last_clean":"2024-09-16T07:57:19.556141+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:19.556141+0000","last_undegraded":"2024-09-16T07:57:19.556141+0000","last_fullsized":"2024-09-16T07:57:19.556141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":26083328,"num_objects":398,"num_object_clones":0,"num_object_copies":1194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":398,"num_write_kb":25472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0},"log_size":398,"ondisk_log_size":398,"up":18,"acting":18,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122227,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35836,"kb_used_data":6188,"kb_used_omap":0,"kb_used_meta":29632,"kb_avail":94336004,"statfs":{"total":96636764160,"available":96600068096,"internally_reserved":0,"allocated":6336512,"data_stored":84576275,"data_compressed":3997841,"data_compressed_allocated":5263360,"data_compressed_original":84131840,"omap_allocated":0,"internal_metadata":30343168},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33060,"kb_used_data":3916,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":4009984,"data_stored":46520702,"data_compressed":2189127,"data_compressed_allocated":2883584,"data_compressed_original":46055424,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42340,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":1069056,"data_stored":434127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29820,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94342020,"statfs":{"total":96636764160,"available":96606228480,"internally_reserved":0,"allocated":1159168,"data_stored":1035084,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:32.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:57:32.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:32.174+0000 7fabbb86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:32.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:32.183+0000 7fabbb86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:32.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 10 16 1955 1939 12.1178 11.5 0.126865 0.0819296 2024-09-16T07:57:33.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 11 16 2149 2133 12.1183 12.125 0.0406778 0.0821676 2024-09-16T07:57:34.616 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:57:34.623 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 12 16 2342 2326 12.1136 12.0625 0.0706829 0.0821979 2024-09-16T07:57:34.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:34.778+0000 7f8dcea88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:34.782 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:34.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:34.792+0000 7f8dcea88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:34.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:34.955+0000 7f21e9751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:34.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:34.969+0000 7f21e9751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:35.259 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:35.260 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:35.277 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":499,"stamp":"2024-09-16T07:57:34.452548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75235880,"num_objects":1143,"num_object_clones":0,"num_object_copies":3429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1219,"num_write_kb":74003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":63,"acting":63,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":173616,"kb_used_data":14312,"kb_used_omap":0,"kb_used_meta":159232,"kb_avail":377313744,"statfs":{"total":386547056640,"available":386369273856,"internally_reserved":0,"allocated":14655488,"data_stored":165092868,"data_compressed":7759523,"data_compressed_allocated":10219520,"data_compressed_original":163266560,"omap_allocated":0,"internal_metadata":163053568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":74645504,"num_objects":1139,"num_object_clones":0,"num_object_copies":3417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.920098"},"pg_stats":[{"pgid":"7.f","version":"132'123","reported_seq":135,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.032215+0000","last_change":"2024-09-16T07:57:21.677659+0000","last_active":"2024-09-16T07:57:33.032215+0000","last_peered":"2024-09-16T07:57:33.032215+0000","last_clean":"2024-09-16T07:57:33.032215+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:57:33.032215+0000","last_undegraded":"2024-09-16T07:57:33.032215+0000","last_fullsized":"2024-09-16T07:57:33.032215+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"132'83","reported_seq":95,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.659615+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:28.659615+0000","last_peered":"2024-09-16T07:57:28.659615+0000","last_clean":"2024-09-16T07:57:28.659615+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:28.659615+0000","last_undegraded":"2024-09-16T07:57:28.659615+0000","last_fullsized":"2024-09-16T07:57:28.659615+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'79","reported_seq":91,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.752077+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:28.752077+0000","last_peered":"2024-09-16T07:57:28.752077+0000","last_clean":"2024-09-16T07:57:28.752077+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:28.752077+0000","last_undegraded":"2024-09-16T07:57:28.752077+0000","last_fullsized":"2024-09-16T07:57:28.752077+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"132'122","reported_seq":134,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.117306+0000","last_change":"2024-09-16T07:57:21.747923+0000","last_active":"2024-09-16T07:57:33.117306+0000","last_peered":"2024-09-16T07:57:33.117306+0000","last_clean":"2024-09-16T07:57:33.117306+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:57:33.117306+0000","last_undegraded":"2024-09-16T07:57:33.117306+0000","last_fullsized":"2024-09-16T07:57:33.117306+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"132'131","reported_seq":143,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.008158+0000","last_change":"2024-09-16T07:57:21.678939+0000","last_active":"2024-09-16T07:57:33.008158+0000","last_peered":"2024-09-16T07:57:33.008158+0000","last_clean":"2024-09-16T07:57:33.008158+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:57:33.008158+0000","last_undegraded":"2024-09-16T07:57:33.008158+0000","last_fullsized":"2024-09-16T07:57:33.008158+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"132'84","reported_seq":96,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.656905+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:28.656905+0000","last_peered":"2024-09-16T07:57:28.656905+0000","last_clean":"2024-09-16T07:57:28.656905+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:28.656905+0000","last_undegraded":"2024-09-16T07:57:28.656905+0000","last_fullsized":"2024-09-16T07:57:28.656905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"132'119","reported_seq":131,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.036329+0000","last_change":"2024-09-16T07:57:21.700152+0000","last_active":"2024-09-16T07:57:33.036329+0000","last_peered":"2024-09-16T07:57:33.036329+0000","last_clean":"2024-09-16T07:57:33.036329+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:57:33.036329+0000","last_undegraded":"2024-09-16T07:57:33.036329+0000","last_fullsized":"2024-09-16T07:57:33.036329+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":397,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545175+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:22.545175+0000","last_peered":"2024-09-16T07:57:22.545175+0000","last_clean":"2024-09-16T07:57:22.545175+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:22.545175+0000","last_undegraded":"2024-09-16T07:57:22.545175+0000","last_fullsized":"2024-09-16T07:57:22.545175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":325,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.542967+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:19.542967+0000","last_peered":"2024-09-16T07:57:19.542967+0000","last_clean":"2024-09-16T07:57:19.542967+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:19.542967+0000","last_undegraded":"2024-09-16T07:57:19.542967+0000","last_fullsized":"2024-09-16T07:57:19.542967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.544627+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:21.544627+0000","last_peered":"2024-09-16T07:57:21.544627+0000","last_clean":"2024-09-16T07:57:21.544627+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:21.544627+0000","last_undegraded":"2024-09-16T07:57:21.544627+0000","last_fullsized":"2024-09-16T07:57:21.544627+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'93","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.722433+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:28.722433+0000","last_peered":"2024-09-16T07:57:28.722433+0000","last_clean":"2024-09-16T07:57:28.722433+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:28.722433+0000","last_undegraded":"2024-09-16T07:57:28.722433+0000","last_fullsized":"2024-09-16T07:57:28.722433+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":306,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.586957+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:19.586957+0000","last_peered":"2024-09-16T07:57:19.586957+0000","last_clean":"2024-09-16T07:57:19.586957+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:19.586957+0000","last_undegraded":"2024-09-16T07:57:19.586957+0000","last_fullsized":"2024-09-16T07:57:19.586957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.557127+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:21.557127+0000","last_peered":"2024-09-16T07:57:21.557127+0000","last_clean":"2024-09-16T07:57:21.557127+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:21.557127+0000","last_undegraded":"2024-09-16T07:57:21.557127+0000","last_fullsized":"2024-09-16T07:57:21.557127+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.682216+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:21.682216+0000","last_peered":"2024-09-16T07:57:21.682216+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:21.682216+0000","last_undegraded":"2024-09-16T07:57:21.682216+0000","last_fullsized":"2024-09-16T07:57:21.682216+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'59","reported_seq":71,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.670887+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:28.670887+0000","last_peered":"2024-09-16T07:57:28.670887+0000","last_clean":"2024-09-16T07:57:28.670887+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:28.670887+0000","last_undegraded":"2024-09-16T07:57:28.670887+0000","last_fullsized":"2024-09-16T07:57:28.670887+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.546751+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:22.546751+0000","last_peered":"2024-09-16T07:57:22.546751+0000","last_clean":"2024-09-16T07:57:22.546751+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:22.546751+0000","last_undegraded":"2024-09-16T07:57:22.546751+0000","last_fullsized":"2024-09-16T07:57:22.546751+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"132'135","reported_seq":147,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.079236+0000","last_change":"2024-09-16T07:57:21.653427+0000","last_active":"2024-09-16T07:57:33.079236+0000","last_peered":"2024-09-16T07:57:33.079236+0000","last_clean":"2024-09-16T07:57:33.079236+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:57:33.079236+0000","last_undegraded":"2024-09-16T07:57:33.079236+0000","last_fullsized":"2024-09-16T07:57:33.079236+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"132'111","reported_seq":123,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:32.706917+0000","last_change":"2024-09-16T07:57:21.704210+0000","last_active":"2024-09-16T07:57:32.706917+0000","last_peered":"2024-09-16T07:57:32.706917+0000","last_clean":"2024-09-16T07:57:32.706917+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:57:32.706917+0000","last_undegraded":"2024-09-16T07:57:32.706917+0000","last_fullsized":"2024-09-16T07:57:32.706917+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":318,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.556141+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:19.556141+0000","last_peered":"2024-09-16T07:57:19.556141+0000","last_clean":"2024-09-16T07:57:19.556141+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:19.556141+0000","last_undegraded":"2024-09-16T07:57:19.556141+0000","last_fullsized":"2024-09-16T07:57:19.556141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":74645504,"num_objects":1139,"num_object_clones":0,"num_object_copies":3417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10805248,"data_stored":172883968,"data_compressed":8207776,"data_compressed_allocated":10805248,"data_compressed_original":172883968,"omap_allocated":0,"internal_metadata":0},"log_size":1139,"ondisk_log_size":1139,"up":36,"acting":36,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68396,"kb_used_data":8220,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94303444,"statfs":{"total":96636764160,"available":96566726656,"internally_reserved":0,"allocated":8417280,"data_stored":117102955,"data_compressed":5540355,"data_compressed_allocated":7294976,"data_compressed_original":116637696,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33060,"kb_used_data":3916,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":4009984,"data_stored":46520702,"data_compressed":2189127,"data_compressed_allocated":2883584,"data_compressed_original":46055424,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42340,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":1069056,"data_stored":434127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29820,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94342020,"statfs":{"total":96636764160,"available":96606228480,"internally_reserved":0,"allocated":1159168,"data_stored":1035084,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7852032,"data_stored":125632512,"data_compressed":5964666,"data_compressed_allocated":7852032,"data_compressed_original":125632512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:35.279 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:57:35.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:35.416+0000 7fada4791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:35.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:35.429+0000 7fada4791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:35.624 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 13 16 2529 2513 12.0807 11.6875 0.133119 0.0824072 2024-09-16T07:57:35.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:35.947 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":758,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":132,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473411,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":21},{"state_name":"unknown","count":4}],"num_pgs":25,"num_pools":3,"num_objects":1143,"data_bytes":75235880,"bytes_used":177782784,"bytes_avail":386369273856,"bytes_total":386547056640,"unknown_pgs_ratio":0.15999999642372131,"write_bytes_sec":6262154,"read_op_per_sec":0,"write_op_per_sec":95},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:57:35.970 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:57:35.970 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:36.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:36.108+0000 7fa02a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:36.119 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:36.118+0000 7fa02a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:36.365 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:36.365 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:36.384 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":499,"stamp":"2024-09-16T07:57:34.452548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75235880,"num_objects":1143,"num_object_clones":0,"num_object_copies":3429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1219,"num_write_kb":74003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":63,"acting":63,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":173616,"kb_used_data":14312,"kb_used_omap":0,"kb_used_meta":159232,"kb_avail":377313744,"statfs":{"total":386547056640,"available":386369273856,"internally_reserved":0,"allocated":14655488,"data_stored":165092868,"data_compressed":7759523,"data_compressed_allocated":10219520,"data_compressed_original":163266560,"omap_allocated":0,"internal_metadata":163053568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":74645504,"num_objects":1139,"num_object_clones":0,"num_object_copies":3417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.920098"},"pg_stats":[{"pgid":"7.f","version":"132'123","reported_seq":135,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.032215+0000","last_change":"2024-09-16T07:57:21.677659+0000","last_active":"2024-09-16T07:57:33.032215+0000","last_peered":"2024-09-16T07:57:33.032215+0000","last_clean":"2024-09-16T07:57:33.032215+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:57:33.032215+0000","last_undegraded":"2024-09-16T07:57:33.032215+0000","last_fullsized":"2024-09-16T07:57:33.032215+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"132'83","reported_seq":95,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.659615+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:28.659615+0000","last_peered":"2024-09-16T07:57:28.659615+0000","last_clean":"2024-09-16T07:57:28.659615+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:28.659615+0000","last_undegraded":"2024-09-16T07:57:28.659615+0000","last_fullsized":"2024-09-16T07:57:28.659615+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'79","reported_seq":91,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.752077+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:28.752077+0000","last_peered":"2024-09-16T07:57:28.752077+0000","last_clean":"2024-09-16T07:57:28.752077+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:28.752077+0000","last_undegraded":"2024-09-16T07:57:28.752077+0000","last_fullsized":"2024-09-16T07:57:28.752077+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"132'122","reported_seq":134,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.117306+0000","last_change":"2024-09-16T07:57:21.747923+0000","last_active":"2024-09-16T07:57:33.117306+0000","last_peered":"2024-09-16T07:57:33.117306+0000","last_clean":"2024-09-16T07:57:33.117306+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:57:33.117306+0000","last_undegraded":"2024-09-16T07:57:33.117306+0000","last_fullsized":"2024-09-16T07:57:33.117306+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"132'131","reported_seq":143,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.008158+0000","last_change":"2024-09-16T07:57:21.678939+0000","last_active":"2024-09-16T07:57:33.008158+0000","last_peered":"2024-09-16T07:57:33.008158+0000","last_clean":"2024-09-16T07:57:33.008158+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:57:33.008158+0000","last_undegraded":"2024-09-16T07:57:33.008158+0000","last_fullsized":"2024-09-16T07:57:33.008158+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"132'84","reported_seq":96,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.656905+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:28.656905+0000","last_peered":"2024-09-16T07:57:28.656905+0000","last_clean":"2024-09-16T07:57:28.656905+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:28.656905+0000","last_undegraded":"2024-09-16T07:57:28.656905+0000","last_fullsized":"2024-09-16T07:57:28.656905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"132'119","reported_seq":131,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.036329+0000","last_change":"2024-09-16T07:57:21.700152+0000","last_active":"2024-09-16T07:57:33.036329+0000","last_peered":"2024-09-16T07:57:33.036329+0000","last_clean":"2024-09-16T07:57:33.036329+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:57:33.036329+0000","last_undegraded":"2024-09-16T07:57:33.036329+0000","last_fullsized":"2024-09-16T07:57:33.036329+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":397,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545175+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:22.545175+0000","last_peered":"2024-09-16T07:57:22.545175+0000","last_clean":"2024-09-16T07:57:22.545175+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:22.545175+0000","last_undegraded":"2024-09-16T07:57:22.545175+0000","last_fullsized":"2024-09-16T07:57:22.545175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":325,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.542967+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:19.542967+0000","last_peered":"2024-09-16T07:57:19.542967+0000","last_clean":"2024-09-16T07:57:19.542967+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:19.542967+0000","last_undegraded":"2024-09-16T07:57:19.542967+0000","last_fullsized":"2024-09-16T07:57:19.542967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.544627+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:21.544627+0000","last_peered":"2024-09-16T07:57:21.544627+0000","last_clean":"2024-09-16T07:57:21.544627+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:21.544627+0000","last_undegraded":"2024-09-16T07:57:21.544627+0000","last_fullsized":"2024-09-16T07:57:21.544627+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'93","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.722433+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:28.722433+0000","last_peered":"2024-09-16T07:57:28.722433+0000","last_clean":"2024-09-16T07:57:28.722433+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:28.722433+0000","last_undegraded":"2024-09-16T07:57:28.722433+0000","last_fullsized":"2024-09-16T07:57:28.722433+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":306,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.586957+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:19.586957+0000","last_peered":"2024-09-16T07:57:19.586957+0000","last_clean":"2024-09-16T07:57:19.586957+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:19.586957+0000","last_undegraded":"2024-09-16T07:57:19.586957+0000","last_fullsized":"2024-09-16T07:57:19.586957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.557127+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:21.557127+0000","last_peered":"2024-09-16T07:57:21.557127+0000","last_clean":"2024-09-16T07:57:21.557127+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:21.557127+0000","last_undegraded":"2024-09-16T07:57:21.557127+0000","last_fullsized":"2024-09-16T07:57:21.557127+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.682216+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:21.682216+0000","last_peered":"2024-09-16T07:57:21.682216+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:21.682216+0000","last_undegraded":"2024-09-16T07:57:21.682216+0000","last_fullsized":"2024-09-16T07:57:21.682216+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'59","reported_seq":71,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.670887+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:28.670887+0000","last_peered":"2024-09-16T07:57:28.670887+0000","last_clean":"2024-09-16T07:57:28.670887+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:28.670887+0000","last_undegraded":"2024-09-16T07:57:28.670887+0000","last_fullsized":"2024-09-16T07:57:28.670887+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.546751+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:22.546751+0000","last_peered":"2024-09-16T07:57:22.546751+0000","last_clean":"2024-09-16T07:57:22.546751+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:22.546751+0000","last_undegraded":"2024-09-16T07:57:22.546751+0000","last_fullsized":"2024-09-16T07:57:22.546751+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"132'135","reported_seq":147,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.079236+0000","last_change":"2024-09-16T07:57:21.653427+0000","last_active":"2024-09-16T07:57:33.079236+0000","last_peered":"2024-09-16T07:57:33.079236+0000","last_clean":"2024-09-16T07:57:33.079236+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:57:33.079236+0000","last_undegraded":"2024-09-16T07:57:33.079236+0000","last_fullsized":"2024-09-16T07:57:33.079236+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"132'111","reported_seq":123,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:32.706917+0000","last_change":"2024-09-16T07:57:21.704210+0000","last_active":"2024-09-16T07:57:32.706917+0000","last_peered":"2024-09-16T07:57:32.706917+0000","last_clean":"2024-09-16T07:57:32.706917+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:57:32.706917+0000","last_undegraded":"2024-09-16T07:57:32.706917+0000","last_fullsized":"2024-09-16T07:57:32.706917+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":318,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.556141+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:19.556141+0000","last_peered":"2024-09-16T07:57:19.556141+0000","last_clean":"2024-09-16T07:57:19.556141+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:19.556141+0000","last_undegraded":"2024-09-16T07:57:19.556141+0000","last_fullsized":"2024-09-16T07:57:19.556141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":74645504,"num_objects":1139,"num_object_clones":0,"num_object_copies":3417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10805248,"data_stored":172883968,"data_compressed":8207776,"data_compressed_allocated":10805248,"data_compressed_original":172883968,"omap_allocated":0,"internal_metadata":0},"log_size":1139,"ondisk_log_size":1139,"up":36,"acting":36,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68396,"kb_used_data":8220,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94303444,"statfs":{"total":96636764160,"available":96566726656,"internally_reserved":0,"allocated":8417280,"data_stored":117102955,"data_compressed":5540355,"data_compressed_allocated":7294976,"data_compressed_original":116637696,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33060,"kb_used_data":3916,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":4009984,"data_stored":46520702,"data_compressed":2189127,"data_compressed_allocated":2883584,"data_compressed_original":46055424,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42340,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":1069056,"data_stored":434127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29820,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94342020,"statfs":{"total":96636764160,"available":96606228480,"internally_reserved":0,"allocated":1159168,"data_stored":1035084,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7852032,"data_stored":125632512,"data_compressed":5964666,"data_compressed_allocated":7852032,"data_compressed_original":125632512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:36.624 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 14 16 2712 2696 12.0347 11.4375 0.0843395 0.0828336 2024-09-16T07:57:37.123 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:57:37.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:37.293+0000 7fc720911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:37.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:37.301+0000 7fc720911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:37.624 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 15 16 2903 2887 12.0281 11.9375 0.112917 0.0827814 2024-09-16T07:57:38.624 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 16 16 3087 3071 11.9951 11.5 0.0875153 0.0830894 2024-09-16T07:57:39.387 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:39.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:39.533+0000 7fe0c5b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:39.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:39.545+0000 7fe0c5b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:39.624 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 17 16 3253 3237 11.8997 10.375 0.109906 0.083825 2024-09-16T07:57:39.760 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:57:39.850 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:39.850 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:39.874 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":501,"stamp":"2024-09-16T07:57:38.453480+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75235880,"num_objects":1143,"num_object_clones":0,"num_object_copies":3429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1219,"num_write_kb":74003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":63,"acting":63,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":173616,"kb_used_data":14312,"kb_used_omap":0,"kb_used_meta":159232,"kb_avail":377313744,"statfs":{"total":386547056640,"available":386369273856,"internally_reserved":0,"allocated":14655488,"data_stored":165092868,"data_compressed":7759523,"data_compressed_allocated":10219520,"data_compressed_original":163266560,"omap_allocated":0,"internal_metadata":163053568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":74645504,"num_objects":1139,"num_object_clones":0,"num_object_copies":3417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002661"},"pg_stats":[{"pgid":"7.f","version":"132'123","reported_seq":135,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.032215+0000","last_change":"2024-09-16T07:57:21.677659+0000","last_active":"2024-09-16T07:57:33.032215+0000","last_peered":"2024-09-16T07:57:33.032215+0000","last_clean":"2024-09-16T07:57:33.032215+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:57:33.032215+0000","last_undegraded":"2024-09-16T07:57:33.032215+0000","last_fullsized":"2024-09-16T07:57:33.032215+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"132'83","reported_seq":95,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.659615+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:28.659615+0000","last_peered":"2024-09-16T07:57:28.659615+0000","last_clean":"2024-09-16T07:57:28.659615+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:28.659615+0000","last_undegraded":"2024-09-16T07:57:28.659615+0000","last_fullsized":"2024-09-16T07:57:28.659615+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'79","reported_seq":91,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.752077+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:28.752077+0000","last_peered":"2024-09-16T07:57:28.752077+0000","last_clean":"2024-09-16T07:57:28.752077+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:28.752077+0000","last_undegraded":"2024-09-16T07:57:28.752077+0000","last_fullsized":"2024-09-16T07:57:28.752077+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"132'122","reported_seq":134,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.117306+0000","last_change":"2024-09-16T07:57:21.747923+0000","last_active":"2024-09-16T07:57:33.117306+0000","last_peered":"2024-09-16T07:57:33.117306+0000","last_clean":"2024-09-16T07:57:33.117306+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:57:33.117306+0000","last_undegraded":"2024-09-16T07:57:33.117306+0000","last_fullsized":"2024-09-16T07:57:33.117306+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"132'131","reported_seq":143,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.008158+0000","last_change":"2024-09-16T07:57:21.678939+0000","last_active":"2024-09-16T07:57:33.008158+0000","last_peered":"2024-09-16T07:57:33.008158+0000","last_clean":"2024-09-16T07:57:33.008158+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:57:33.008158+0000","last_undegraded":"2024-09-16T07:57:33.008158+0000","last_fullsized":"2024-09-16T07:57:33.008158+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"132'84","reported_seq":96,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.656905+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:28.656905+0000","last_peered":"2024-09-16T07:57:28.656905+0000","last_clean":"2024-09-16T07:57:28.656905+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:28.656905+0000","last_undegraded":"2024-09-16T07:57:28.656905+0000","last_fullsized":"2024-09-16T07:57:28.656905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"132'119","reported_seq":131,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.036329+0000","last_change":"2024-09-16T07:57:21.700152+0000","last_active":"2024-09-16T07:57:33.036329+0000","last_peered":"2024-09-16T07:57:33.036329+0000","last_clean":"2024-09-16T07:57:33.036329+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:57:33.036329+0000","last_undegraded":"2024-09-16T07:57:33.036329+0000","last_fullsized":"2024-09-16T07:57:33.036329+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":397,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545175+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:22.545175+0000","last_peered":"2024-09-16T07:57:22.545175+0000","last_clean":"2024-09-16T07:57:22.545175+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:22.545175+0000","last_undegraded":"2024-09-16T07:57:22.545175+0000","last_fullsized":"2024-09-16T07:57:22.545175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":325,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.542967+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:19.542967+0000","last_peered":"2024-09-16T07:57:19.542967+0000","last_clean":"2024-09-16T07:57:19.542967+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:19.542967+0000","last_undegraded":"2024-09-16T07:57:19.542967+0000","last_fullsized":"2024-09-16T07:57:19.542967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.544627+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:21.544627+0000","last_peered":"2024-09-16T07:57:21.544627+0000","last_clean":"2024-09-16T07:57:21.544627+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:21.544627+0000","last_undegraded":"2024-09-16T07:57:21.544627+0000","last_fullsized":"2024-09-16T07:57:21.544627+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'93","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.722433+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:28.722433+0000","last_peered":"2024-09-16T07:57:28.722433+0000","last_clean":"2024-09-16T07:57:28.722433+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:28.722433+0000","last_undegraded":"2024-09-16T07:57:28.722433+0000","last_fullsized":"2024-09-16T07:57:28.722433+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":306,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.586957+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:19.586957+0000","last_peered":"2024-09-16T07:57:19.586957+0000","last_clean":"2024-09-16T07:57:19.586957+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:19.586957+0000","last_undegraded":"2024-09-16T07:57:19.586957+0000","last_fullsized":"2024-09-16T07:57:19.586957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.557127+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:21.557127+0000","last_peered":"2024-09-16T07:57:21.557127+0000","last_clean":"2024-09-16T07:57:21.557127+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:21.557127+0000","last_undegraded":"2024-09-16T07:57:21.557127+0000","last_fullsized":"2024-09-16T07:57:21.557127+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.682216+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:21.682216+0000","last_peered":"2024-09-16T07:57:21.682216+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:21.682216+0000","last_undegraded":"2024-09-16T07:57:21.682216+0000","last_fullsized":"2024-09-16T07:57:21.682216+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'59","reported_seq":71,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.670887+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:28.670887+0000","last_peered":"2024-09-16T07:57:28.670887+0000","last_clean":"2024-09-16T07:57:28.670887+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:28.670887+0000","last_undegraded":"2024-09-16T07:57:28.670887+0000","last_fullsized":"2024-09-16T07:57:28.670887+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.546751+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:22.546751+0000","last_peered":"2024-09-16T07:57:22.546751+0000","last_clean":"2024-09-16T07:57:22.546751+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:22.546751+0000","last_undegraded":"2024-09-16T07:57:22.546751+0000","last_fullsized":"2024-09-16T07:57:22.546751+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"132'135","reported_seq":147,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.079236+0000","last_change":"2024-09-16T07:57:21.653427+0000","last_active":"2024-09-16T07:57:33.079236+0000","last_peered":"2024-09-16T07:57:33.079236+0000","last_clean":"2024-09-16T07:57:33.079236+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:57:33.079236+0000","last_undegraded":"2024-09-16T07:57:33.079236+0000","last_fullsized":"2024-09-16T07:57:33.079236+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"132'111","reported_seq":123,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:32.706917+0000","last_change":"2024-09-16T07:57:21.704210+0000","last_active":"2024-09-16T07:57:32.706917+0000","last_peered":"2024-09-16T07:57:32.706917+0000","last_clean":"2024-09-16T07:57:32.706917+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:57:32.706917+0000","last_undegraded":"2024-09-16T07:57:32.706917+0000","last_fullsized":"2024-09-16T07:57:32.706917+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":318,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.556141+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:19.556141+0000","last_peered":"2024-09-16T07:57:19.556141+0000","last_clean":"2024-09-16T07:57:19.556141+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:19.556141+0000","last_undegraded":"2024-09-16T07:57:19.556141+0000","last_fullsized":"2024-09-16T07:57:19.556141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":74645504,"num_objects":1139,"num_object_clones":0,"num_object_copies":3417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10805248,"data_stored":172883968,"data_compressed":8207776,"data_compressed_allocated":10805248,"data_compressed_original":172883968,"omap_allocated":0,"internal_metadata":0},"log_size":1139,"ondisk_log_size":1139,"up":36,"acting":36,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68396,"kb_used_data":8220,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94303444,"statfs":{"total":96636764160,"available":96566726656,"internally_reserved":0,"allocated":8417280,"data_stored":117102955,"data_compressed":5540355,"data_compressed_allocated":7294976,"data_compressed_original":116637696,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33060,"kb_used_data":3916,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":4009984,"data_stored":46520702,"data_compressed":2189127,"data_compressed_allocated":2883584,"data_compressed_original":46055424,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42340,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":1069056,"data_stored":434127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29820,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94342020,"statfs":{"total":96636764160,"available":96606228480,"internally_reserved":0,"allocated":1159168,"data_stored":1035084,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7852032,"data_stored":125632512,"data_compressed":5964666,"data_compressed_allocated":7852032,"data_compressed_original":125632512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:39.876 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:57:39.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:39.911+0000 7fa468791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:39.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:39.919+0000 7fa468791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:40.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:40.011+0000 7f2b49f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:40.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:40.020+0000 7f2b49f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:40.513 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:40.514 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":762,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":132,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473411,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":21},{"state_name":"unknown","count":4}],"num_pgs":25,"num_pools":3,"num_objects":1143,"data_bytes":75235880,"bytes_used":177782784,"bytes_avail":386369273856,"bytes_total":386547056640,"unknown_pgs_ratio":0.15999999642372131,"write_bytes_sec":6219079,"read_op_per_sec":0,"write_op_per_sec":94},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:57:40.534 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:57:40.534 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:40.624 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 18 16 3404 3388 11.7629 9.4375 0.0584172 0.0846604 2024-09-16T07:57:40.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:40.686+0000 7fe61cb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:40.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:40.697+0000 7fe61cb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:40.997 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:40.998 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:41.014 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":502,"stamp":"2024-09-16T07:57:40.453928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75235880,"num_objects":1143,"num_object_clones":0,"num_object_copies":3429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1219,"num_write_kb":74003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":63,"acting":63,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":173616,"kb_used_data":14312,"kb_used_omap":0,"kb_used_meta":159232,"kb_avail":377313744,"statfs":{"total":386547056640,"available":386369273856,"internally_reserved":0,"allocated":14655488,"data_stored":165092868,"data_compressed":7759523,"data_compressed_allocated":10219520,"data_compressed_original":163266560,"omap_allocated":0,"internal_metadata":163053568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":74645504,"num_objects":1139,"num_object_clones":0,"num_object_copies":3417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002684"},"pg_stats":[{"pgid":"7.f","version":"132'123","reported_seq":135,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.032215+0000","last_change":"2024-09-16T07:57:21.677659+0000","last_active":"2024-09-16T07:57:33.032215+0000","last_peered":"2024-09-16T07:57:33.032215+0000","last_clean":"2024-09-16T07:57:33.032215+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:57:33.032215+0000","last_undegraded":"2024-09-16T07:57:33.032215+0000","last_fullsized":"2024-09-16T07:57:33.032215+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"132'83","reported_seq":95,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.659615+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:28.659615+0000","last_peered":"2024-09-16T07:57:28.659615+0000","last_clean":"2024-09-16T07:57:28.659615+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:28.659615+0000","last_undegraded":"2024-09-16T07:57:28.659615+0000","last_fullsized":"2024-09-16T07:57:28.659615+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'79","reported_seq":91,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.752077+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:28.752077+0000","last_peered":"2024-09-16T07:57:28.752077+0000","last_clean":"2024-09-16T07:57:28.752077+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:28.752077+0000","last_undegraded":"2024-09-16T07:57:28.752077+0000","last_fullsized":"2024-09-16T07:57:28.752077+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"132'122","reported_seq":134,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.117306+0000","last_change":"2024-09-16T07:57:21.747923+0000","last_active":"2024-09-16T07:57:33.117306+0000","last_peered":"2024-09-16T07:57:33.117306+0000","last_clean":"2024-09-16T07:57:33.117306+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:57:33.117306+0000","last_undegraded":"2024-09-16T07:57:33.117306+0000","last_fullsized":"2024-09-16T07:57:33.117306+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"132'131","reported_seq":143,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.008158+0000","last_change":"2024-09-16T07:57:21.678939+0000","last_active":"2024-09-16T07:57:33.008158+0000","last_peered":"2024-09-16T07:57:33.008158+0000","last_clean":"2024-09-16T07:57:33.008158+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:57:33.008158+0000","last_undegraded":"2024-09-16T07:57:33.008158+0000","last_fullsized":"2024-09-16T07:57:33.008158+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"132'84","reported_seq":96,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.656905+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:28.656905+0000","last_peered":"2024-09-16T07:57:28.656905+0000","last_clean":"2024-09-16T07:57:28.656905+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:28.656905+0000","last_undegraded":"2024-09-16T07:57:28.656905+0000","last_fullsized":"2024-09-16T07:57:28.656905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"132'119","reported_seq":131,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.036329+0000","last_change":"2024-09-16T07:57:21.700152+0000","last_active":"2024-09-16T07:57:33.036329+0000","last_peered":"2024-09-16T07:57:33.036329+0000","last_clean":"2024-09-16T07:57:33.036329+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:57:33.036329+0000","last_undegraded":"2024-09-16T07:57:33.036329+0000","last_fullsized":"2024-09-16T07:57:33.036329+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":397,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545175+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:22.545175+0000","last_peered":"2024-09-16T07:57:22.545175+0000","last_clean":"2024-09-16T07:57:22.545175+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:22.545175+0000","last_undegraded":"2024-09-16T07:57:22.545175+0000","last_fullsized":"2024-09-16T07:57:22.545175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":325,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.542967+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:19.542967+0000","last_peered":"2024-09-16T07:57:19.542967+0000","last_clean":"2024-09-16T07:57:19.542967+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:19.542967+0000","last_undegraded":"2024-09-16T07:57:19.542967+0000","last_fullsized":"2024-09-16T07:57:19.542967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.544627+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:21.544627+0000","last_peered":"2024-09-16T07:57:21.544627+0000","last_clean":"2024-09-16T07:57:21.544627+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:21.544627+0000","last_undegraded":"2024-09-16T07:57:21.544627+0000","last_fullsized":"2024-09-16T07:57:21.544627+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'93","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.722433+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:28.722433+0000","last_peered":"2024-09-16T07:57:28.722433+0000","last_clean":"2024-09-16T07:57:28.722433+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:28.722433+0000","last_undegraded":"2024-09-16T07:57:28.722433+0000","last_fullsized":"2024-09-16T07:57:28.722433+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":306,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.586957+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:19.586957+0000","last_peered":"2024-09-16T07:57:19.586957+0000","last_clean":"2024-09-16T07:57:19.586957+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:19.586957+0000","last_undegraded":"2024-09-16T07:57:19.586957+0000","last_fullsized":"2024-09-16T07:57:19.586957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.557127+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:21.557127+0000","last_peered":"2024-09-16T07:57:21.557127+0000","last_clean":"2024-09-16T07:57:21.557127+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:21.557127+0000","last_undegraded":"2024-09-16T07:57:21.557127+0000","last_fullsized":"2024-09-16T07:57:21.557127+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.682216+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:21.682216+0000","last_peered":"2024-09-16T07:57:21.682216+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:21.682216+0000","last_undegraded":"2024-09-16T07:57:21.682216+0000","last_fullsized":"2024-09-16T07:57:21.682216+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'59","reported_seq":71,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.670887+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:28.670887+0000","last_peered":"2024-09-16T07:57:28.670887+0000","last_clean":"2024-09-16T07:57:28.670887+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:28.670887+0000","last_undegraded":"2024-09-16T07:57:28.670887+0000","last_fullsized":"2024-09-16T07:57:28.670887+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.546751+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:22.546751+0000","last_peered":"2024-09-16T07:57:22.546751+0000","last_clean":"2024-09-16T07:57:22.546751+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:22.546751+0000","last_undegraded":"2024-09-16T07:57:22.546751+0000","last_fullsized":"2024-09-16T07:57:22.546751+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"132'135","reported_seq":147,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.079236+0000","last_change":"2024-09-16T07:57:21.653427+0000","last_active":"2024-09-16T07:57:33.079236+0000","last_peered":"2024-09-16T07:57:33.079236+0000","last_clean":"2024-09-16T07:57:33.079236+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:57:33.079236+0000","last_undegraded":"2024-09-16T07:57:33.079236+0000","last_fullsized":"2024-09-16T07:57:33.079236+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"132'111","reported_seq":123,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:32.706917+0000","last_change":"2024-09-16T07:57:21.704210+0000","last_active":"2024-09-16T07:57:32.706917+0000","last_peered":"2024-09-16T07:57:32.706917+0000","last_clean":"2024-09-16T07:57:32.706917+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:57:32.706917+0000","last_undegraded":"2024-09-16T07:57:32.706917+0000","last_fullsized":"2024-09-16T07:57:32.706917+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":318,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.556141+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:19.556141+0000","last_peered":"2024-09-16T07:57:19.556141+0000","last_clean":"2024-09-16T07:57:19.556141+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:19.556141+0000","last_undegraded":"2024-09-16T07:57:19.556141+0000","last_fullsized":"2024-09-16T07:57:19.556141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":74645504,"num_objects":1139,"num_object_clones":0,"num_object_copies":3417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10805248,"data_stored":172883968,"data_compressed":8207776,"data_compressed_allocated":10805248,"data_compressed_original":172883968,"omap_allocated":0,"internal_metadata":0},"log_size":1139,"ondisk_log_size":1139,"up":36,"acting":36,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68396,"kb_used_data":8220,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94303444,"statfs":{"total":96636764160,"available":96566726656,"internally_reserved":0,"allocated":8417280,"data_stored":117102955,"data_compressed":5540355,"data_compressed_allocated":7294976,"data_compressed_original":116637696,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33060,"kb_used_data":3916,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":4009984,"data_stored":46520702,"data_compressed":2189127,"data_compressed_allocated":2883584,"data_compressed_original":46055424,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42340,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":1069056,"data_stored":434127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29820,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94342020,"statfs":{"total":96636764160,"available":96606228480,"internally_reserved":0,"allocated":1159168,"data_stored":1035084,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7852032,"data_stored":125632512,"data_compressed":5964666,"data_compressed_allocated":7852032,"data_compressed_original":125632512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:41.624 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 19 16 3592 3576 11.7621 11.75 0.0548776 0.0848233 2024-09-16T07:57:42.211 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:57:42.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:42.367+0000 7f258fec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:42.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:42.374+0000 7f258fec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:42.624 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:57:42.626535+0000 min lat: 0.0156257 max lat: 0.259311 avg lat: 0.0847122 2024-09-16T07:57:42.625 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:57:42.625 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 20 16 3787 3771 11.7833 12.1875 0.107407 0.0847122 2024-09-16T07:57:43.624 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 21 16 3965 3949 11.7519 11.125 0.0811548 0.0849229 2024-09-16T07:57:44.016 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:44.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:44.171+0000 7f2ed0991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:44.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:44.184+0000 7f2ed0991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:44.441 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:44.441 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:44.457 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":503,"stamp":"2024-09-16T07:57:42.454320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75235880,"num_objects":1143,"num_object_clones":0,"num_object_copies":3429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1219,"num_write_kb":74003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":63,"acting":63,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":173616,"kb_used_data":14312,"kb_used_omap":0,"kb_used_meta":159232,"kb_avail":377313744,"statfs":{"total":386547056640,"available":386369273856,"internally_reserved":0,"allocated":14655488,"data_stored":165092868,"data_compressed":7759523,"data_compressed_allocated":10219520,"data_compressed_original":163266560,"omap_allocated":0,"internal_metadata":163053568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48562176,"num_objects":741,"num_object_clones":0,"num_object_copies":2223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":741,"num_write_kb":47424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002607"},"pg_stats":[{"pgid":"7.f","version":"132'123","reported_seq":135,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.032215+0000","last_change":"2024-09-16T07:57:21.677659+0000","last_active":"2024-09-16T07:57:33.032215+0000","last_peered":"2024-09-16T07:57:33.032215+0000","last_clean":"2024-09-16T07:57:33.032215+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:57:33.032215+0000","last_undegraded":"2024-09-16T07:57:33.032215+0000","last_fullsized":"2024-09-16T07:57:33.032215+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"132'83","reported_seq":95,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.659615+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:28.659615+0000","last_peered":"2024-09-16T07:57:28.659615+0000","last_clean":"2024-09-16T07:57:28.659615+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:28.659615+0000","last_undegraded":"2024-09-16T07:57:28.659615+0000","last_fullsized":"2024-09-16T07:57:28.659615+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'79","reported_seq":91,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.752077+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:28.752077+0000","last_peered":"2024-09-16T07:57:28.752077+0000","last_clean":"2024-09-16T07:57:28.752077+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:28.752077+0000","last_undegraded":"2024-09-16T07:57:28.752077+0000","last_fullsized":"2024-09-16T07:57:28.752077+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"132'122","reported_seq":134,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.117306+0000","last_change":"2024-09-16T07:57:21.747923+0000","last_active":"2024-09-16T07:57:33.117306+0000","last_peered":"2024-09-16T07:57:33.117306+0000","last_clean":"2024-09-16T07:57:33.117306+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:57:33.117306+0000","last_undegraded":"2024-09-16T07:57:33.117306+0000","last_fullsized":"2024-09-16T07:57:33.117306+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"132'131","reported_seq":143,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.008158+0000","last_change":"2024-09-16T07:57:21.678939+0000","last_active":"2024-09-16T07:57:33.008158+0000","last_peered":"2024-09-16T07:57:33.008158+0000","last_clean":"2024-09-16T07:57:33.008158+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:57:33.008158+0000","last_undegraded":"2024-09-16T07:57:33.008158+0000","last_fullsized":"2024-09-16T07:57:33.008158+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"132'84","reported_seq":96,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.656905+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:28.656905+0000","last_peered":"2024-09-16T07:57:28.656905+0000","last_clean":"2024-09-16T07:57:28.656905+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:28.656905+0000","last_undegraded":"2024-09-16T07:57:28.656905+0000","last_fullsized":"2024-09-16T07:57:28.656905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"132'119","reported_seq":131,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.036329+0000","last_change":"2024-09-16T07:57:21.700152+0000","last_active":"2024-09-16T07:57:33.036329+0000","last_peered":"2024-09-16T07:57:33.036329+0000","last_clean":"2024-09-16T07:57:33.036329+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:57:33.036329+0000","last_undegraded":"2024-09-16T07:57:33.036329+0000","last_fullsized":"2024-09-16T07:57:33.036329+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":397,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545175+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:22.545175+0000","last_peered":"2024-09-16T07:57:22.545175+0000","last_clean":"2024-09-16T07:57:22.545175+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:22.545175+0000","last_undegraded":"2024-09-16T07:57:22.545175+0000","last_fullsized":"2024-09-16T07:57:22.545175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":325,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.542967+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:19.542967+0000","last_peered":"2024-09-16T07:57:19.542967+0000","last_clean":"2024-09-16T07:57:19.542967+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:19.542967+0000","last_undegraded":"2024-09-16T07:57:19.542967+0000","last_fullsized":"2024-09-16T07:57:19.542967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.544627+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:21.544627+0000","last_peered":"2024-09-16T07:57:21.544627+0000","last_clean":"2024-09-16T07:57:21.544627+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:21.544627+0000","last_undegraded":"2024-09-16T07:57:21.544627+0000","last_fullsized":"2024-09-16T07:57:21.544627+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'93","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.722433+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:28.722433+0000","last_peered":"2024-09-16T07:57:28.722433+0000","last_clean":"2024-09-16T07:57:28.722433+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:28.722433+0000","last_undegraded":"2024-09-16T07:57:28.722433+0000","last_fullsized":"2024-09-16T07:57:28.722433+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":306,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.586957+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:19.586957+0000","last_peered":"2024-09-16T07:57:19.586957+0000","last_clean":"2024-09-16T07:57:19.586957+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:19.586957+0000","last_undegraded":"2024-09-16T07:57:19.586957+0000","last_fullsized":"2024-09-16T07:57:19.586957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.557127+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:21.557127+0000","last_peered":"2024-09-16T07:57:21.557127+0000","last_clean":"2024-09-16T07:57:21.557127+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:21.557127+0000","last_undegraded":"2024-09-16T07:57:21.557127+0000","last_fullsized":"2024-09-16T07:57:21.557127+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.682216+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:21.682216+0000","last_peered":"2024-09-16T07:57:21.682216+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:21.682216+0000","last_undegraded":"2024-09-16T07:57:21.682216+0000","last_fullsized":"2024-09-16T07:57:21.682216+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'59","reported_seq":71,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.670887+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:28.670887+0000","last_peered":"2024-09-16T07:57:28.670887+0000","last_clean":"2024-09-16T07:57:28.670887+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:28.670887+0000","last_undegraded":"2024-09-16T07:57:28.670887+0000","last_fullsized":"2024-09-16T07:57:28.670887+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.546751+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:22.546751+0000","last_peered":"2024-09-16T07:57:22.546751+0000","last_clean":"2024-09-16T07:57:22.546751+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:22.546751+0000","last_undegraded":"2024-09-16T07:57:22.546751+0000","last_fullsized":"2024-09-16T07:57:22.546751+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"132'135","reported_seq":147,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.079236+0000","last_change":"2024-09-16T07:57:21.653427+0000","last_active":"2024-09-16T07:57:33.079236+0000","last_peered":"2024-09-16T07:57:33.079236+0000","last_clean":"2024-09-16T07:57:33.079236+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:57:33.079236+0000","last_undegraded":"2024-09-16T07:57:33.079236+0000","last_fullsized":"2024-09-16T07:57:33.079236+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"132'111","reported_seq":123,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:32.706917+0000","last_change":"2024-09-16T07:57:21.704210+0000","last_active":"2024-09-16T07:57:32.706917+0000","last_peered":"2024-09-16T07:57:32.706917+0000","last_clean":"2024-09-16T07:57:32.706917+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:57:32.706917+0000","last_undegraded":"2024-09-16T07:57:32.706917+0000","last_fullsized":"2024-09-16T07:57:32.706917+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":318,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.556141+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:19.556141+0000","last_peered":"2024-09-16T07:57:19.556141+0000","last_clean":"2024-09-16T07:57:19.556141+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:19.556141+0000","last_undegraded":"2024-09-16T07:57:19.556141+0000","last_fullsized":"2024-09-16T07:57:19.556141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":74645504,"num_objects":1139,"num_object_clones":0,"num_object_copies":3417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10805248,"data_stored":172883968,"data_compressed":8207776,"data_compressed_allocated":10805248,"data_compressed_original":172883968,"omap_allocated":0,"internal_metadata":0},"log_size":1139,"ondisk_log_size":1139,"up":36,"acting":36,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68396,"kb_used_data":8220,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94303444,"statfs":{"total":96636764160,"available":96566726656,"internally_reserved":0,"allocated":8417280,"data_stored":117102955,"data_compressed":5540355,"data_compressed_allocated":7294976,"data_compressed_original":116637696,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33060,"kb_used_data":3916,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":4009984,"data_stored":46520702,"data_compressed":2189127,"data_compressed_allocated":2883584,"data_compressed_original":46055424,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42340,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":1069056,"data_stored":434127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29820,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94342020,"statfs":{"total":96636764160,"available":96606228480,"internally_reserved":0,"allocated":1159168,"data_stored":1035084,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7852032,"data_stored":125632512,"data_compressed":5964666,"data_compressed_allocated":7852032,"data_compressed_original":125632512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:44.459 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:57:44.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:44.605+0000 7f9768551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:44.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:44.615+0000 7f9768551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:44.624 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 22 16 4159 4143 11.7688 12.125 0.135775 0.0848079 2024-09-16T07:57:44.687 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:57:44.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:44.847+0000 7f93e8591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:44.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:44.855+0000 7f93e8591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:45.017 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:45.017 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":767,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":132,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473411,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":21},{"state_name":"unknown","count":4}],"num_pgs":25,"num_pools":3,"num_objects":1143,"data_bytes":75235880,"bytes_used":177782784,"bytes_avail":386369273856,"bytes_total":386547056640,"unknown_pgs_ratio":0.15999999642372131,"write_bytes_sec":4045968,"read_op_per_sec":0,"write_op_per_sec":61},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:57:45.035 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:57:45.036 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:45.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:45.192+0000 7f8c7df11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:45.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:45.205+0000 7f8c7df11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:45.485 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:45.485 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:45.507 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":504,"stamp":"2024-09-16T07:57:44.454749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75235880,"num_objects":1143,"num_object_clones":0,"num_object_copies":3429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1219,"num_write_kb":74003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":63,"acting":63,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":173616,"kb_used_data":14312,"kb_used_omap":0,"kb_used_meta":159232,"kb_avail":377313744,"statfs":{"total":386547056640,"available":386369273856,"internally_reserved":0,"allocated":14655488,"data_stored":165092868,"data_compressed":7759523,"data_compressed_allocated":10219520,"data_compressed_original":163266560,"omap_allocated":0,"internal_metadata":163053568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48562176,"num_objects":741,"num_object_clones":0,"num_object_copies":2223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":741,"num_write_kb":47424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002599"},"pg_stats":[{"pgid":"7.f","version":"132'123","reported_seq":135,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.032215+0000","last_change":"2024-09-16T07:57:21.677659+0000","last_active":"2024-09-16T07:57:33.032215+0000","last_peered":"2024-09-16T07:57:33.032215+0000","last_clean":"2024-09-16T07:57:33.032215+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:57:33.032215+0000","last_undegraded":"2024-09-16T07:57:33.032215+0000","last_fullsized":"2024-09-16T07:57:33.032215+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"132'83","reported_seq":95,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.659615+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:28.659615+0000","last_peered":"2024-09-16T07:57:28.659615+0000","last_clean":"2024-09-16T07:57:28.659615+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:28.659615+0000","last_undegraded":"2024-09-16T07:57:28.659615+0000","last_fullsized":"2024-09-16T07:57:28.659615+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'79","reported_seq":91,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.752077+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:28.752077+0000","last_peered":"2024-09-16T07:57:28.752077+0000","last_clean":"2024-09-16T07:57:28.752077+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:28.752077+0000","last_undegraded":"2024-09-16T07:57:28.752077+0000","last_fullsized":"2024-09-16T07:57:28.752077+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"132'122","reported_seq":134,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.117306+0000","last_change":"2024-09-16T07:57:21.747923+0000","last_active":"2024-09-16T07:57:33.117306+0000","last_peered":"2024-09-16T07:57:33.117306+0000","last_clean":"2024-09-16T07:57:33.117306+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:57:33.117306+0000","last_undegraded":"2024-09-16T07:57:33.117306+0000","last_fullsized":"2024-09-16T07:57:33.117306+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"132'131","reported_seq":143,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.008158+0000","last_change":"2024-09-16T07:57:21.678939+0000","last_active":"2024-09-16T07:57:33.008158+0000","last_peered":"2024-09-16T07:57:33.008158+0000","last_clean":"2024-09-16T07:57:33.008158+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:57:33.008158+0000","last_undegraded":"2024-09-16T07:57:33.008158+0000","last_fullsized":"2024-09-16T07:57:33.008158+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"132'84","reported_seq":96,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.656905+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:28.656905+0000","last_peered":"2024-09-16T07:57:28.656905+0000","last_clean":"2024-09-16T07:57:28.656905+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:28.656905+0000","last_undegraded":"2024-09-16T07:57:28.656905+0000","last_fullsized":"2024-09-16T07:57:28.656905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"132'119","reported_seq":131,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.036329+0000","last_change":"2024-09-16T07:57:21.700152+0000","last_active":"2024-09-16T07:57:33.036329+0000","last_peered":"2024-09-16T07:57:33.036329+0000","last_clean":"2024-09-16T07:57:33.036329+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:57:33.036329+0000","last_undegraded":"2024-09-16T07:57:33.036329+0000","last_fullsized":"2024-09-16T07:57:33.036329+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":397,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545175+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:22.545175+0000","last_peered":"2024-09-16T07:57:22.545175+0000","last_clean":"2024-09-16T07:57:22.545175+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:22.545175+0000","last_undegraded":"2024-09-16T07:57:22.545175+0000","last_fullsized":"2024-09-16T07:57:22.545175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":325,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.542967+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:19.542967+0000","last_peered":"2024-09-16T07:57:19.542967+0000","last_clean":"2024-09-16T07:57:19.542967+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:19.542967+0000","last_undegraded":"2024-09-16T07:57:19.542967+0000","last_fullsized":"2024-09-16T07:57:19.542967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.544627+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:21.544627+0000","last_peered":"2024-09-16T07:57:21.544627+0000","last_clean":"2024-09-16T07:57:21.544627+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:21.544627+0000","last_undegraded":"2024-09-16T07:57:21.544627+0000","last_fullsized":"2024-09-16T07:57:21.544627+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'93","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.722433+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:28.722433+0000","last_peered":"2024-09-16T07:57:28.722433+0000","last_clean":"2024-09-16T07:57:28.722433+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:28.722433+0000","last_undegraded":"2024-09-16T07:57:28.722433+0000","last_fullsized":"2024-09-16T07:57:28.722433+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":306,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.586957+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:19.586957+0000","last_peered":"2024-09-16T07:57:19.586957+0000","last_clean":"2024-09-16T07:57:19.586957+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:19.586957+0000","last_undegraded":"2024-09-16T07:57:19.586957+0000","last_fullsized":"2024-09-16T07:57:19.586957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.557127+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:21.557127+0000","last_peered":"2024-09-16T07:57:21.557127+0000","last_clean":"2024-09-16T07:57:21.557127+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:21.557127+0000","last_undegraded":"2024-09-16T07:57:21.557127+0000","last_fullsized":"2024-09-16T07:57:21.557127+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.682216+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:21.682216+0000","last_peered":"2024-09-16T07:57:21.682216+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:21.682216+0000","last_undegraded":"2024-09-16T07:57:21.682216+0000","last_fullsized":"2024-09-16T07:57:21.682216+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'59","reported_seq":71,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.670887+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:28.670887+0000","last_peered":"2024-09-16T07:57:28.670887+0000","last_clean":"2024-09-16T07:57:28.670887+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:28.670887+0000","last_undegraded":"2024-09-16T07:57:28.670887+0000","last_fullsized":"2024-09-16T07:57:28.670887+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.546751+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:22.546751+0000","last_peered":"2024-09-16T07:57:22.546751+0000","last_clean":"2024-09-16T07:57:22.546751+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:22.546751+0000","last_undegraded":"2024-09-16T07:57:22.546751+0000","last_fullsized":"2024-09-16T07:57:22.546751+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"132'135","reported_seq":147,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.079236+0000","last_change":"2024-09-16T07:57:21.653427+0000","last_active":"2024-09-16T07:57:33.079236+0000","last_peered":"2024-09-16T07:57:33.079236+0000","last_clean":"2024-09-16T07:57:33.079236+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:57:33.079236+0000","last_undegraded":"2024-09-16T07:57:33.079236+0000","last_fullsized":"2024-09-16T07:57:33.079236+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"132'111","reported_seq":123,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:32.706917+0000","last_change":"2024-09-16T07:57:21.704210+0000","last_active":"2024-09-16T07:57:32.706917+0000","last_peered":"2024-09-16T07:57:32.706917+0000","last_clean":"2024-09-16T07:57:32.706917+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:57:32.706917+0000","last_undegraded":"2024-09-16T07:57:32.706917+0000","last_fullsized":"2024-09-16T07:57:32.706917+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":318,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.556141+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:19.556141+0000","last_peered":"2024-09-16T07:57:19.556141+0000","last_clean":"2024-09-16T07:57:19.556141+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:19.556141+0000","last_undegraded":"2024-09-16T07:57:19.556141+0000","last_fullsized":"2024-09-16T07:57:19.556141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":74645504,"num_objects":1139,"num_object_clones":0,"num_object_copies":3417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10805248,"data_stored":172883968,"data_compressed":8207776,"data_compressed_allocated":10805248,"data_compressed_original":172883968,"omap_allocated":0,"internal_metadata":0},"log_size":1139,"ondisk_log_size":1139,"up":36,"acting":36,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68396,"kb_used_data":8220,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94303444,"statfs":{"total":96636764160,"available":96566726656,"internally_reserved":0,"allocated":8417280,"data_stored":117102955,"data_compressed":5540355,"data_compressed_allocated":7294976,"data_compressed_original":116637696,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33060,"kb_used_data":3916,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":4009984,"data_stored":46520702,"data_compressed":2189127,"data_compressed_allocated":2883584,"data_compressed_original":46055424,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42340,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":1069056,"data_stored":434127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29820,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94342020,"statfs":{"total":96636764160,"available":96606228480,"internally_reserved":0,"allocated":1159168,"data_stored":1035084,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7852032,"data_stored":125632512,"data_compressed":5964666,"data_compressed_allocated":7852032,"data_compressed_original":125632512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:45.625 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 23 16 4340 4324 11.7489 11.3125 0.103627 0.0848971 2024-09-16T07:57:46.625 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 24 16 4522 4506 11.7333 11.375 0.0419326 0.0850215 2024-09-16T07:57:47.275 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:57:47.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:47.426+0000 7feb97e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:47.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:47.437+0000 7feb97e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:47.625 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 25 16 4707 4691 11.7265 11.5625 0.090922 0.0850702 2024-09-16T07:57:48.509 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:48.625 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 26 16 4895 4879 11.7273 11.75 0.0763612 0.0851475 2024-09-16T07:57:48.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:48.659+0000 7f076b948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:48.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:48.674+0000 7f076b948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:48.963 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:48.963 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:48.978 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":506,"stamp":"2024-09-16T07:57:48.455532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75235880,"num_objects":1143,"num_object_clones":0,"num_object_copies":3429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1219,"num_write_kb":74003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":63,"acting":63,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":173616,"kb_used_data":14312,"kb_used_omap":0,"kb_used_meta":159232,"kb_avail":377313744,"statfs":{"total":386547056640,"available":386369273856,"internally_reserved":0,"allocated":14655488,"data_stored":165092868,"data_compressed":7759523,"data_compressed_allocated":10219520,"data_compressed_original":163266560,"omap_allocated":0,"internal_metadata":163053568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002478"},"pg_stats":[{"pgid":"7.f","version":"132'123","reported_seq":135,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.032215+0000","last_change":"2024-09-16T07:57:21.677659+0000","last_active":"2024-09-16T07:57:33.032215+0000","last_peered":"2024-09-16T07:57:33.032215+0000","last_clean":"2024-09-16T07:57:33.032215+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:57:33.032215+0000","last_undegraded":"2024-09-16T07:57:33.032215+0000","last_fullsized":"2024-09-16T07:57:33.032215+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"132'83","reported_seq":95,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.659615+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:28.659615+0000","last_peered":"2024-09-16T07:57:28.659615+0000","last_clean":"2024-09-16T07:57:28.659615+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:28.659615+0000","last_undegraded":"2024-09-16T07:57:28.659615+0000","last_fullsized":"2024-09-16T07:57:28.659615+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'79","reported_seq":91,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.752077+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:28.752077+0000","last_peered":"2024-09-16T07:57:28.752077+0000","last_clean":"2024-09-16T07:57:28.752077+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:28.752077+0000","last_undegraded":"2024-09-16T07:57:28.752077+0000","last_fullsized":"2024-09-16T07:57:28.752077+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"132'122","reported_seq":134,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.117306+0000","last_change":"2024-09-16T07:57:21.747923+0000","last_active":"2024-09-16T07:57:33.117306+0000","last_peered":"2024-09-16T07:57:33.117306+0000","last_clean":"2024-09-16T07:57:33.117306+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:57:33.117306+0000","last_undegraded":"2024-09-16T07:57:33.117306+0000","last_fullsized":"2024-09-16T07:57:33.117306+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"132'131","reported_seq":143,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.008158+0000","last_change":"2024-09-16T07:57:21.678939+0000","last_active":"2024-09-16T07:57:33.008158+0000","last_peered":"2024-09-16T07:57:33.008158+0000","last_clean":"2024-09-16T07:57:33.008158+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:57:33.008158+0000","last_undegraded":"2024-09-16T07:57:33.008158+0000","last_fullsized":"2024-09-16T07:57:33.008158+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"132'84","reported_seq":96,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.656905+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:28.656905+0000","last_peered":"2024-09-16T07:57:28.656905+0000","last_clean":"2024-09-16T07:57:28.656905+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:28.656905+0000","last_undegraded":"2024-09-16T07:57:28.656905+0000","last_fullsized":"2024-09-16T07:57:28.656905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"132'119","reported_seq":131,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.036329+0000","last_change":"2024-09-16T07:57:21.700152+0000","last_active":"2024-09-16T07:57:33.036329+0000","last_peered":"2024-09-16T07:57:33.036329+0000","last_clean":"2024-09-16T07:57:33.036329+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:57:33.036329+0000","last_undegraded":"2024-09-16T07:57:33.036329+0000","last_fullsized":"2024-09-16T07:57:33.036329+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":397,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545175+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:22.545175+0000","last_peered":"2024-09-16T07:57:22.545175+0000","last_clean":"2024-09-16T07:57:22.545175+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:22.545175+0000","last_undegraded":"2024-09-16T07:57:22.545175+0000","last_fullsized":"2024-09-16T07:57:22.545175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":325,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.542967+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:19.542967+0000","last_peered":"2024-09-16T07:57:19.542967+0000","last_clean":"2024-09-16T07:57:19.542967+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:19.542967+0000","last_undegraded":"2024-09-16T07:57:19.542967+0000","last_fullsized":"2024-09-16T07:57:19.542967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.544627+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:21.544627+0000","last_peered":"2024-09-16T07:57:21.544627+0000","last_clean":"2024-09-16T07:57:21.544627+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:21.544627+0000","last_undegraded":"2024-09-16T07:57:21.544627+0000","last_fullsized":"2024-09-16T07:57:21.544627+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'93","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.722433+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:28.722433+0000","last_peered":"2024-09-16T07:57:28.722433+0000","last_clean":"2024-09-16T07:57:28.722433+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:28.722433+0000","last_undegraded":"2024-09-16T07:57:28.722433+0000","last_fullsized":"2024-09-16T07:57:28.722433+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":306,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.586957+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:19.586957+0000","last_peered":"2024-09-16T07:57:19.586957+0000","last_clean":"2024-09-16T07:57:19.586957+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:19.586957+0000","last_undegraded":"2024-09-16T07:57:19.586957+0000","last_fullsized":"2024-09-16T07:57:19.586957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.557127+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:21.557127+0000","last_peered":"2024-09-16T07:57:21.557127+0000","last_clean":"2024-09-16T07:57:21.557127+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:21.557127+0000","last_undegraded":"2024-09-16T07:57:21.557127+0000","last_fullsized":"2024-09-16T07:57:21.557127+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.682216+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:21.682216+0000","last_peered":"2024-09-16T07:57:21.682216+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:21.682216+0000","last_undegraded":"2024-09-16T07:57:21.682216+0000","last_fullsized":"2024-09-16T07:57:21.682216+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'59","reported_seq":71,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.670887+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:28.670887+0000","last_peered":"2024-09-16T07:57:28.670887+0000","last_clean":"2024-09-16T07:57:28.670887+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:28.670887+0000","last_undegraded":"2024-09-16T07:57:28.670887+0000","last_fullsized":"2024-09-16T07:57:28.670887+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.546751+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:22.546751+0000","last_peered":"2024-09-16T07:57:22.546751+0000","last_clean":"2024-09-16T07:57:22.546751+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:22.546751+0000","last_undegraded":"2024-09-16T07:57:22.546751+0000","last_fullsized":"2024-09-16T07:57:22.546751+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"132'135","reported_seq":147,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.079236+0000","last_change":"2024-09-16T07:57:21.653427+0000","last_active":"2024-09-16T07:57:33.079236+0000","last_peered":"2024-09-16T07:57:33.079236+0000","last_clean":"2024-09-16T07:57:33.079236+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:57:33.079236+0000","last_undegraded":"2024-09-16T07:57:33.079236+0000","last_fullsized":"2024-09-16T07:57:33.079236+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"132'111","reported_seq":123,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:32.706917+0000","last_change":"2024-09-16T07:57:21.704210+0000","last_active":"2024-09-16T07:57:32.706917+0000","last_peered":"2024-09-16T07:57:32.706917+0000","last_clean":"2024-09-16T07:57:32.706917+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:57:32.706917+0000","last_undegraded":"2024-09-16T07:57:32.706917+0000","last_fullsized":"2024-09-16T07:57:32.706917+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":318,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.556141+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:19.556141+0000","last_peered":"2024-09-16T07:57:19.556141+0000","last_clean":"2024-09-16T07:57:19.556141+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:19.556141+0000","last_undegraded":"2024-09-16T07:57:19.556141+0000","last_fullsized":"2024-09-16T07:57:19.556141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":74645504,"num_objects":1139,"num_object_clones":0,"num_object_copies":3417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10805248,"data_stored":172883968,"data_compressed":8207776,"data_compressed_allocated":10805248,"data_compressed_original":172883968,"omap_allocated":0,"internal_metadata":0},"log_size":1139,"ondisk_log_size":1139,"up":36,"acting":36,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68396,"kb_used_data":8220,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94303444,"statfs":{"total":96636764160,"available":96566726656,"internally_reserved":0,"allocated":8417280,"data_stored":117102955,"data_compressed":5540355,"data_compressed_allocated":7294976,"data_compressed_original":116637696,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33060,"kb_used_data":3916,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":4009984,"data_stored":46520702,"data_compressed":2189127,"data_compressed_allocated":2883584,"data_compressed_original":46055424,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42340,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":1069056,"data_stored":434127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29820,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94342020,"statfs":{"total":96636764160,"available":96606228480,"internally_reserved":0,"allocated":1159168,"data_stored":1035084,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7852032,"data_stored":125632512,"data_compressed":5964666,"data_compressed_allocated":7852032,"data_compressed_original":125632512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:48.979 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:57:49.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:49.137+0000 7f3aae591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:49.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:49.147+0000 7f3aae591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:49.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:49.531 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":771,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":132,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473411,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":21},{"state_name":"unknown","count":4}],"num_pgs":25,"num_pools":3,"num_objects":1143,"data_bytes":75235880,"bytes_used":177782784,"bytes_avail":386369273856,"bytes_total":386547056640,"unknown_pgs_ratio":0.15999999642372131},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:57:49.550 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:57:49.550 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:49.625 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 27 16 5082 5066 11.7258 11.6875 0.10854 0.085183 2024-09-16T07:57:49.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:49.698+0000 7f6eca791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:49.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:49.710+0000 7f6eca791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:49.832 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:57:49.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:49.985+0000 7f06dd151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:49.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:49.993+0000 7f06dd151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:49.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:49.994 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:50.014 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":506,"stamp":"2024-09-16T07:57:48.455532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75235880,"num_objects":1143,"num_object_clones":0,"num_object_copies":3429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1219,"num_write_kb":74003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":63,"acting":63,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":173616,"kb_used_data":14312,"kb_used_omap":0,"kb_used_meta":159232,"kb_avail":377313744,"statfs":{"total":386547056640,"available":386369273856,"internally_reserved":0,"allocated":14655488,"data_stored":165092868,"data_compressed":7759523,"data_compressed_allocated":10219520,"data_compressed_original":163266560,"omap_allocated":0,"internal_metadata":163053568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002478"},"pg_stats":[{"pgid":"7.f","version":"132'123","reported_seq":135,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.032215+0000","last_change":"2024-09-16T07:57:21.677659+0000","last_active":"2024-09-16T07:57:33.032215+0000","last_peered":"2024-09-16T07:57:33.032215+0000","last_clean":"2024-09-16T07:57:33.032215+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:57:33.032215+0000","last_undegraded":"2024-09-16T07:57:33.032215+0000","last_fullsized":"2024-09-16T07:57:33.032215+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"132'83","reported_seq":95,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.659615+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:28.659615+0000","last_peered":"2024-09-16T07:57:28.659615+0000","last_clean":"2024-09-16T07:57:28.659615+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:28.659615+0000","last_undegraded":"2024-09-16T07:57:28.659615+0000","last_fullsized":"2024-09-16T07:57:28.659615+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'79","reported_seq":91,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.752077+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:28.752077+0000","last_peered":"2024-09-16T07:57:28.752077+0000","last_clean":"2024-09-16T07:57:28.752077+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:28.752077+0000","last_undegraded":"2024-09-16T07:57:28.752077+0000","last_fullsized":"2024-09-16T07:57:28.752077+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"132'122","reported_seq":134,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.117306+0000","last_change":"2024-09-16T07:57:21.747923+0000","last_active":"2024-09-16T07:57:33.117306+0000","last_peered":"2024-09-16T07:57:33.117306+0000","last_clean":"2024-09-16T07:57:33.117306+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:57:33.117306+0000","last_undegraded":"2024-09-16T07:57:33.117306+0000","last_fullsized":"2024-09-16T07:57:33.117306+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"132'131","reported_seq":143,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.008158+0000","last_change":"2024-09-16T07:57:21.678939+0000","last_active":"2024-09-16T07:57:33.008158+0000","last_peered":"2024-09-16T07:57:33.008158+0000","last_clean":"2024-09-16T07:57:33.008158+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:57:33.008158+0000","last_undegraded":"2024-09-16T07:57:33.008158+0000","last_fullsized":"2024-09-16T07:57:33.008158+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"132'84","reported_seq":96,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.656905+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:28.656905+0000","last_peered":"2024-09-16T07:57:28.656905+0000","last_clean":"2024-09-16T07:57:28.656905+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:28.656905+0000","last_undegraded":"2024-09-16T07:57:28.656905+0000","last_fullsized":"2024-09-16T07:57:28.656905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"132'119","reported_seq":131,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.036329+0000","last_change":"2024-09-16T07:57:21.700152+0000","last_active":"2024-09-16T07:57:33.036329+0000","last_peered":"2024-09-16T07:57:33.036329+0000","last_clean":"2024-09-16T07:57:33.036329+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:57:33.036329+0000","last_undegraded":"2024-09-16T07:57:33.036329+0000","last_fullsized":"2024-09-16T07:57:33.036329+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":397,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545175+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:22.545175+0000","last_peered":"2024-09-16T07:57:22.545175+0000","last_clean":"2024-09-16T07:57:22.545175+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:22.545175+0000","last_undegraded":"2024-09-16T07:57:22.545175+0000","last_fullsized":"2024-09-16T07:57:22.545175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":325,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.542967+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:19.542967+0000","last_peered":"2024-09-16T07:57:19.542967+0000","last_clean":"2024-09-16T07:57:19.542967+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:19.542967+0000","last_undegraded":"2024-09-16T07:57:19.542967+0000","last_fullsized":"2024-09-16T07:57:19.542967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":215,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.544627+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:21.544627+0000","last_peered":"2024-09-16T07:57:21.544627+0000","last_clean":"2024-09-16T07:57:21.544627+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:21.544627+0000","last_undegraded":"2024-09-16T07:57:21.544627+0000","last_fullsized":"2024-09-16T07:57:21.544627+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'93","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.722433+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:28.722433+0000","last_peered":"2024-09-16T07:57:28.722433+0000","last_clean":"2024-09-16T07:57:28.722433+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:28.722433+0000","last_undegraded":"2024-09-16T07:57:28.722433+0000","last_fullsized":"2024-09-16T07:57:28.722433+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":306,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.586957+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:19.586957+0000","last_peered":"2024-09-16T07:57:19.586957+0000","last_clean":"2024-09-16T07:57:19.586957+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:19.586957+0000","last_undegraded":"2024-09-16T07:57:19.586957+0000","last_fullsized":"2024-09-16T07:57:19.586957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:57:20.520061+0000","last_change":"2024-09-16T07:57:20.520061+0000","last_active":"2024-09-16T07:57:20.520061+0000","last_peered":"2024-09-16T07:57:20.520061+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:57:20.520061+0000","last_undegraded":"2024-09-16T07:57:20.520061+0000","last_fullsized":"2024-09-16T07:57:20.520061+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":223,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.557127+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:21.557127+0000","last_peered":"2024-09-16T07:57:21.557127+0000","last_clean":"2024-09-16T07:57:21.557127+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:21.557127+0000","last_undegraded":"2024-09-16T07:57:21.557127+0000","last_fullsized":"2024-09-16T07:57:21.557127+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-16T07:57:21.682216+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:21.682216+0000","last_peered":"2024-09-16T07:57:21.682216+0000","last_clean":"2024-09-16T07:57:20.520061+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:21.682216+0000","last_undegraded":"2024-09-16T07:57:21.682216+0000","last_fullsized":"2024-09-16T07:57:21.682216+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'59","reported_seq":71,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.670887+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:28.670887+0000","last_peered":"2024-09-16T07:57:28.670887+0000","last_clean":"2024-09-16T07:57:28.670887+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:28.670887+0000","last_undegraded":"2024-09-16T07:57:28.670887+0000","last_fullsized":"2024-09-16T07:57:28.670887+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.546751+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:22.546751+0000","last_peered":"2024-09-16T07:57:22.546751+0000","last_clean":"2024-09-16T07:57:22.546751+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:22.546751+0000","last_undegraded":"2024-09-16T07:57:22.546751+0000","last_fullsized":"2024-09-16T07:57:22.546751+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"132'135","reported_seq":147,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.079236+0000","last_change":"2024-09-16T07:57:21.653427+0000","last_active":"2024-09-16T07:57:33.079236+0000","last_peered":"2024-09-16T07:57:33.079236+0000","last_clean":"2024-09-16T07:57:33.079236+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:57:33.079236+0000","last_undegraded":"2024-09-16T07:57:33.079236+0000","last_fullsized":"2024-09-16T07:57:33.079236+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"132'111","reported_seq":123,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:32.706917+0000","last_change":"2024-09-16T07:57:21.704210+0000","last_active":"2024-09-16T07:57:32.706917+0000","last_peered":"2024-09-16T07:57:32.706917+0000","last_clean":"2024-09-16T07:57:32.706917+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:57:32.706917+0000","last_undegraded":"2024-09-16T07:57:32.706917+0000","last_fullsized":"2024-09-16T07:57:32.706917+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":318,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-16T07:57:19.556141+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:19.556141+0000","last_peered":"2024-09-16T07:57:19.556141+0000","last_clean":"2024-09-16T07:57:19.556141+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:19.556141+0000","last_undegraded":"2024-09-16T07:57:19.556141+0000","last_fullsized":"2024-09-16T07:57:19.556141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":74645504,"num_objects":1139,"num_object_clones":0,"num_object_copies":3417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1139,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":10805248,"data_stored":172883968,"data_compressed":8207776,"data_compressed_allocated":10805248,"data_compressed_original":172883968,"omap_allocated":0,"internal_metadata":0},"log_size":1139,"ondisk_log_size":1139,"up":36,"acting":36,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68396,"kb_used_data":8220,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94303444,"statfs":{"total":96636764160,"available":96566726656,"internally_reserved":0,"allocated":8417280,"data_stored":117102955,"data_compressed":5540355,"data_compressed_allocated":7294976,"data_compressed_original":116637696,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33060,"kb_used_data":3916,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":4009984,"data_stored":46520702,"data_compressed":2189127,"data_compressed_allocated":2883584,"data_compressed_original":46055424,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42340,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94329500,"statfs":{"total":96636764160,"available":96593408000,"internally_reserved":0,"allocated":1069056,"data_stored":434127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29820,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94342020,"statfs":{"total":96636764160,"available":96606228480,"internally_reserved":0,"allocated":1159168,"data_stored":1035084,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7852032,"data_stored":125632512,"data_compressed":5964666,"data_compressed_allocated":7852032,"data_compressed_original":125632512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:50.625 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 28 16 5265 5249 11.7155 11.4375 0.100421 0.0851338 2024-09-16T07:57:51.625 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 29 16 5449 5433 11.708 11.5 0.108765 0.0852212 2024-09-16T07:57:52.405 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:57:52.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:52.571+0000 7fcd9a8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:52.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:52.580+0000 7fcd9a8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:52.627 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 30 16 5649 5633 11.7344 12.5 0.0804674 0.0851061 2024-09-16T07:57:53.016 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:53.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:53.174+0000 7f8c30d08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:53.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:53.188+0000 7f8c30d08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:53.466 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:53.467 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:53.484 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":508,"stamp":"2024-09-16T07:57:52.456207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":181928488,"num_objects":2771,"num_object_clones":0,"num_object_copies":8313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2847,"num_write_kb":178195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2822,"ondisk_log_size":2822,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":205064,"kb_used_data":45760,"kb_used_omap":0,"kb_used_meta":159232,"kb_avail":377282296,"statfs":{"total":386547056640,"available":386337071104,"internally_reserved":0,"allocated":46858240,"data_stored":679633861,"data_compressed":32190185,"data_compressed_allocated":42377216,"data_compressed_original":677789696,"omap_allocated":0,"internal_metadata":163053568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":106692608,"num_objects":1628,"num_object_clones":0,"num_object_copies":4884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1628,"num_write_kb":104192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002278"},"pg_stats":[{"pgid":"7.f","version":"132'123","reported_seq":135,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.032215+0000","last_change":"2024-09-16T07:57:21.677659+0000","last_active":"2024-09-16T07:57:33.032215+0000","last_peered":"2024-09-16T07:57:33.032215+0000","last_clean":"2024-09-16T07:57:33.032215+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:57:33.032215+0000","last_undegraded":"2024-09-16T07:57:33.032215+0000","last_fullsized":"2024-09-16T07:57:33.032215+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"132'330","reported_seq":342,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.896375+0000","last_change":"2024-09-16T07:57:21.730082+0000","last_active":"2024-09-16T07:57:49.896375+0000","last_peered":"2024-09-16T07:57:49.896375+0000","last_clean":"2024-09-16T07:57:49.896375+0000","last_became_active":"2024-09-16T07:57:21.701780+0000","last_became_peered":"2024-09-16T07:57:21.701780+0000","last_unstale":"2024-09-16T07:57:49.896375+0000","last_undegraded":"2024-09-16T07:57:49.896375+0000","last_fullsized":"2024-09-16T07:57:49.896375+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"132'83","reported_seq":95,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.659615+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:28.659615+0000","last_peered":"2024-09-16T07:57:28.659615+0000","last_clean":"2024-09-16T07:57:28.659615+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:28.659615+0000","last_undegraded":"2024-09-16T07:57:28.659615+0000","last_fullsized":"2024-09-16T07:57:28.659615+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'79","reported_seq":91,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.752077+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:28.752077+0000","last_peered":"2024-09-16T07:57:28.752077+0000","last_clean":"2024-09-16T07:57:28.752077+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:28.752077+0000","last_undegraded":"2024-09-16T07:57:28.752077+0000","last_fullsized":"2024-09-16T07:57:28.752077+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"132'122","reported_seq":134,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.117306+0000","last_change":"2024-09-16T07:57:21.747923+0000","last_active":"2024-09-16T07:57:33.117306+0000","last_peered":"2024-09-16T07:57:33.117306+0000","last_clean":"2024-09-16T07:57:33.117306+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:57:33.117306+0000","last_undegraded":"2024-09-16T07:57:33.117306+0000","last_fullsized":"2024-09-16T07:57:33.117306+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"132'131","reported_seq":143,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.008158+0000","last_change":"2024-09-16T07:57:21.678939+0000","last_active":"2024-09-16T07:57:33.008158+0000","last_peered":"2024-09-16T07:57:33.008158+0000","last_clean":"2024-09-16T07:57:33.008158+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:57:33.008158+0000","last_undegraded":"2024-09-16T07:57:33.008158+0000","last_fullsized":"2024-09-16T07:57:33.008158+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"132'84","reported_seq":96,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.656905+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:28.656905+0000","last_peered":"2024-09-16T07:57:28.656905+0000","last_clean":"2024-09-16T07:57:28.656905+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:28.656905+0000","last_undegraded":"2024-09-16T07:57:28.656905+0000","last_fullsized":"2024-09-16T07:57:28.656905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"132'321","reported_seq":333,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.621564+0000","last_change":"2024-09-16T07:57:21.754262+0000","last_active":"2024-09-16T07:57:49.621564+0000","last_peered":"2024-09-16T07:57:49.621564+0000","last_clean":"2024-09-16T07:57:49.621564+0000","last_became_active":"2024-09-16T07:57:21.743887+0000","last_became_peered":"2024-09-16T07:57:21.743887+0000","last_unstale":"2024-09-16T07:57:49.621564+0000","last_undegraded":"2024-09-16T07:57:49.621564+0000","last_fullsized":"2024-09-16T07:57:49.621564+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":20544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"132'119","reported_seq":131,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.036329+0000","last_change":"2024-09-16T07:57:21.700152+0000","last_active":"2024-09-16T07:57:33.036329+0000","last_peered":"2024-09-16T07:57:33.036329+0000","last_clean":"2024-09-16T07:57:33.036329+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:57:33.036329+0000","last_undegraded":"2024-09-16T07:57:33.036329+0000","last_fullsized":"2024-09-16T07:57:33.036329+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":397,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545175+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:22.545175+0000","last_peered":"2024-09-16T07:57:22.545175+0000","last_clean":"2024-09-16T07:57:22.545175+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:22.545175+0000","last_undegraded":"2024-09-16T07:57:22.545175+0000","last_fullsized":"2024-09-16T07:57:22.545175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":334,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.551263+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:22.551263+0000","last_peered":"2024-09-16T07:57:22.551263+0000","last_clean":"2024-09-16T07:57:22.551263+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:22.551263+0000","last_undegraded":"2024-09-16T07:57:22.551263+0000","last_fullsized":"2024-09-16T07:57:22.551263+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"132'324","reported_seq":336,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.983843+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:57:49.983843+0000","last_peered":"2024-09-16T07:57:49.983843+0000","last_clean":"2024-09-16T07:57:49.983843+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:57:49.983843+0000","last_undegraded":"2024-09-16T07:57:49.983843+0000","last_fullsized":"2024-09-16T07:57:49.983843+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":20736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:22.545777+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'93","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.722433+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:28.722433+0000","last_peered":"2024-09-16T07:57:28.722433+0000","last_clean":"2024-09-16T07:57:28.722433+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:28.722433+0000","last_undegraded":"2024-09-16T07:57:28.722433+0000","last_fullsized":"2024-09-16T07:57:28.722433+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":315,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.558168+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:22.558168+0000","last_peered":"2024-09-16T07:57:22.558168+0000","last_clean":"2024-09-16T07:57:22.558168+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:22.558168+0000","last_undegraded":"2024-09-16T07:57:22.558168+0000","last_fullsized":"2024-09-16T07:57:22.558168+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"132'330","reported_seq":342,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.802781+0000","last_change":"2024-09-16T07:57:21.704253+0000","last_active":"2024-09-16T07:57:49.802781+0000","last_peered":"2024-09-16T07:57:49.802781+0000","last_clean":"2024-09-16T07:57:49.802781+0000","last_became_active":"2024-09-16T07:57:21.683562+0000","last_became_peered":"2024-09-16T07:57:21.683562+0000","last_unstale":"2024-09-16T07:57:49.802781+0000","last_undegraded":"2024-09-16T07:57:49.802781+0000","last_fullsized":"2024-09-16T07:57:49.802781+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:22.550570+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:52.194250+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'59","reported_seq":71,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.670887+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:28.670887+0000","last_peered":"2024-09-16T07:57:28.670887+0000","last_clean":"2024-09-16T07:57:28.670887+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:28.670887+0000","last_undegraded":"2024-09-16T07:57:28.670887+0000","last_fullsized":"2024-09-16T07:57:28.670887+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.546751+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:22.546751+0000","last_peered":"2024-09-16T07:57:22.546751+0000","last_clean":"2024-09-16T07:57:22.546751+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:22.546751+0000","last_undegraded":"2024-09-16T07:57:22.546751+0000","last_fullsized":"2024-09-16T07:57:22.546751+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"132'135","reported_seq":147,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.079236+0000","last_change":"2024-09-16T07:57:21.653427+0000","last_active":"2024-09-16T07:57:33.079236+0000","last_peered":"2024-09-16T07:57:33.079236+0000","last_clean":"2024-09-16T07:57:33.079236+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:57:33.079236+0000","last_undegraded":"2024-09-16T07:57:33.079236+0000","last_fullsized":"2024-09-16T07:57:33.079236+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"132'111","reported_seq":123,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:32.706917+0000","last_change":"2024-09-16T07:57:21.704210+0000","last_active":"2024-09-16T07:57:32.706917+0000","last_peered":"2024-09-16T07:57:32.706917+0000","last_clean":"2024-09-16T07:57:32.706917+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:57:32.706917+0000","last_undegraded":"2024-09-16T07:57:32.706917+0000","last_fullsized":"2024-09-16T07:57:32.706917+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":327,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.556270+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:22.556270+0000","last_peered":"2024-09-16T07:57:22.556270+0000","last_clean":"2024-09-16T07:57:22.556270+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:22.556270+0000","last_undegraded":"2024-09-16T07:57:22.556270+0000","last_fullsized":"2024-09-16T07:57:22.556270+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":181338112,"num_objects":2767,"num_object_clones":0,"num_object_copies":8301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2767,"num_write_kb":177088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":43577344,"data_stored":697237504,"data_compressed":33105238,"data_compressed_allocated":43577344,"data_compressed_original":697237504,"omap_allocated":0,"internal_metadata":0},"log_size":2767,"ondisk_log_size":2767,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68396,"kb_used_data":8220,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94303444,"statfs":{"total":96636764160,"available":96566726656,"internally_reserved":0,"allocated":8417280,"data_stored":117102955,"data_compressed":5540355,"data_compressed_allocated":7294976,"data_compressed_original":116637696,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33060,"kb_used_data":3916,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":4009984,"data_stored":46520702,"data_compressed":2189127,"data_compressed_allocated":2883584,"data_compressed_original":46055424,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58496,"kb_used_data":17200,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94313344,"statfs":{"total":96636764160,"available":96576864256,"internally_reserved":0,"allocated":17612800,"data_stored":264558430,"data_compressed":12540468,"data_compressed_allocated":16506880,"data_compressed_original":264110080,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17051648,"data_stored":272826368,"data_compressed":12954364,"data_compressed_allocated":17051648,"data_compressed_original":272826368,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7852032,"data_stored":125632512,"data_compressed":5964666,"data_compressed_allocated":7852032,"data_compressed_original":125632512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:53.486 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:57:53.486 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:57:53.486 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:53.625 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 31 16 5834 5818 11.7288 11.5625 0.08217 0.0851441 2024-09-16T07:57:53.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:53.634+0000 7f18dfb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:53.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:53.646+0000 7f18dfb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:53.960 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:53.961 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:53.983 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":508,"stamp":"2024-09-16T07:57:52.456207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":181928488,"num_objects":2771,"num_object_clones":0,"num_object_copies":8313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2847,"num_write_kb":178195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2822,"ondisk_log_size":2822,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":205064,"kb_used_data":45760,"kb_used_omap":0,"kb_used_meta":159232,"kb_avail":377282296,"statfs":{"total":386547056640,"available":386337071104,"internally_reserved":0,"allocated":46858240,"data_stored":679633861,"data_compressed":32190185,"data_compressed_allocated":42377216,"data_compressed_original":677789696,"omap_allocated":0,"internal_metadata":163053568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":106692608,"num_objects":1628,"num_object_clones":0,"num_object_copies":4884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1628,"num_write_kb":104192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002278"},"pg_stats":[{"pgid":"7.f","version":"132'123","reported_seq":135,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.032215+0000","last_change":"2024-09-16T07:57:21.677659+0000","last_active":"2024-09-16T07:57:33.032215+0000","last_peered":"2024-09-16T07:57:33.032215+0000","last_clean":"2024-09-16T07:57:33.032215+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:57:33.032215+0000","last_undegraded":"2024-09-16T07:57:33.032215+0000","last_fullsized":"2024-09-16T07:57:33.032215+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"132'330","reported_seq":342,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.896375+0000","last_change":"2024-09-16T07:57:21.730082+0000","last_active":"2024-09-16T07:57:49.896375+0000","last_peered":"2024-09-16T07:57:49.896375+0000","last_clean":"2024-09-16T07:57:49.896375+0000","last_became_active":"2024-09-16T07:57:21.701780+0000","last_became_peered":"2024-09-16T07:57:21.701780+0000","last_unstale":"2024-09-16T07:57:49.896375+0000","last_undegraded":"2024-09-16T07:57:49.896375+0000","last_fullsized":"2024-09-16T07:57:49.896375+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"132'83","reported_seq":95,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.659615+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:28.659615+0000","last_peered":"2024-09-16T07:57:28.659615+0000","last_clean":"2024-09-16T07:57:28.659615+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:28.659615+0000","last_undegraded":"2024-09-16T07:57:28.659615+0000","last_fullsized":"2024-09-16T07:57:28.659615+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'79","reported_seq":91,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.752077+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:28.752077+0000","last_peered":"2024-09-16T07:57:28.752077+0000","last_clean":"2024-09-16T07:57:28.752077+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:28.752077+0000","last_undegraded":"2024-09-16T07:57:28.752077+0000","last_fullsized":"2024-09-16T07:57:28.752077+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"132'122","reported_seq":134,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.117306+0000","last_change":"2024-09-16T07:57:21.747923+0000","last_active":"2024-09-16T07:57:33.117306+0000","last_peered":"2024-09-16T07:57:33.117306+0000","last_clean":"2024-09-16T07:57:33.117306+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:57:33.117306+0000","last_undegraded":"2024-09-16T07:57:33.117306+0000","last_fullsized":"2024-09-16T07:57:33.117306+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"132'131","reported_seq":143,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.008158+0000","last_change":"2024-09-16T07:57:21.678939+0000","last_active":"2024-09-16T07:57:33.008158+0000","last_peered":"2024-09-16T07:57:33.008158+0000","last_clean":"2024-09-16T07:57:33.008158+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:57:33.008158+0000","last_undegraded":"2024-09-16T07:57:33.008158+0000","last_fullsized":"2024-09-16T07:57:33.008158+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"132'84","reported_seq":96,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.656905+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:28.656905+0000","last_peered":"2024-09-16T07:57:28.656905+0000","last_clean":"2024-09-16T07:57:28.656905+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:28.656905+0000","last_undegraded":"2024-09-16T07:57:28.656905+0000","last_fullsized":"2024-09-16T07:57:28.656905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"132'321","reported_seq":333,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.621564+0000","last_change":"2024-09-16T07:57:21.754262+0000","last_active":"2024-09-16T07:57:49.621564+0000","last_peered":"2024-09-16T07:57:49.621564+0000","last_clean":"2024-09-16T07:57:49.621564+0000","last_became_active":"2024-09-16T07:57:21.743887+0000","last_became_peered":"2024-09-16T07:57:21.743887+0000","last_unstale":"2024-09-16T07:57:49.621564+0000","last_undegraded":"2024-09-16T07:57:49.621564+0000","last_fullsized":"2024-09-16T07:57:49.621564+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":20544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"132'119","reported_seq":131,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.036329+0000","last_change":"2024-09-16T07:57:21.700152+0000","last_active":"2024-09-16T07:57:33.036329+0000","last_peered":"2024-09-16T07:57:33.036329+0000","last_clean":"2024-09-16T07:57:33.036329+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:57:33.036329+0000","last_undegraded":"2024-09-16T07:57:33.036329+0000","last_fullsized":"2024-09-16T07:57:33.036329+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":397,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545175+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:22.545175+0000","last_peered":"2024-09-16T07:57:22.545175+0000","last_clean":"2024-09-16T07:57:22.545175+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:22.545175+0000","last_undegraded":"2024-09-16T07:57:22.545175+0000","last_fullsized":"2024-09-16T07:57:22.545175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":334,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.551263+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:22.551263+0000","last_peered":"2024-09-16T07:57:22.551263+0000","last_clean":"2024-09-16T07:57:22.551263+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:22.551263+0000","last_undegraded":"2024-09-16T07:57:22.551263+0000","last_fullsized":"2024-09-16T07:57:22.551263+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"132'324","reported_seq":336,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.983843+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:57:49.983843+0000","last_peered":"2024-09-16T07:57:49.983843+0000","last_clean":"2024-09-16T07:57:49.983843+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:57:49.983843+0000","last_undegraded":"2024-09-16T07:57:49.983843+0000","last_fullsized":"2024-09-16T07:57:49.983843+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":20736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:22.545777+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'93","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.722433+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:28.722433+0000","last_peered":"2024-09-16T07:57:28.722433+0000","last_clean":"2024-09-16T07:57:28.722433+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:28.722433+0000","last_undegraded":"2024-09-16T07:57:28.722433+0000","last_fullsized":"2024-09-16T07:57:28.722433+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":315,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.558168+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:22.558168+0000","last_peered":"2024-09-16T07:57:22.558168+0000","last_clean":"2024-09-16T07:57:22.558168+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:22.558168+0000","last_undegraded":"2024-09-16T07:57:22.558168+0000","last_fullsized":"2024-09-16T07:57:22.558168+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"132'330","reported_seq":342,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.802781+0000","last_change":"2024-09-16T07:57:21.704253+0000","last_active":"2024-09-16T07:57:49.802781+0000","last_peered":"2024-09-16T07:57:49.802781+0000","last_clean":"2024-09-16T07:57:49.802781+0000","last_became_active":"2024-09-16T07:57:21.683562+0000","last_became_peered":"2024-09-16T07:57:21.683562+0000","last_unstale":"2024-09-16T07:57:49.802781+0000","last_undegraded":"2024-09-16T07:57:49.802781+0000","last_fullsized":"2024-09-16T07:57:49.802781+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:22.550570+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:52.194250+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'59","reported_seq":71,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.670887+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:28.670887+0000","last_peered":"2024-09-16T07:57:28.670887+0000","last_clean":"2024-09-16T07:57:28.670887+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:28.670887+0000","last_undegraded":"2024-09-16T07:57:28.670887+0000","last_fullsized":"2024-09-16T07:57:28.670887+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.546751+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:22.546751+0000","last_peered":"2024-09-16T07:57:22.546751+0000","last_clean":"2024-09-16T07:57:22.546751+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:22.546751+0000","last_undegraded":"2024-09-16T07:57:22.546751+0000","last_fullsized":"2024-09-16T07:57:22.546751+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"132'135","reported_seq":147,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.079236+0000","last_change":"2024-09-16T07:57:21.653427+0000","last_active":"2024-09-16T07:57:33.079236+0000","last_peered":"2024-09-16T07:57:33.079236+0000","last_clean":"2024-09-16T07:57:33.079236+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:57:33.079236+0000","last_undegraded":"2024-09-16T07:57:33.079236+0000","last_fullsized":"2024-09-16T07:57:33.079236+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"132'111","reported_seq":123,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:32.706917+0000","last_change":"2024-09-16T07:57:21.704210+0000","last_active":"2024-09-16T07:57:32.706917+0000","last_peered":"2024-09-16T07:57:32.706917+0000","last_clean":"2024-09-16T07:57:32.706917+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:57:32.706917+0000","last_undegraded":"2024-09-16T07:57:32.706917+0000","last_fullsized":"2024-09-16T07:57:32.706917+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":327,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.556270+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:22.556270+0000","last_peered":"2024-09-16T07:57:22.556270+0000","last_clean":"2024-09-16T07:57:22.556270+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:22.556270+0000","last_undegraded":"2024-09-16T07:57:22.556270+0000","last_fullsized":"2024-09-16T07:57:22.556270+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":181338112,"num_objects":2767,"num_object_clones":0,"num_object_copies":8301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2767,"num_write_kb":177088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":43577344,"data_stored":697237504,"data_compressed":33105238,"data_compressed_allocated":43577344,"data_compressed_original":697237504,"omap_allocated":0,"internal_metadata":0},"log_size":2767,"ondisk_log_size":2767,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68396,"kb_used_data":8220,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94303444,"statfs":{"total":96636764160,"available":96566726656,"internally_reserved":0,"allocated":8417280,"data_stored":117102955,"data_compressed":5540355,"data_compressed_allocated":7294976,"data_compressed_original":116637696,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33060,"kb_used_data":3916,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":4009984,"data_stored":46520702,"data_compressed":2189127,"data_compressed_allocated":2883584,"data_compressed_original":46055424,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58496,"kb_used_data":17200,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94313344,"statfs":{"total":96636764160,"available":96576864256,"internally_reserved":0,"allocated":17612800,"data_stored":264558430,"data_compressed":12540468,"data_compressed_allocated":16506880,"data_compressed_original":264110080,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17051648,"data_stored":272826368,"data_compressed":12954364,"data_compressed_allocated":17051648,"data_compressed_original":272826368,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7852032,"data_stored":125632512,"data_compressed":5964666,"data_compressed_allocated":7852032,"data_compressed_original":125632512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:54.625 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 32 16 6020 6004 11.7255 11.625 0.112619 0.0851588 2024-09-16T07:57:54.962 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:57:55.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:55.105+0000 7f74c2308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:55.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:55.113+0000 7f74c2308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:55.625 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 33 16 6201 6185 11.713 11.3125 0.0740321 0.0852313 2024-09-16T07:57:56.626 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 34 16 6399 6383 11.7324 12.375 0.0681302 0.085133 2024-09-16T07:57:57.510 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:57:57.626 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 35 16 6589 6573 11.7364 11.875 0.0424104 0.0850918 2024-09-16T07:57:57.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:57.650+0000 7f5dcc4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:57.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:57.658+0000 7f5dcc4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:58.626 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 36 16 6780 6764 11.742 11.9375 0.0869629 0.0850603 2024-09-16T07:57:58.986 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 0, 2, 1] 2024-09-16T07:57:58.986 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:57:58.986 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:57:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:59.143+0000 7f673e6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:59.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:57:59.160+0000 7f673e6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:57:59.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:57:59.477 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:57:59.501 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":511,"stamp":"2024-09-16T07:57:58.457446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":181928488,"num_objects":2771,"num_object_clones":0,"num_object_copies":8313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2847,"num_write_kb":178195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2822,"ondisk_log_size":2822,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":205064,"kb_used_data":45760,"kb_used_omap":0,"kb_used_meta":159232,"kb_avail":377282296,"statfs":{"total":386547056640,"available":386337071104,"internally_reserved":0,"allocated":46858240,"data_stored":679633861,"data_compressed":32190185,"data_compressed_allocated":42377216,"data_compressed_original":677789696,"omap_allocated":0,"internal_metadata":163053568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":106692608,"num_objects":1628,"num_object_clones":0,"num_object_copies":4884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1628,"num_write_kb":104192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002276"},"pg_stats":[{"pgid":"7.f","version":"132'123","reported_seq":135,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.032215+0000","last_change":"2024-09-16T07:57:21.677659+0000","last_active":"2024-09-16T07:57:33.032215+0000","last_peered":"2024-09-16T07:57:33.032215+0000","last_clean":"2024-09-16T07:57:33.032215+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:57:33.032215+0000","last_undegraded":"2024-09-16T07:57:33.032215+0000","last_fullsized":"2024-09-16T07:57:33.032215+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"132'330","reported_seq":342,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.896375+0000","last_change":"2024-09-16T07:57:21.730082+0000","last_active":"2024-09-16T07:57:49.896375+0000","last_peered":"2024-09-16T07:57:49.896375+0000","last_clean":"2024-09-16T07:57:49.896375+0000","last_became_active":"2024-09-16T07:57:21.701780+0000","last_became_peered":"2024-09-16T07:57:21.701780+0000","last_unstale":"2024-09-16T07:57:49.896375+0000","last_undegraded":"2024-09-16T07:57:49.896375+0000","last_fullsized":"2024-09-16T07:57:49.896375+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"132'83","reported_seq":95,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.659615+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:28.659615+0000","last_peered":"2024-09-16T07:57:28.659615+0000","last_clean":"2024-09-16T07:57:28.659615+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:28.659615+0000","last_undegraded":"2024-09-16T07:57:28.659615+0000","last_fullsized":"2024-09-16T07:57:28.659615+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'79","reported_seq":91,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.752077+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:28.752077+0000","last_peered":"2024-09-16T07:57:28.752077+0000","last_clean":"2024-09-16T07:57:28.752077+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:28.752077+0000","last_undegraded":"2024-09-16T07:57:28.752077+0000","last_fullsized":"2024-09-16T07:57:28.752077+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"132'122","reported_seq":134,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.117306+0000","last_change":"2024-09-16T07:57:21.747923+0000","last_active":"2024-09-16T07:57:33.117306+0000","last_peered":"2024-09-16T07:57:33.117306+0000","last_clean":"2024-09-16T07:57:33.117306+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:57:33.117306+0000","last_undegraded":"2024-09-16T07:57:33.117306+0000","last_fullsized":"2024-09-16T07:57:33.117306+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"132'131","reported_seq":143,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.008158+0000","last_change":"2024-09-16T07:57:21.678939+0000","last_active":"2024-09-16T07:57:33.008158+0000","last_peered":"2024-09-16T07:57:33.008158+0000","last_clean":"2024-09-16T07:57:33.008158+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:57:33.008158+0000","last_undegraded":"2024-09-16T07:57:33.008158+0000","last_fullsized":"2024-09-16T07:57:33.008158+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"132'84","reported_seq":96,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.656905+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:28.656905+0000","last_peered":"2024-09-16T07:57:28.656905+0000","last_clean":"2024-09-16T07:57:28.656905+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:28.656905+0000","last_undegraded":"2024-09-16T07:57:28.656905+0000","last_fullsized":"2024-09-16T07:57:28.656905+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"132'321","reported_seq":333,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.621564+0000","last_change":"2024-09-16T07:57:21.754262+0000","last_active":"2024-09-16T07:57:49.621564+0000","last_peered":"2024-09-16T07:57:49.621564+0000","last_clean":"2024-09-16T07:57:49.621564+0000","last_became_active":"2024-09-16T07:57:21.743887+0000","last_became_peered":"2024-09-16T07:57:21.743887+0000","last_unstale":"2024-09-16T07:57:49.621564+0000","last_undegraded":"2024-09-16T07:57:49.621564+0000","last_fullsized":"2024-09-16T07:57:49.621564+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":20544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"132'119","reported_seq":131,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.036329+0000","last_change":"2024-09-16T07:57:21.700152+0000","last_active":"2024-09-16T07:57:33.036329+0000","last_peered":"2024-09-16T07:57:33.036329+0000","last_clean":"2024-09-16T07:57:33.036329+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:57:33.036329+0000","last_undegraded":"2024-09-16T07:57:33.036329+0000","last_fullsized":"2024-09-16T07:57:33.036329+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":397,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545175+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:22.545175+0000","last_peered":"2024-09-16T07:57:22.545175+0000","last_clean":"2024-09-16T07:57:22.545175+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:22.545175+0000","last_undegraded":"2024-09-16T07:57:22.545175+0000","last_fullsized":"2024-09-16T07:57:22.545175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":334,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.551263+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:22.551263+0000","last_peered":"2024-09-16T07:57:22.551263+0000","last_clean":"2024-09-16T07:57:22.551263+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:22.551263+0000","last_undegraded":"2024-09-16T07:57:22.551263+0000","last_fullsized":"2024-09-16T07:57:22.551263+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"132'324","reported_seq":336,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.983843+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:57:49.983843+0000","last_peered":"2024-09-16T07:57:49.983843+0000","last_clean":"2024-09-16T07:57:49.983843+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:57:49.983843+0000","last_undegraded":"2024-09-16T07:57:49.983843+0000","last_fullsized":"2024-09-16T07:57:49.983843+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":20736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:22.545777+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'93","reported_seq":105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.722433+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:28.722433+0000","last_peered":"2024-09-16T07:57:28.722433+0000","last_clean":"2024-09-16T07:57:28.722433+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:28.722433+0000","last_undegraded":"2024-09-16T07:57:28.722433+0000","last_fullsized":"2024-09-16T07:57:28.722433+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":315,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.558168+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:22.558168+0000","last_peered":"2024-09-16T07:57:22.558168+0000","last_clean":"2024-09-16T07:57:22.558168+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:22.558168+0000","last_undegraded":"2024-09-16T07:57:22.558168+0000","last_fullsized":"2024-09-16T07:57:22.558168+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"132'330","reported_seq":342,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.802781+0000","last_change":"2024-09-16T07:57:21.704253+0000","last_active":"2024-09-16T07:57:49.802781+0000","last_peered":"2024-09-16T07:57:49.802781+0000","last_clean":"2024-09-16T07:57:49.802781+0000","last_became_active":"2024-09-16T07:57:21.683562+0000","last_became_peered":"2024-09-16T07:57:21.683562+0000","last_unstale":"2024-09-16T07:57:49.802781+0000","last_undegraded":"2024-09-16T07:57:49.802781+0000","last_fullsized":"2024-09-16T07:57:49.802781+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:22.550570+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:52.194250+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'59","reported_seq":71,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:28.670887+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:28.670887+0000","last_peered":"2024-09-16T07:57:28.670887+0000","last_clean":"2024-09-16T07:57:28.670887+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:28.670887+0000","last_undegraded":"2024-09-16T07:57:28.670887+0000","last_fullsized":"2024-09-16T07:57:28.670887+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.546751+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:22.546751+0000","last_peered":"2024-09-16T07:57:22.546751+0000","last_clean":"2024-09-16T07:57:22.546751+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:22.546751+0000","last_undegraded":"2024-09-16T07:57:22.546751+0000","last_fullsized":"2024-09-16T07:57:22.546751+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"132'135","reported_seq":147,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:33.079236+0000","last_change":"2024-09-16T07:57:21.653427+0000","last_active":"2024-09-16T07:57:33.079236+0000","last_peered":"2024-09-16T07:57:33.079236+0000","last_clean":"2024-09-16T07:57:33.079236+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:57:33.079236+0000","last_undegraded":"2024-09-16T07:57:33.079236+0000","last_fullsized":"2024-09-16T07:57:33.079236+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"132'111","reported_seq":123,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:32.706917+0000","last_change":"2024-09-16T07:57:21.704210+0000","last_active":"2024-09-16T07:57:32.706917+0000","last_peered":"2024-09-16T07:57:32.706917+0000","last_clean":"2024-09-16T07:57:32.706917+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:57:32.706917+0000","last_undegraded":"2024-09-16T07:57:32.706917+0000","last_fullsized":"2024-09-16T07:57:32.706917+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":327,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.556270+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:22.556270+0000","last_peered":"2024-09-16T07:57:22.556270+0000","last_clean":"2024-09-16T07:57:22.556270+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:22.556270+0000","last_undegraded":"2024-09-16T07:57:22.556270+0000","last_fullsized":"2024-09-16T07:57:22.556270+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":181338112,"num_objects":2767,"num_object_clones":0,"num_object_copies":8301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2767,"num_write_kb":177088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":43577344,"data_stored":697237504,"data_compressed":33105238,"data_compressed_allocated":43577344,"data_compressed_original":697237504,"omap_allocated":0,"internal_metadata":0},"log_size":2767,"ondisk_log_size":2767,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68396,"kb_used_data":8220,"kb_used_omap":0,"kb_used_meta":60160,"kb_avail":94303444,"statfs":{"total":96636764160,"available":96566726656,"internally_reserved":0,"allocated":8417280,"data_stored":117102955,"data_compressed":5540355,"data_compressed_allocated":7294976,"data_compressed_original":116637696,"omap_allocated":0,"internal_metadata":61603840},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500732,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33060,"kb_used_data":3916,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":4009984,"data_stored":46520702,"data_compressed":2189127,"data_compressed_allocated":2883584,"data_compressed_original":46055424,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58496,"kb_used_data":17200,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94313344,"statfs":{"total":96636764160,"available":96576864256,"internally_reserved":0,"allocated":17612800,"data_stored":264558430,"data_compressed":12540468,"data_compressed_allocated":16506880,"data_compressed_original":264110080,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17051648,"data_stored":272826368,"data_compressed":12954364,"data_compressed_allocated":17051648,"data_compressed_original":272826368,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2953216,"data_stored":47251456,"data_compressed":2243110,"data_compressed_allocated":2953216,"data_compressed_original":47251456,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7852032,"data_stored":125632512,"data_compressed":5964666,"data_compressed_allocated":7852032,"data_compressed_original":125632512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:57:59.626 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 37 16 6965 6949 11.7371 11.5625 0.145192 0.0850828 2024-09-16T07:58:00.108 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:58:00.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:00.251+0000 7f7834d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:00.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:00.262+0000 7f7834d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:00.626 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 38 16 7136 7120 11.7095 10.6875 0.121444 0.0852468 2024-09-16T07:58:01.626 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 39 16 7321 7305 11.7057 11.5625 0.0866231 0.0853287 2024-09-16T07:58:02.564 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:58:02.626 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:58:02.628348+0000 min lat: 0.0156257 max lat: 0.259311 avg lat: 0.0854426 2024-09-16T07:58:02.626 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:58:02.626 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 40 16 7497 7481 11.688 11 0.0474178 0.0854426 2024-09-16T07:58:02.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:02.715+0000 7f110f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:02.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:02.723+0000 7f110f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:03.626 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 41 16 7686 7670 11.691 11.8125 0.046436 0.0854313 2024-09-16T07:58:04.503 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 0, 2, 1] 2024-09-16T07:58:04.503 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:58:04.626 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 42 16 7867 7851 11.682 11.3125 0.126626 0.0855171 2024-09-16T07:58:04.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:04.650+0000 7f9d1a074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:04.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:04.670+0000 7f9d1a074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:05.025 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:58:05.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:05.188+0000 7f0c05711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:05.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:05.197+0000 7f0c05711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:05.530 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:58:05.549 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:58:05.626 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 43 16 8032 8016 11.6501 10.3125 0.134586 0.0856839 2024-09-16T07:58:05.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:05.701+0000 7f8d8e85c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:05.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:05.718+0000 7f8d8e85c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:06.531 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:58:06.550 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:58:06.626 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 44 16 8197 8181 11.6197 10.3125 0.124676 0.0859516 2024-09-16T07:58:06.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:06.732+0000 7f9a8a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:06.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:06.746+0000 7f9a8a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:07.538 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:58:07.563 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:58:07.627 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 45 16 8380 8364 11.6156 11.4375 0.0812489 0.0859841 2024-09-16T07:58:07.683 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:58:07.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:07.757+0000 7f4a9d674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:07.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:07.770+0000 7f4a9d674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:07.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:07.852+0000 7f1432c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:07.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:07.864+0000 7f1432c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:08.627 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 46 16 8552 8536 11.5968 10.75 0.0917634 0.0861099 2024-09-16T07:58:09.057 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:58:09.080 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:58:09.080 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:09.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:09.219+0000 7fd19ecfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:09.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:09.229+0000 7fd19ecfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:09.601 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:09.601 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:58:09.622 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":521,"stamp":"2024-09-16T07:58:09.061462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":435552808,"num_objects":6641,"num_object_clones":0,"num_object_copies":19923,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6717,"num_write_kb":425875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6692,"ondisk_log_size":6692,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":255232,"kb_used_data":79292,"kb_used_omap":0,"kb_used_meta":175872,"kb_avail":377232128,"statfs":{"total":386547056640,"available":386285699072,"internally_reserved":0,"allocated":81195008,"data_stored":1229022149,"data_compressed":58278081,"data_compressed_allocated":76713984,"data_compressed_original":1227177984,"omap_allocated":0,"internal_metadata":180092928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.528774"},"pg_stats":[{"pgid":"7.f","version":"132'481","reported_seq":493,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:58:03.141364+0000","last_change":"2024-09-16T07:57:21.677659+0000","last_active":"2024-09-16T07:58:03.141364+0000","last_peered":"2024-09-16T07:58:03.141364+0000","last_clean":"2024-09-16T07:58:03.141364+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:03.141364+0000","last_undegraded":"2024-09-16T07:58:03.141364+0000","last_fullsized":"2024-09-16T07:58:03.141364+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31522816,"num_objects":481,"num_object_clones":0,"num_object_copies":1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":30784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"132'330","reported_seq":342,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.896375+0000","last_change":"2024-09-16T07:57:21.730082+0000","last_active":"2024-09-16T07:57:49.896375+0000","last_peered":"2024-09-16T07:57:49.896375+0000","last_clean":"2024-09-16T07:57:49.896375+0000","last_became_active":"2024-09-16T07:57:21.701780+0000","last_became_peered":"2024-09-16T07:57:21.701780+0000","last_unstale":"2024-09-16T07:57:49.896375+0000","last_undegraded":"2024-09-16T07:57:49.896375+0000","last_fullsized":"2024-09-16T07:57:49.896375+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"132'403","reported_seq":415,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:58.620788+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:58.620788+0000","last_peered":"2024-09-16T07:57:58.620788+0000","last_clean":"2024-09-16T07:57:58.620788+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:58.620788+0000","last_undegraded":"2024-09-16T07:57:58.620788+0000","last_fullsized":"2024-09-16T07:57:58.620788+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26411008,"num_objects":403,"num_object_clones":0,"num_object_copies":1209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'425","reported_seq":437,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:58.763510+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:58.763510+0000","last_peered":"2024-09-16T07:57:58.763510+0000","last_clean":"2024-09-16T07:57:58.763510+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:58.763510+0000","last_undegraded":"2024-09-16T07:57:58.763510+0000","last_fullsized":"2024-09-16T07:57:58.763510+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27852800,"num_objects":425,"num_object_clones":0,"num_object_copies":1275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":27200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"132'447","reported_seq":459,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:58:02.938850+0000","last_change":"2024-09-16T07:57:21.747923+0000","last_active":"2024-09-16T07:58:02.938850+0000","last_peered":"2024-09-16T07:58:02.938850+0000","last_clean":"2024-09-16T07:58:02.938850+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:02.938850+0000","last_undegraded":"2024-09-16T07:58:02.938850+0000","last_fullsized":"2024-09-16T07:58:02.938850+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29294592,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"132'490","reported_seq":502,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:58:02.955724+0000","last_change":"2024-09-16T07:57:21.678939+0000","last_active":"2024-09-16T07:58:02.955724+0000","last_peered":"2024-09-16T07:58:02.955724+0000","last_clean":"2024-09-16T07:58:02.955724+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:02.955724+0000","last_undegraded":"2024-09-16T07:58:02.955724+0000","last_fullsized":"2024-09-16T07:58:02.955724+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"132'464","reported_seq":476,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:58.714519+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:58.714519+0000","last_peered":"2024-09-16T07:57:58.714519+0000","last_clean":"2024-09-16T07:57:58.714519+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:58.714519+0000","last_undegraded":"2024-09-16T07:57:58.714519+0000","last_fullsized":"2024-09-16T07:57:58.714519+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30408704,"num_objects":464,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":29696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"132'321","reported_seq":333,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.621564+0000","last_change":"2024-09-16T07:57:21.754262+0000","last_active":"2024-09-16T07:57:49.621564+0000","last_peered":"2024-09-16T07:57:49.621564+0000","last_clean":"2024-09-16T07:57:49.621564+0000","last_became_active":"2024-09-16T07:57:21.743887+0000","last_became_peered":"2024-09-16T07:57:21.743887+0000","last_unstale":"2024-09-16T07:57:49.621564+0000","last_undegraded":"2024-09-16T07:57:49.621564+0000","last_fullsized":"2024-09-16T07:57:49.621564+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":20544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"132'514","reported_seq":526,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:58:03.099660+0000","last_change":"2024-09-16T07:57:21.700152+0000","last_active":"2024-09-16T07:58:03.099660+0000","last_peered":"2024-09-16T07:58:03.099660+0000","last_clean":"2024-09-16T07:58:03.099660+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:03.099660+0000","last_undegraded":"2024-09-16T07:58:03.099660+0000","last_fullsized":"2024-09-16T07:58:03.099660+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33685504,"num_objects":514,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":514,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":397,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545175+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:22.545175+0000","last_peered":"2024-09-16T07:57:22.545175+0000","last_clean":"2024-09-16T07:57:22.545175+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:22.545175+0000","last_undegraded":"2024-09-16T07:57:22.545175+0000","last_fullsized":"2024-09-16T07:57:22.545175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":334,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.551263+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:22.551263+0000","last_peered":"2024-09-16T07:57:22.551263+0000","last_clean":"2024-09-16T07:57:22.551263+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:22.551263+0000","last_undegraded":"2024-09-16T07:57:22.551263+0000","last_fullsized":"2024-09-16T07:57:22.551263+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"132'324","reported_seq":336,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.983843+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:57:49.983843+0000","last_peered":"2024-09-16T07:57:49.983843+0000","last_clean":"2024-09-16T07:57:49.983843+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:57:49.983843+0000","last_undegraded":"2024-09-16T07:57:49.983843+0000","last_fullsized":"2024-09-16T07:57:49.983843+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":20736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:22.545777+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'469","reported_seq":481,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:58.702822+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:58.702822+0000","last_peered":"2024-09-16T07:57:58.702822+0000","last_clean":"2024-09-16T07:57:58.702822+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:58.702822+0000","last_undegraded":"2024-09-16T07:57:58.702822+0000","last_fullsized":"2024-09-16T07:57:58.702822+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30736384,"num_objects":469,"num_object_clones":0,"num_object_copies":1407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":469,"num_write_kb":30016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":315,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.558168+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:22.558168+0000","last_peered":"2024-09-16T07:57:22.558168+0000","last_clean":"2024-09-16T07:57:22.558168+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:22.558168+0000","last_undegraded":"2024-09-16T07:57:22.558168+0000","last_fullsized":"2024-09-16T07:57:22.558168+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"132'330","reported_seq":342,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.802781+0000","last_change":"2024-09-16T07:57:21.704253+0000","last_active":"2024-09-16T07:57:49.802781+0000","last_peered":"2024-09-16T07:57:49.802781+0000","last_clean":"2024-09-16T07:57:49.802781+0000","last_became_active":"2024-09-16T07:57:21.683562+0000","last_became_peered":"2024-09-16T07:57:21.683562+0000","last_unstale":"2024-09-16T07:57:49.802781+0000","last_undegraded":"2024-09-16T07:57:49.802781+0000","last_fullsized":"2024-09-16T07:57:49.802781+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:22.550570+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:52.194250+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'419","reported_seq":431,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:58.745344+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:58.745344+0000","last_peered":"2024-09-16T07:57:58.745344+0000","last_clean":"2024-09-16T07:57:58.745344+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:58.745344+0000","last_undegraded":"2024-09-16T07:57:58.745344+0000","last_fullsized":"2024-09-16T07:57:58.745344+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27459584,"num_objects":419,"num_object_clones":0,"num_object_copies":1257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":26816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.546751+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:22.546751+0000","last_peered":"2024-09-16T07:57:22.546751+0000","last_clean":"2024-09-16T07:57:22.546751+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:22.546751+0000","last_undegraded":"2024-09-16T07:57:22.546751+0000","last_fullsized":"2024-09-16T07:57:22.546751+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"132'450","reported_seq":462,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:58:03.058944+0000","last_change":"2024-09-16T07:57:21.653427+0000","last_active":"2024-09-16T07:58:03.058944+0000","last_peered":"2024-09-16T07:58:03.058944+0000","last_clean":"2024-09-16T07:58:03.058944+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:03.058944+0000","last_undegraded":"2024-09-16T07:58:03.058944+0000","last_fullsized":"2024-09-16T07:58:03.058944+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29491200,"num_objects":450,"num_object_clones":0,"num_object_copies":1350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":28800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"132'447","reported_seq":459,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:58:03.120516+0000","last_change":"2024-09-16T07:57:21.704210+0000","last_active":"2024-09-16T07:58:03.120516+0000","last_peered":"2024-09-16T07:58:03.120516+0000","last_clean":"2024-09-16T07:58:03.120516+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:03.120516+0000","last_undegraded":"2024-09-16T07:58:03.120516+0000","last_fullsized":"2024-09-16T07:58:03.120516+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29294592,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":327,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.556270+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:22.556270+0000","last_peered":"2024-09-16T07:57:22.556270+0000","last_clean":"2024-09-16T07:57:22.556270+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:22.556270+0000","last_undegraded":"2024-09-16T07:57:22.556270+0000","last_fullsized":"2024-09-16T07:57:22.556270+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":434962432,"num_objects":6637,"num_object_clones":0,"num_object_copies":19911,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6637,"num_write_kb":424768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77856768,"data_stored":1245708288,"data_compressed":59149566,"data_compressed_allocated":77856768,"data_compressed_original":1245708288,"omap_allocated":0,"internal_metadata":0},"log_size":6637,"ondisk_log_size":6637,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93376,"kb_used_data":29036,"kb_used_omap":0,"kb_used_meta":64320,"kb_avail":94278464,"statfs":{"total":96636764160,"available":96541147136,"internally_reserved":0,"allocated":29732864,"data_stored":458152299,"data_compressed":21735203,"data_compressed_allocated":28610560,"data_compressed_original":457687040,"omap_allocated":0,"internal_metadata":65863680},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500762,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58248,"kb_used_data":16632,"kb_used_omap":0,"kb_used_meta":41600,"kb_avail":94313592,"statfs":{"total":96636764160,"available":96577118208,"internally_reserved":0,"allocated":17031168,"data_stored":254859646,"data_compressed":12082175,"data_compressed_allocated":15904768,"data_compressed_original":254394368,"omap_allocated":0,"internal_metadata":42598400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58496,"kb_used_data":17200,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94313344,"statfs":{"total":96636764160,"available":96576864256,"internally_reserved":0,"allocated":17612800,"data_stored":264558430,"data_compressed":12540468,"data_compressed_allocated":16506880,"data_compressed_original":264110080,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17051648,"data_stored":272826368,"data_compressed":12954364,"data_compressed_allocated":17051648,"data_compressed_original":272826368,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15937536,"data_stored":255000576,"data_compressed":12108150,"data_compressed_allocated":15937536,"data_compressed_original":255000576,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29147136,"data_stored":466354176,"data_compressed":22143954,"data_compressed_allocated":29147136,"data_compressed_original":466354176,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:58:09.624 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:09.627 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 47 16 8719 8703 11.5721 10.4375 0.11947 0.0862956 2024-09-16T07:58:09.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:09.790+0000 7fdb80191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:09.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:09.804+0000 7fdb80191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:10.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:10.197 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:58:10.218 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":521,"stamp":"2024-09-16T07:58:09.061462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":435552808,"num_objects":6641,"num_object_clones":0,"num_object_copies":19923,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6717,"num_write_kb":425875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6692,"ondisk_log_size":6692,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":255232,"kb_used_data":79292,"kb_used_omap":0,"kb_used_meta":175872,"kb_avail":377232128,"statfs":{"total":386547056640,"available":386285699072,"internally_reserved":0,"allocated":81195008,"data_stored":1229022149,"data_compressed":58278081,"data_compressed_allocated":76713984,"data_compressed_original":1227177984,"omap_allocated":0,"internal_metadata":180092928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.528774"},"pg_stats":[{"pgid":"7.f","version":"132'481","reported_seq":493,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:58:03.141364+0000","last_change":"2024-09-16T07:57:21.677659+0000","last_active":"2024-09-16T07:58:03.141364+0000","last_peered":"2024-09-16T07:58:03.141364+0000","last_clean":"2024-09-16T07:58:03.141364+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:03.141364+0000","last_undegraded":"2024-09-16T07:58:03.141364+0000","last_fullsized":"2024-09-16T07:58:03.141364+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31522816,"num_objects":481,"num_object_clones":0,"num_object_copies":1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":481,"num_write_kb":30784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"132'330","reported_seq":342,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.896375+0000","last_change":"2024-09-16T07:57:21.730082+0000","last_active":"2024-09-16T07:57:49.896375+0000","last_peered":"2024-09-16T07:57:49.896375+0000","last_clean":"2024-09-16T07:57:49.896375+0000","last_became_active":"2024-09-16T07:57:21.701780+0000","last_became_peered":"2024-09-16T07:57:21.701780+0000","last_unstale":"2024-09-16T07:57:49.896375+0000","last_undegraded":"2024-09-16T07:57:49.896375+0000","last_fullsized":"2024-09-16T07:57:49.896375+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"132'403","reported_seq":415,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:58.620788+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:57:58.620788+0000","last_peered":"2024-09-16T07:57:58.620788+0000","last_clean":"2024-09-16T07:57:58.620788+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:57:58.620788+0000","last_undegraded":"2024-09-16T07:57:58.620788+0000","last_fullsized":"2024-09-16T07:57:58.620788+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26411008,"num_objects":403,"num_object_clones":0,"num_object_copies":1209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":403,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"132'425","reported_seq":437,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:58.763510+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:57:58.763510+0000","last_peered":"2024-09-16T07:57:58.763510+0000","last_clean":"2024-09-16T07:57:58.763510+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:57:58.763510+0000","last_undegraded":"2024-09-16T07:57:58.763510+0000","last_fullsized":"2024-09-16T07:57:58.763510+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27852800,"num_objects":425,"num_object_clones":0,"num_object_copies":1275,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":425,"num_write_kb":27200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"132'447","reported_seq":459,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:58:02.938850+0000","last_change":"2024-09-16T07:57:21.747923+0000","last_active":"2024-09-16T07:58:02.938850+0000","last_peered":"2024-09-16T07:58:02.938850+0000","last_clean":"2024-09-16T07:58:02.938850+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:02.938850+0000","last_undegraded":"2024-09-16T07:58:02.938850+0000","last_fullsized":"2024-09-16T07:58:02.938850+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29294592,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"132'490","reported_seq":502,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:58:02.955724+0000","last_change":"2024-09-16T07:57:21.678939+0000","last_active":"2024-09-16T07:58:02.955724+0000","last_peered":"2024-09-16T07:58:02.955724+0000","last_clean":"2024-09-16T07:58:02.955724+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:02.955724+0000","last_undegraded":"2024-09-16T07:58:02.955724+0000","last_fullsized":"2024-09-16T07:58:02.955724+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"132'464","reported_seq":476,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:58.714519+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:57:58.714519+0000","last_peered":"2024-09-16T07:57:58.714519+0000","last_clean":"2024-09-16T07:57:58.714519+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:57:58.714519+0000","last_undegraded":"2024-09-16T07:57:58.714519+0000","last_fullsized":"2024-09-16T07:57:58.714519+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30408704,"num_objects":464,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":29696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"132'321","reported_seq":333,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.621564+0000","last_change":"2024-09-16T07:57:21.754262+0000","last_active":"2024-09-16T07:57:49.621564+0000","last_peered":"2024-09-16T07:57:49.621564+0000","last_clean":"2024-09-16T07:57:49.621564+0000","last_became_active":"2024-09-16T07:57:21.743887+0000","last_became_peered":"2024-09-16T07:57:21.743887+0000","last_unstale":"2024-09-16T07:57:49.621564+0000","last_undegraded":"2024-09-16T07:57:49.621564+0000","last_fullsized":"2024-09-16T07:57:49.621564+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":20544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"132'514","reported_seq":526,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:58:03.099660+0000","last_change":"2024-09-16T07:57:21.700152+0000","last_active":"2024-09-16T07:58:03.099660+0000","last_peered":"2024-09-16T07:58:03.099660+0000","last_clean":"2024-09-16T07:58:03.099660+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:03.099660+0000","last_undegraded":"2024-09-16T07:58:03.099660+0000","last_fullsized":"2024-09-16T07:58:03.099660+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33685504,"num_objects":514,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":514,"num_write_kb":32896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":397,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545175+0000","last_change":"2024-09-16T07:56:29.693679+0000","last_active":"2024-09-16T07:57:22.545175+0000","last_peered":"2024-09-16T07:57:22.545175+0000","last_clean":"2024-09-16T07:57:22.545175+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:57:22.545175+0000","last_undegraded":"2024-09-16T07:57:22.545175+0000","last_fullsized":"2024-09-16T07:57:22.545175+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":334,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.551263+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:57:22.551263+0000","last_peered":"2024-09-16T07:57:22.551263+0000","last_clean":"2024-09-16T07:57:22.551263+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:57:22.551263+0000","last_undegraded":"2024-09-16T07:57:22.551263+0000","last_fullsized":"2024-09-16T07:57:22.551263+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"132'324","reported_seq":336,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.983843+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:57:49.983843+0000","last_peered":"2024-09-16T07:57:49.983843+0000","last_clean":"2024-09-16T07:57:49.983843+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:57:49.983843+0000","last_undegraded":"2024-09-16T07:57:49.983843+0000","last_fullsized":"2024-09-16T07:57:49.983843+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21233664,"num_objects":324,"num_object_clones":0,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":324,"num_write_kb":20736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:57:22.545777+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"132'469","reported_seq":481,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:58.702822+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:57:58.702822+0000","last_peered":"2024-09-16T07:57:58.702822+0000","last_clean":"2024-09-16T07:57:58.702822+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:57:58.702822+0000","last_undegraded":"2024-09-16T07:57:58.702822+0000","last_fullsized":"2024-09-16T07:57:58.702822+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30736384,"num_objects":469,"num_object_clones":0,"num_object_copies":1407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":469,"num_write_kb":30016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":315,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.558168+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:57:22.558168+0000","last_peered":"2024-09-16T07:57:22.558168+0000","last_clean":"2024-09-16T07:57:22.558168+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:57:22.558168+0000","last_undegraded":"2024-09-16T07:57:22.558168+0000","last_fullsized":"2024-09-16T07:57:22.558168+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"132'330","reported_seq":342,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:49.802781+0000","last_change":"2024-09-16T07:57:21.704253+0000","last_active":"2024-09-16T07:57:49.802781+0000","last_peered":"2024-09-16T07:57:49.802781+0000","last_clean":"2024-09-16T07:57:49.802781+0000","last_became_active":"2024-09-16T07:57:21.683562+0000","last_became_peered":"2024-09-16T07:57:21.683562+0000","last_unstale":"2024-09-16T07:57:49.802781+0000","last_undegraded":"2024-09-16T07:57:49.802781+0000","last_fullsized":"2024-09-16T07:57:49.802781+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21626880,"num_objects":330,"num_object_clones":0,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":330,"num_write_kb":21120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:57:22.550570+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:57:52.194250+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.542650+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:57:22.542650+0000","last_peered":"2024-09-16T07:57:22.542650+0000","last_clean":"2024-09-16T07:57:22.542650+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:57:22.542650+0000","last_undegraded":"2024-09-16T07:57:22.542650+0000","last_fullsized":"2024-09-16T07:57:22.542650+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"132'419","reported_seq":431,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:58.745344+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:57:58.745344+0000","last_peered":"2024-09-16T07:57:58.745344+0000","last_clean":"2024-09-16T07:57:58.745344+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:57:58.745344+0000","last_undegraded":"2024-09-16T07:57:58.745344+0000","last_fullsized":"2024-09-16T07:57:58.745344+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27459584,"num_objects":419,"num_object_clones":0,"num_object_copies":1257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":26816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":332,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.546751+0000","last_change":"2024-09-16T07:56:30.648896+0000","last_active":"2024-09-16T07:57:22.546751+0000","last_peered":"2024-09-16T07:57:22.546751+0000","last_clean":"2024-09-16T07:57:22.546751+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:57:22.546751+0000","last_undegraded":"2024-09-16T07:57:22.546751+0000","last_fullsized":"2024-09-16T07:57:22.546751+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"132'450","reported_seq":462,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:58:03.058944+0000","last_change":"2024-09-16T07:57:21.653427+0000","last_active":"2024-09-16T07:58:03.058944+0000","last_peered":"2024-09-16T07:58:03.058944+0000","last_clean":"2024-09-16T07:58:03.058944+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:03.058944+0000","last_undegraded":"2024-09-16T07:58:03.058944+0000","last_fullsized":"2024-09-16T07:58:03.058944+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29491200,"num_objects":450,"num_object_clones":0,"num_object_copies":1350,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":28800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":356,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.541197+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:57:22.541197+0000","last_peered":"2024-09-16T07:57:22.541197+0000","last_clean":"2024-09-16T07:57:22.541197+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:57:22.541197+0000","last_undegraded":"2024-09-16T07:57:22.541197+0000","last_fullsized":"2024-09-16T07:57:22.541197+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"132'447","reported_seq":459,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:58:03.120516+0000","last_change":"2024-09-16T07:57:21.704210+0000","last_active":"2024-09-16T07:58:03.120516+0000","last_peered":"2024-09-16T07:58:03.120516+0000","last_clean":"2024-09-16T07:58:03.120516+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:03.120516+0000","last_undegraded":"2024-09-16T07:58:03.120516+0000","last_fullsized":"2024-09-16T07:58:03.120516+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29294592,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":447,"num_write_kb":28608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":327,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-16T07:57:22.556270+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:57:22.556270+0000","last_peered":"2024-09-16T07:57:22.556270+0000","last_clean":"2024-09-16T07:57:22.556270+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:57:22.556270+0000","last_undegraded":"2024-09-16T07:57:22.556270+0000","last_fullsized":"2024-09-16T07:57:22.556270+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":434962432,"num_objects":6637,"num_object_clones":0,"num_object_copies":19911,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6637,"num_write_kb":424768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77856768,"data_stored":1245708288,"data_compressed":59149566,"data_compressed_allocated":77856768,"data_compressed_original":1245708288,"omap_allocated":0,"internal_metadata":0},"log_size":6637,"ondisk_log_size":6637,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122287,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93376,"kb_used_data":29036,"kb_used_omap":0,"kb_used_meta":64320,"kb_avail":94278464,"statfs":{"total":96636764160,"available":96541147136,"internally_reserved":0,"allocated":29732864,"data_stored":458152299,"data_compressed":21735203,"data_compressed_allocated":28610560,"data_compressed_original":457687040,"omap_allocated":0,"internal_metadata":65863680},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500762,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58248,"kb_used_data":16632,"kb_used_omap":0,"kb_used_meta":41600,"kb_avail":94313592,"statfs":{"total":96636764160,"available":96577118208,"internally_reserved":0,"allocated":17031168,"data_stored":254859646,"data_compressed":12082175,"data_compressed_allocated":15904768,"data_compressed_original":254394368,"omap_allocated":0,"internal_metadata":42598400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075578,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58496,"kb_used_data":17200,"kb_used_omap":0,"kb_used_meta":41280,"kb_avail":94313344,"statfs":{"total":96636764160,"available":96576864256,"internally_reserved":0,"allocated":17612800,"data_stored":264558430,"data_compressed":12540468,"data_compressed_allocated":16506880,"data_compressed_original":264110080,"omap_allocated":0,"internal_metadata":42270720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17051648,"data_stored":272826368,"data_compressed":12954364,"data_compressed_allocated":17051648,"data_compressed_original":272826368,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15937536,"data_stored":255000576,"data_compressed":12108150,"data_compressed_allocated":15937536,"data_compressed_original":255000576,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29147136,"data_stored":466354176,"data_compressed":22143954,"data_compressed_allocated":29147136,"data_compressed_original":466354176,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:58:10.219 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:58:10.219 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:58:10.220 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [3, 0, 2, 1] 2024-09-16T07:58:10.220 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T07:58:10.220 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:58:10.352 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:58:10.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:10.464+0000 7ff9cc8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:10.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:10.471+0000 7ff9cc8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:10.627 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 48 16 8806 8790 11.4443 5.4375 0.0565172 0.0867359 2024-09-16T07:58:11.627 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 49 16 8806 8790 11.2107 0 - 0.0867359 2024-09-16T07:58:12.627 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 50 16 8806 8790 10.9865 0 - 0.0867359 2024-09-16T07:58:13.628 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 51 16 8806 8790 10.771 0 - 0.0867359 2024-09-16T07:58:14.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-16T07:58:14.628 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 52 16 8806 8790 10.5639 0 - 0.0867359 2024-09-16T07:58:15.628 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 53 16 8806 8790 10.3646 0 - 0.0867359 2024-09-16T07:58:16.321 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T07:58:16.628 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 54 16 8806 8790 10.1726 0 - 0.0867359 2024-09-16T07:58:17.628 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 55 16 8806 8790 9.98765 0 - 0.0867359 2024-09-16T07:58:18.628 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 56 16 8806 8790 9.80929 0 - 0.0867359 2024-09-16T07:58:19.628 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 57 16 8806 8790 9.63719 0 - 0.0867359 2024-09-16T07:58:19.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-16T07:58:20.629 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 58 16 8806 8790 9.47102 0 - 0.0867359 2024-09-16T07:58:21.322 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [3, 2, 1] 2024-09-16T07:58:21.322 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-16T07:58:21.322 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:58:21.322 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T07:58:21.326 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:58:21.326 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:58:21.440 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:58:21.444 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:58:21.444 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:58:21.629 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 59 16 8806 8790 9.31048 0 - 0.0867359 2024-09-16T07:58:22.629 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:58:22.631002+0000 min lat: 0.0156257 max lat: 0.259311 avg lat: 0.0867359 2024-09-16T07:58:22.629 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:58:22.629 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 60 16 8806 8790 9.1553 0 - 0.0867359 2024-09-16T07:58:23.633 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 61 16 8806 8790 9.00521 0 - 0.0867359 2024-09-16T07:58:24.629 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 62 16 8806 8790 8.85996 0 - 0.0867359 2024-09-16T07:58:25.629 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 63 16 8806 8790 8.71933 0 - 0.0867359 2024-09-16T07:58:26.445 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:58:26.551 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:58:26.554 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:58:26.554 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T07:58:26.629 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 64 16 8806 8790 8.58309 0 - 0.0867359 2024-09-16T07:58:27.630 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 65 16 8806 8790 8.45104 0 - 0.0867359 2024-09-16T07:58:28.630 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 66 16 8806 8790 8.32299 0 - 0.0867359 2024-09-16T07:58:29.630 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 67 16 8806 8790 8.19876 0 - 0.0867359 2024-09-16T07:58:30.630 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 68 16 8806 8790 8.0782 0 - 0.0867359 2024-09-16T07:58:31.556 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T07:58:31.630 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 69 16 8806 8790 7.96112 0 - 0.0867359 2024-09-16T07:58:31.662 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T07:58:31.662 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [] 2024-09-16T07:58:31.662 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T07:58:31.673 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:58:31.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:31.783+0000 7fa98eaac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:31.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:31.794+0000 7fa98eaac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:32.067 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:58:32.069 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T07:58:32.089 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:58:32.242 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:58:32.242 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:58:32.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:32.242+0000 7fe0ded91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:32.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:32.255+0000 7fe0ded91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:32.630 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 70 16 8806 8790 7.84738 0 - 0.0867359 2024-09-16T07:58:33.055 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:58:33.078 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:58:33.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:33.272+0000 7f0fb6688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:33.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:33.284+0000 7f0fb6688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:33.630 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 71 16 8806 8790 7.73685 0 - 0.0867359 2024-09-16T07:58:34.084 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:58:34.103 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:58:34.243 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:58:34.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:34.253+0000 7f850549c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:34.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:34.274+0000 7f850549c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:34.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:34.399+0000 7f5f24d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:34.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:34.407+0000 7f5f24d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:34.630 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 72 16 8830 8814 7.65023 0.0625 0.0459482 0.127779 2024-09-16T07:58:35.085 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:58:35.107 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:58:35.108 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:35.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:35.240+0000 7f617a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:35.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:35.253+0000 7f617a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:35.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:35.537 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:58:35.560 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":539,"stamp":"2024-09-16T07:58:35.087935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":564199976,"num_objects":8604,"num_object_clones":0,"num_object_copies":25812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8680,"num_write_kb":551507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8655,"ondisk_log_size":8655,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248248,"kb_used_data":101432,"kb_used_omap":0,"kb_used_meta":146752,"kb_avail":377239112,"statfs":{"total":386547056640,"available":386292850688,"internally_reserved":0,"allocated":103866368,"data_stored":1589336617,"data_compressed":75384745,"data_compressed_allocated":99229696,"data_compressed_original":1587429376,"omap_allocated":0,"internal_metadata":150274048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.622576"},"pg_stats":[{"pgid":"7.f","version":"137'557","reported_seq":590,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.117773+0000","last_change":"2024-09-16T07:58:32.124703+0000","last_active":"2024-09-16T07:58:32.124703+0000","last_peered":"2024-09-16T07:58:13.076723+0000","last_clean":"2024-09-16T07:58:13.076723+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:33.117773+0000","last_undegraded":"2024-09-16T07:58:33.117773+0000","last_fullsized":"2024-09-16T07:58:33.117773+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071891+0000","last_change":"2024-09-16T07:57:21.730082+0000","last_active":"2024-09-16T07:58:13.071891+0000","last_peered":"2024-09-16T07:58:13.071891+0000","last_clean":"2024-09-16T07:58:13.071891+0000","last_became_active":"2024-09-16T07:57:21.701780+0000","last_became_peered":"2024-09-16T07:57:21.701780+0000","last_unstale":"2024-09-16T07:58:13.071891+0000","last_undegraded":"2024-09-16T07:58:13.071891+0000","last_fullsized":"2024-09-16T07:58:13.071891+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.066949+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:13.066949+0000","last_peered":"2024-09-16T07:58:13.066949+0000","last_clean":"2024-09-16T07:58:13.066949+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:13.066949+0000","last_undegraded":"2024-09-16T07:58:13.066949+0000","last_fullsized":"2024-09-16T07:58:13.066949+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"137'533","reported_seq":563,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.072390+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:13.072390+0000","last_peered":"2024-09-16T07:58:13.072390+0000","last_clean":"2024-09-16T07:58:13.072390+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:13.072390+0000","last_undegraded":"2024-09-16T07:58:13.072390+0000","last_fullsized":"2024-09-16T07:58:13.072390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"137'508","reported_seq":541,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.116150+0000","last_change":"2024-09-16T07:58:32.142013+0000","last_active":"2024-09-16T07:58:32.142013+0000","last_peered":"2024-09-16T07:58:13.076585+0000","last_clean":"2024-09-16T07:58:13.076585+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:33.116150+0000","last_undegraded":"2024-09-16T07:58:33.116150+0000","last_fullsized":"2024-09-16T07:58:33.116150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"137'554","reported_seq":586,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.106969+0000","last_change":"2024-09-16T07:58:32.106969+0000","last_active":"2024-09-16T07:58:32.106969+0000","last_peered":"2024-09-16T07:58:13.070933+0000","last_clean":"2024-09-16T07:58:13.070933+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:32.106969+0000","last_undegraded":"2024-09-16T07:58:32.106969+0000","last_fullsized":"2024-09-16T07:58:32.106969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"137'603","reported_seq":633,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073722+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:13.073722+0000","last_peered":"2024-09-16T07:58:13.073722+0000","last_clean":"2024-09-16T07:58:13.073722+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:13.073722+0000","last_undegraded":"2024-09-16T07:58:13.073722+0000","last_fullsized":"2024-09-16T07:58:13.073722+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"137'543","reported_seq":573,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073405+0000","last_change":"2024-09-16T07:57:21.754262+0000","last_active":"2024-09-16T07:58:13.073405+0000","last_peered":"2024-09-16T07:58:13.073405+0000","last_clean":"2024-09-16T07:58:13.073405+0000","last_became_active":"2024-09-16T07:57:21.743887+0000","last_became_peered":"2024-09-16T07:57:21.743887+0000","last_unstale":"2024-09-16T07:58:13.073405+0000","last_undegraded":"2024-09-16T07:58:13.073405+0000","last_fullsized":"2024-09-16T07:58:13.073405+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"137'576","reported_seq":608,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.132254+0000","last_change":"2024-09-16T07:58:32.132254+0000","last_active":"2024-09-16T07:58:32.132254+0000","last_peered":"2024-09-16T07:58:13.074775+0000","last_clean":"2024-09-16T07:58:13.074775+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:32.132254+0000","last_undegraded":"2024-09-16T07:58:32.132254+0000","last_fullsized":"2024-09-16T07:58:32.132254+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":417,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.095446+0000","last_change":"2024-09-16T07:58:32.095446+0000","last_active":"2024-09-16T07:58:32.095446+0000","last_peered":"2024-09-16T07:58:13.070190+0000","last_clean":"2024-09-16T07:58:13.070190+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:58:32.095446+0000","last_undegraded":"2024-09-16T07:58:32.095446+0000","last_fullsized":"2024-09-16T07:58:32.095446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":352,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.068775+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:13.068775+0000","last_peered":"2024-09-16T07:58:13.068775+0000","last_clean":"2024-09-16T07:58:13.068775+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:13.068775+0000","last_undegraded":"2024-09-16T07:58:13.068775+0000","last_fullsized":"2024-09-16T07:58:13.068775+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067625+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:13.067625+0000","last_peered":"2024-09-16T07:58:13.067625+0000","last_clean":"2024-09-16T07:58:13.067625+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:13.067625+0000","last_undegraded":"2024-09-16T07:58:13.067625+0000","last_fullsized":"2024-09-16T07:58:13.067625+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:58:32.069085+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"137'597","reported_seq":627,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071646+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:58:13.071646+0000","last_peered":"2024-09-16T07:58:13.071646+0000","last_clean":"2024-09-16T07:58:13.071646+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:58:13.071646+0000","last_undegraded":"2024-09-16T07:58:13.071646+0000","last_fullsized":"2024-09-16T07:58:13.071646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":333,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.074065+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:13.074065+0000","last_peered":"2024-09-16T07:58:13.074065+0000","last_clean":"2024-09-16T07:58:13.074065+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:13.074065+0000","last_undegraded":"2024-09-16T07:58:13.074065+0000","last_fullsized":"2024-09-16T07:58:13.074065+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069554+0000","last_change":"2024-09-16T07:57:21.704253+0000","last_active":"2024-09-16T07:58:13.069554+0000","last_peered":"2024-09-16T07:58:13.069554+0000","last_clean":"2024-09-16T07:58:13.069554+0000","last_became_active":"2024-09-16T07:57:21.683562+0000","last_became_peered":"2024-09-16T07:57:21.683562+0000","last_unstale":"2024-09-16T07:58:13.069554+0000","last_undegraded":"2024-09-16T07:58:13.069554+0000","last_fullsized":"2024-09-16T07:58:13.069554+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:58:32.069088+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:58:32.069090+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067638+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:58:13.067638+0000","last_peered":"2024-09-16T07:58:13.067638+0000","last_clean":"2024-09-16T07:58:13.067638+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:58:13.067638+0000","last_undegraded":"2024-09-16T07:58:13.067638+0000","last_fullsized":"2024-09-16T07:58:13.067638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"137'529","reported_seq":559,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071467+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:13.071467+0000","last_peered":"2024-09-16T07:58:13.071467+0000","last_clean":"2024-09-16T07:58:13.071467+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:13.071467+0000","last_undegraded":"2024-09-16T07:58:13.071467+0000","last_fullsized":"2024-09-16T07:58:13.071467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":352,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.093504+0000","last_change":"2024-09-16T07:58:32.093504+0000","last_active":"2024-09-16T07:58:32.093504+0000","last_peered":"2024-09-16T07:58:13.071163+0000","last_clean":"2024-09-16T07:58:13.071163+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:58:32.093504+0000","last_undegraded":"2024-09-16T07:58:32.093504+0000","last_fullsized":"2024-09-16T07:58:32.093504+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"137'545","reported_seq":577,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.118586+0000","last_change":"2024-09-16T07:58:32.118586+0000","last_active":"2024-09-16T07:58:32.118586+0000","last_peered":"2024-09-16T07:58:13.067147+0000","last_clean":"2024-09-16T07:58:13.067147+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:32.118586+0000","last_undegraded":"2024-09-16T07:58:32.118586+0000","last_fullsized":"2024-09-16T07:58:32.118586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069861+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:58:13.069861+0000","last_peered":"2024-09-16T07:58:13.069861+0000","last_clean":"2024-09-16T07:58:13.069861+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:58:13.069861+0000","last_undegraded":"2024-09-16T07:58:13.069861+0000","last_fullsized":"2024-09-16T07:58:13.069861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"137'528","reported_seq":560,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.123332+0000","last_change":"2024-09-16T07:58:32.123332+0000","last_active":"2024-09-16T07:58:32.123332+0000","last_peered":"2024-09-16T07:58:13.073897+0000","last_clean":"2024-09-16T07:58:13.073897+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:32.123332+0000","last_undegraded":"2024-09-16T07:58:32.123332+0000","last_fullsized":"2024-09-16T07:58:32.123332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":345,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073235+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:58:13.073235+0000","last_peered":"2024-09-16T07:58:13.073235+0000","last_clean":"2024-09-16T07:58:13.073235+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:58:13.073235+0000","last_undegraded":"2024-09-16T07:58:13.073235+0000","last_fullsized":"2024-09-16T07:58:13.073235+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":563609600,"num_objects":8600,"num_object_clones":0,"num_object_copies":25800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8600,"num_write_kb":550400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99176448,"data_stored":1586823168,"data_compressed":75347526,"data_compressed_allocated":99176448,"data_compressed_original":1586823168,"omap_allocated":0,"internal_metadata":0},"log_size":8600,"ondisk_log_size":8600,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86060,"kb_used_data":34204,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94285780,"statfs":{"total":96636764160,"available":96548638720,"internally_reserved":0,"allocated":35024896,"data_stored":541930791,"data_compressed":25712339,"data_compressed_allocated":33845248,"data_compressed_original":541442048,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500792,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50372,"kb_used_data":21236,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94321468,"statfs":{"total":96636764160,"available":96585183232,"internally_reserved":0,"allocated":21745664,"data_stored":329524946,"data_compressed":15626743,"data_compressed_allocated":20570112,"data_compressed_original":329039872,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075608,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66704,"kb_used_data":29568,"kb_used_omap":0,"kb_used_meta":37120,"kb_avail":94305136,"statfs":{"total":96636764160,"available":96568459264,"internally_reserved":0,"allocated":30277632,"data_stored":466429106,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":38010880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29122560,"data_stored":465960960,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20529152,"data_stored":328466432,"data_compressed":15596702,"data_compressed_allocated":20529152,"data_compressed_original":328466432,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33804288,"data_stored":540868608,"data_compressed":25682298,"data_compressed_allocated":33804288,"data_compressed_original":540868608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:58:35.562 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:35.630 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 73 16 8994 8978 7.68583 10.25 0.0844059 0.130026 2024-09-16T07:58:35.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:35.732+0000 7f47eeb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:35.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:35.744+0000 7f47eeb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:35.994 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:35.995 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:58:36.017 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":539,"stamp":"2024-09-16T07:58:35.087935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":564199976,"num_objects":8604,"num_object_clones":0,"num_object_copies":25812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8680,"num_write_kb":551507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8655,"ondisk_log_size":8655,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248248,"kb_used_data":101432,"kb_used_omap":0,"kb_used_meta":146752,"kb_avail":377239112,"statfs":{"total":386547056640,"available":386292850688,"internally_reserved":0,"allocated":103866368,"data_stored":1589336617,"data_compressed":75384745,"data_compressed_allocated":99229696,"data_compressed_original":1587429376,"omap_allocated":0,"internal_metadata":150274048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.622576"},"pg_stats":[{"pgid":"7.f","version":"137'557","reported_seq":590,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.117773+0000","last_change":"2024-09-16T07:58:32.124703+0000","last_active":"2024-09-16T07:58:32.124703+0000","last_peered":"2024-09-16T07:58:13.076723+0000","last_clean":"2024-09-16T07:58:13.076723+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:33.117773+0000","last_undegraded":"2024-09-16T07:58:33.117773+0000","last_fullsized":"2024-09-16T07:58:33.117773+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071891+0000","last_change":"2024-09-16T07:57:21.730082+0000","last_active":"2024-09-16T07:58:13.071891+0000","last_peered":"2024-09-16T07:58:13.071891+0000","last_clean":"2024-09-16T07:58:13.071891+0000","last_became_active":"2024-09-16T07:57:21.701780+0000","last_became_peered":"2024-09-16T07:57:21.701780+0000","last_unstale":"2024-09-16T07:58:13.071891+0000","last_undegraded":"2024-09-16T07:58:13.071891+0000","last_fullsized":"2024-09-16T07:58:13.071891+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.066949+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:13.066949+0000","last_peered":"2024-09-16T07:58:13.066949+0000","last_clean":"2024-09-16T07:58:13.066949+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:13.066949+0000","last_undegraded":"2024-09-16T07:58:13.066949+0000","last_fullsized":"2024-09-16T07:58:13.066949+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"137'533","reported_seq":563,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.072390+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:13.072390+0000","last_peered":"2024-09-16T07:58:13.072390+0000","last_clean":"2024-09-16T07:58:13.072390+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:13.072390+0000","last_undegraded":"2024-09-16T07:58:13.072390+0000","last_fullsized":"2024-09-16T07:58:13.072390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"137'508","reported_seq":541,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.116150+0000","last_change":"2024-09-16T07:58:32.142013+0000","last_active":"2024-09-16T07:58:32.142013+0000","last_peered":"2024-09-16T07:58:13.076585+0000","last_clean":"2024-09-16T07:58:13.076585+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:33.116150+0000","last_undegraded":"2024-09-16T07:58:33.116150+0000","last_fullsized":"2024-09-16T07:58:33.116150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"137'554","reported_seq":586,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.106969+0000","last_change":"2024-09-16T07:58:32.106969+0000","last_active":"2024-09-16T07:58:32.106969+0000","last_peered":"2024-09-16T07:58:13.070933+0000","last_clean":"2024-09-16T07:58:13.070933+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:32.106969+0000","last_undegraded":"2024-09-16T07:58:32.106969+0000","last_fullsized":"2024-09-16T07:58:32.106969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"137'603","reported_seq":633,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073722+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:13.073722+0000","last_peered":"2024-09-16T07:58:13.073722+0000","last_clean":"2024-09-16T07:58:13.073722+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:13.073722+0000","last_undegraded":"2024-09-16T07:58:13.073722+0000","last_fullsized":"2024-09-16T07:58:13.073722+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"137'543","reported_seq":573,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073405+0000","last_change":"2024-09-16T07:57:21.754262+0000","last_active":"2024-09-16T07:58:13.073405+0000","last_peered":"2024-09-16T07:58:13.073405+0000","last_clean":"2024-09-16T07:58:13.073405+0000","last_became_active":"2024-09-16T07:57:21.743887+0000","last_became_peered":"2024-09-16T07:57:21.743887+0000","last_unstale":"2024-09-16T07:58:13.073405+0000","last_undegraded":"2024-09-16T07:58:13.073405+0000","last_fullsized":"2024-09-16T07:58:13.073405+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"137'576","reported_seq":608,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.132254+0000","last_change":"2024-09-16T07:58:32.132254+0000","last_active":"2024-09-16T07:58:32.132254+0000","last_peered":"2024-09-16T07:58:13.074775+0000","last_clean":"2024-09-16T07:58:13.074775+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:32.132254+0000","last_undegraded":"2024-09-16T07:58:32.132254+0000","last_fullsized":"2024-09-16T07:58:32.132254+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":417,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.095446+0000","last_change":"2024-09-16T07:58:32.095446+0000","last_active":"2024-09-16T07:58:32.095446+0000","last_peered":"2024-09-16T07:58:13.070190+0000","last_clean":"2024-09-16T07:58:13.070190+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:58:32.095446+0000","last_undegraded":"2024-09-16T07:58:32.095446+0000","last_fullsized":"2024-09-16T07:58:32.095446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":352,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.068775+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:13.068775+0000","last_peered":"2024-09-16T07:58:13.068775+0000","last_clean":"2024-09-16T07:58:13.068775+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:13.068775+0000","last_undegraded":"2024-09-16T07:58:13.068775+0000","last_fullsized":"2024-09-16T07:58:13.068775+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067625+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:13.067625+0000","last_peered":"2024-09-16T07:58:13.067625+0000","last_clean":"2024-09-16T07:58:13.067625+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:13.067625+0000","last_undegraded":"2024-09-16T07:58:13.067625+0000","last_fullsized":"2024-09-16T07:58:13.067625+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:58:32.069085+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"137'597","reported_seq":627,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071646+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:58:13.071646+0000","last_peered":"2024-09-16T07:58:13.071646+0000","last_clean":"2024-09-16T07:58:13.071646+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:58:13.071646+0000","last_undegraded":"2024-09-16T07:58:13.071646+0000","last_fullsized":"2024-09-16T07:58:13.071646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":333,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.074065+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:13.074065+0000","last_peered":"2024-09-16T07:58:13.074065+0000","last_clean":"2024-09-16T07:58:13.074065+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:13.074065+0000","last_undegraded":"2024-09-16T07:58:13.074065+0000","last_fullsized":"2024-09-16T07:58:13.074065+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069554+0000","last_change":"2024-09-16T07:57:21.704253+0000","last_active":"2024-09-16T07:58:13.069554+0000","last_peered":"2024-09-16T07:58:13.069554+0000","last_clean":"2024-09-16T07:58:13.069554+0000","last_became_active":"2024-09-16T07:57:21.683562+0000","last_became_peered":"2024-09-16T07:57:21.683562+0000","last_unstale":"2024-09-16T07:58:13.069554+0000","last_undegraded":"2024-09-16T07:58:13.069554+0000","last_fullsized":"2024-09-16T07:58:13.069554+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:58:32.069088+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:58:32.069090+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067638+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:58:13.067638+0000","last_peered":"2024-09-16T07:58:13.067638+0000","last_clean":"2024-09-16T07:58:13.067638+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:58:13.067638+0000","last_undegraded":"2024-09-16T07:58:13.067638+0000","last_fullsized":"2024-09-16T07:58:13.067638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"137'529","reported_seq":559,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071467+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:13.071467+0000","last_peered":"2024-09-16T07:58:13.071467+0000","last_clean":"2024-09-16T07:58:13.071467+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:13.071467+0000","last_undegraded":"2024-09-16T07:58:13.071467+0000","last_fullsized":"2024-09-16T07:58:13.071467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":352,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.093504+0000","last_change":"2024-09-16T07:58:32.093504+0000","last_active":"2024-09-16T07:58:32.093504+0000","last_peered":"2024-09-16T07:58:13.071163+0000","last_clean":"2024-09-16T07:58:13.071163+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:58:32.093504+0000","last_undegraded":"2024-09-16T07:58:32.093504+0000","last_fullsized":"2024-09-16T07:58:32.093504+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"137'545","reported_seq":577,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.118586+0000","last_change":"2024-09-16T07:58:32.118586+0000","last_active":"2024-09-16T07:58:32.118586+0000","last_peered":"2024-09-16T07:58:13.067147+0000","last_clean":"2024-09-16T07:58:13.067147+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:32.118586+0000","last_undegraded":"2024-09-16T07:58:32.118586+0000","last_fullsized":"2024-09-16T07:58:32.118586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069861+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:58:13.069861+0000","last_peered":"2024-09-16T07:58:13.069861+0000","last_clean":"2024-09-16T07:58:13.069861+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:58:13.069861+0000","last_undegraded":"2024-09-16T07:58:13.069861+0000","last_fullsized":"2024-09-16T07:58:13.069861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"137'528","reported_seq":560,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.123332+0000","last_change":"2024-09-16T07:58:32.123332+0000","last_active":"2024-09-16T07:58:32.123332+0000","last_peered":"2024-09-16T07:58:13.073897+0000","last_clean":"2024-09-16T07:58:13.073897+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:32.123332+0000","last_undegraded":"2024-09-16T07:58:32.123332+0000","last_fullsized":"2024-09-16T07:58:32.123332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":345,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073235+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:58:13.073235+0000","last_peered":"2024-09-16T07:58:13.073235+0000","last_clean":"2024-09-16T07:58:13.073235+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:58:13.073235+0000","last_undegraded":"2024-09-16T07:58:13.073235+0000","last_fullsized":"2024-09-16T07:58:13.073235+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":563609600,"num_objects":8600,"num_object_clones":0,"num_object_copies":25800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8600,"num_write_kb":550400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99176448,"data_stored":1586823168,"data_compressed":75347526,"data_compressed_allocated":99176448,"data_compressed_original":1586823168,"omap_allocated":0,"internal_metadata":0},"log_size":8600,"ondisk_log_size":8600,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86060,"kb_used_data":34204,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94285780,"statfs":{"total":96636764160,"available":96548638720,"internally_reserved":0,"allocated":35024896,"data_stored":541930791,"data_compressed":25712339,"data_compressed_allocated":33845248,"data_compressed_original":541442048,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500792,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50372,"kb_used_data":21236,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94321468,"statfs":{"total":96636764160,"available":96585183232,"internally_reserved":0,"allocated":21745664,"data_stored":329524946,"data_compressed":15626743,"data_compressed_allocated":20570112,"data_compressed_original":329039872,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075608,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66704,"kb_used_data":29568,"kb_used_omap":0,"kb_used_meta":37120,"kb_avail":94305136,"statfs":{"total":96636764160,"available":96568459264,"internally_reserved":0,"allocated":30277632,"data_stored":466429106,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":38010880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29122560,"data_stored":465960960,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20529152,"data_stored":328466432,"data_compressed":15596702,"data_compressed_allocated":20529152,"data_compressed_original":328466432,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33804288,"data_stored":540868608,"data_compressed":25682298,"data_compressed_allocated":33804288,"data_compressed_original":540868608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:58:36.018 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:58:36.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:36.162+0000 7fb80c951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:36.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:36.172+0000 7fb80c951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:36.630 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 74 16 9157 9141 7.71962 10.1875 0.0307652 0.129406 2024-09-16T07:58:36.689 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:36.689 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":818,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":142,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473513,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":14},{"state_name":"peering","count":8},{"state_name":"stale+active+clean","count":3}],"num_pgs":25,"num_pools":3,"num_objects":8604,"data_bytes":564199976,"bytes_used":254205952,"bytes_avail":386292850688,"bytes_total":386547056640,"inactive_pgs_ratio":0.31999999284744263,"write_bytes_sec":11684302,"read_op_per_sec":0,"write_op_per_sec":178},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:58:36.712 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:58:36.712 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:36.794 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:58:36.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:36.876+0000 7fa6ef263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:36.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:36.893+0000 7fa6ef263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:36.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:36.966+0000 7fcd06646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:36.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:36.979+0000 7fcd06646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:37.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:37.218 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:58:37.235 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":540,"stamp":"2024-09-16T07:58:36.466791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":564199976,"num_objects":8604,"num_object_clones":0,"num_object_copies":25812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8680,"num_write_kb":551507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8655,"ondisk_log_size":8655,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248248,"kb_used_data":101432,"kb_used_omap":0,"kb_used_meta":146752,"kb_avail":377239112,"statfs":{"total":386547056640,"available":386292850688,"internally_reserved":0,"allocated":103866368,"data_stored":1589336617,"data_compressed":75384745,"data_compressed_allocated":99229696,"data_compressed_original":1587429376,"omap_allocated":0,"internal_metadata":150274048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.397744"},"pg_stats":[{"pgid":"7.f","version":"137'557","reported_seq":590,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.117773+0000","last_change":"2024-09-16T07:58:32.124703+0000","last_active":"2024-09-16T07:58:32.124703+0000","last_peered":"2024-09-16T07:58:13.076723+0000","last_clean":"2024-09-16T07:58:13.076723+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:33.117773+0000","last_undegraded":"2024-09-16T07:58:33.117773+0000","last_fullsized":"2024-09-16T07:58:33.117773+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071891+0000","last_change":"2024-09-16T07:57:21.730082+0000","last_active":"2024-09-16T07:58:13.071891+0000","last_peered":"2024-09-16T07:58:13.071891+0000","last_clean":"2024-09-16T07:58:13.071891+0000","last_became_active":"2024-09-16T07:57:21.701780+0000","last_became_peered":"2024-09-16T07:57:21.701780+0000","last_unstale":"2024-09-16T07:58:13.071891+0000","last_undegraded":"2024-09-16T07:58:13.071891+0000","last_fullsized":"2024-09-16T07:58:13.071891+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.066949+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:13.066949+0000","last_peered":"2024-09-16T07:58:13.066949+0000","last_clean":"2024-09-16T07:58:13.066949+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:13.066949+0000","last_undegraded":"2024-09-16T07:58:13.066949+0000","last_fullsized":"2024-09-16T07:58:13.066949+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"137'533","reported_seq":563,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.072390+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:13.072390+0000","last_peered":"2024-09-16T07:58:13.072390+0000","last_clean":"2024-09-16T07:58:13.072390+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:13.072390+0000","last_undegraded":"2024-09-16T07:58:13.072390+0000","last_fullsized":"2024-09-16T07:58:13.072390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"137'508","reported_seq":541,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.116150+0000","last_change":"2024-09-16T07:58:32.142013+0000","last_active":"2024-09-16T07:58:32.142013+0000","last_peered":"2024-09-16T07:58:13.076585+0000","last_clean":"2024-09-16T07:58:13.076585+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:33.116150+0000","last_undegraded":"2024-09-16T07:58:33.116150+0000","last_fullsized":"2024-09-16T07:58:33.116150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"137'554","reported_seq":586,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.106969+0000","last_change":"2024-09-16T07:58:32.106969+0000","last_active":"2024-09-16T07:58:32.106969+0000","last_peered":"2024-09-16T07:58:13.070933+0000","last_clean":"2024-09-16T07:58:13.070933+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:32.106969+0000","last_undegraded":"2024-09-16T07:58:32.106969+0000","last_fullsized":"2024-09-16T07:58:32.106969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"137'603","reported_seq":633,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073722+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:13.073722+0000","last_peered":"2024-09-16T07:58:13.073722+0000","last_clean":"2024-09-16T07:58:13.073722+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:13.073722+0000","last_undegraded":"2024-09-16T07:58:13.073722+0000","last_fullsized":"2024-09-16T07:58:13.073722+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"137'543","reported_seq":573,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073405+0000","last_change":"2024-09-16T07:57:21.754262+0000","last_active":"2024-09-16T07:58:13.073405+0000","last_peered":"2024-09-16T07:58:13.073405+0000","last_clean":"2024-09-16T07:58:13.073405+0000","last_became_active":"2024-09-16T07:57:21.743887+0000","last_became_peered":"2024-09-16T07:57:21.743887+0000","last_unstale":"2024-09-16T07:58:13.073405+0000","last_undegraded":"2024-09-16T07:58:13.073405+0000","last_fullsized":"2024-09-16T07:58:13.073405+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"137'576","reported_seq":608,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.132254+0000","last_change":"2024-09-16T07:58:32.132254+0000","last_active":"2024-09-16T07:58:32.132254+0000","last_peered":"2024-09-16T07:58:13.074775+0000","last_clean":"2024-09-16T07:58:13.074775+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:32.132254+0000","last_undegraded":"2024-09-16T07:58:32.132254+0000","last_fullsized":"2024-09-16T07:58:32.132254+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":417,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.095446+0000","last_change":"2024-09-16T07:58:32.095446+0000","last_active":"2024-09-16T07:58:32.095446+0000","last_peered":"2024-09-16T07:58:13.070190+0000","last_clean":"2024-09-16T07:58:13.070190+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:58:32.095446+0000","last_undegraded":"2024-09-16T07:58:32.095446+0000","last_fullsized":"2024-09-16T07:58:32.095446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":352,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.068775+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:13.068775+0000","last_peered":"2024-09-16T07:58:13.068775+0000","last_clean":"2024-09-16T07:58:13.068775+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:13.068775+0000","last_undegraded":"2024-09-16T07:58:13.068775+0000","last_fullsized":"2024-09-16T07:58:13.068775+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067625+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:13.067625+0000","last_peered":"2024-09-16T07:58:13.067625+0000","last_clean":"2024-09-16T07:58:13.067625+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:13.067625+0000","last_undegraded":"2024-09-16T07:58:13.067625+0000","last_fullsized":"2024-09-16T07:58:13.067625+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:58:32.069085+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"137'597","reported_seq":627,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071646+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:58:13.071646+0000","last_peered":"2024-09-16T07:58:13.071646+0000","last_clean":"2024-09-16T07:58:13.071646+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:58:13.071646+0000","last_undegraded":"2024-09-16T07:58:13.071646+0000","last_fullsized":"2024-09-16T07:58:13.071646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":333,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.074065+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:13.074065+0000","last_peered":"2024-09-16T07:58:13.074065+0000","last_clean":"2024-09-16T07:58:13.074065+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:13.074065+0000","last_undegraded":"2024-09-16T07:58:13.074065+0000","last_fullsized":"2024-09-16T07:58:13.074065+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069554+0000","last_change":"2024-09-16T07:57:21.704253+0000","last_active":"2024-09-16T07:58:13.069554+0000","last_peered":"2024-09-16T07:58:13.069554+0000","last_clean":"2024-09-16T07:58:13.069554+0000","last_became_active":"2024-09-16T07:57:21.683562+0000","last_became_peered":"2024-09-16T07:57:21.683562+0000","last_unstale":"2024-09-16T07:58:13.069554+0000","last_undegraded":"2024-09-16T07:58:13.069554+0000","last_fullsized":"2024-09-16T07:58:13.069554+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:58:32.069088+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:58:32.069090+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067638+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:58:13.067638+0000","last_peered":"2024-09-16T07:58:13.067638+0000","last_clean":"2024-09-16T07:58:13.067638+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:58:13.067638+0000","last_undegraded":"2024-09-16T07:58:13.067638+0000","last_fullsized":"2024-09-16T07:58:13.067638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"137'529","reported_seq":559,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071467+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:13.071467+0000","last_peered":"2024-09-16T07:58:13.071467+0000","last_clean":"2024-09-16T07:58:13.071467+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:13.071467+0000","last_undegraded":"2024-09-16T07:58:13.071467+0000","last_fullsized":"2024-09-16T07:58:13.071467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":352,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.093504+0000","last_change":"2024-09-16T07:58:32.093504+0000","last_active":"2024-09-16T07:58:32.093504+0000","last_peered":"2024-09-16T07:58:13.071163+0000","last_clean":"2024-09-16T07:58:13.071163+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:58:32.093504+0000","last_undegraded":"2024-09-16T07:58:32.093504+0000","last_fullsized":"2024-09-16T07:58:32.093504+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"137'545","reported_seq":577,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.118586+0000","last_change":"2024-09-16T07:58:32.118586+0000","last_active":"2024-09-16T07:58:32.118586+0000","last_peered":"2024-09-16T07:58:13.067147+0000","last_clean":"2024-09-16T07:58:13.067147+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:32.118586+0000","last_undegraded":"2024-09-16T07:58:32.118586+0000","last_fullsized":"2024-09-16T07:58:32.118586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069861+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:58:13.069861+0000","last_peered":"2024-09-16T07:58:13.069861+0000","last_clean":"2024-09-16T07:58:13.069861+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:58:13.069861+0000","last_undegraded":"2024-09-16T07:58:13.069861+0000","last_fullsized":"2024-09-16T07:58:13.069861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"137'528","reported_seq":560,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.123332+0000","last_change":"2024-09-16T07:58:32.123332+0000","last_active":"2024-09-16T07:58:32.123332+0000","last_peered":"2024-09-16T07:58:13.073897+0000","last_clean":"2024-09-16T07:58:13.073897+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:32.123332+0000","last_undegraded":"2024-09-16T07:58:32.123332+0000","last_fullsized":"2024-09-16T07:58:32.123332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":345,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073235+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:58:13.073235+0000","last_peered":"2024-09-16T07:58:13.073235+0000","last_clean":"2024-09-16T07:58:13.073235+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:58:13.073235+0000","last_undegraded":"2024-09-16T07:58:13.073235+0000","last_fullsized":"2024-09-16T07:58:13.073235+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":563609600,"num_objects":8600,"num_object_clones":0,"num_object_copies":25800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8600,"num_write_kb":550400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99176448,"data_stored":1586823168,"data_compressed":75347526,"data_compressed_allocated":99176448,"data_compressed_original":1586823168,"omap_allocated":0,"internal_metadata":0},"log_size":8600,"ondisk_log_size":8600,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86060,"kb_used_data":34204,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94285780,"statfs":{"total":96636764160,"available":96548638720,"internally_reserved":0,"allocated":35024896,"data_stored":541930791,"data_compressed":25712339,"data_compressed_allocated":33845248,"data_compressed_original":541442048,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500792,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50372,"kb_used_data":21236,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94321468,"statfs":{"total":96636764160,"available":96585183232,"internally_reserved":0,"allocated":21745664,"data_stored":329524946,"data_compressed":15626743,"data_compressed_allocated":20570112,"data_compressed_original":329039872,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075608,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66704,"kb_used_data":29568,"kb_used_omap":0,"kb_used_meta":37120,"kb_avail":94305136,"statfs":{"total":96636764160,"available":96568459264,"internally_reserved":0,"allocated":30277632,"data_stored":466429106,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":38010880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29122560,"data_stored":465960960,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20529152,"data_stored":328466432,"data_compressed":15596702,"data_compressed_allocated":20529152,"data_compressed_original":328466432,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33804288,"data_stored":540868608,"data_compressed":25682298,"data_compressed_allocated":33804288,"data_compressed_original":540868608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:58:37.631 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 75 16 9330 9314 7.76085 10.8125 0.110733 0.128771 2024-09-16T07:58:38.631 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 76 16 9522 9506 7.81661 12 0.0755475 0.12787 2024-09-16T07:58:39.365 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:58:39.631 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 77 16 9702 9686 7.86119 11.25 0.0930287 0.127151 2024-09-16T07:58:39.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:39.642+0000 7fa2e1eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:39.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:39.652+0000 7fa2e1eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:40.237 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:40.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:40.375+0000 7f0255d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:40.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:40.390+0000 7f0255d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:40.631 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 78 16 9882 9866 7.90462 11.25 0.0559053 0.126421 2024-09-16T07:58:40.650 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:40.651 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:58:40.671 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2024-09-16T07:58:40.467566+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":564199976,"num_objects":8604,"num_object_clones":0,"num_object_copies":25812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8680,"num_write_kb":551507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8655,"ondisk_log_size":8655,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248248,"kb_used_data":101432,"kb_used_omap":0,"kb_used_meta":146752,"kb_avail":377239112,"statfs":{"total":386547056640,"available":386292850688,"internally_reserved":0,"allocated":103866368,"data_stored":1589336617,"data_compressed":75384745,"data_compressed_allocated":99229696,"data_compressed_original":1587429376,"omap_allocated":0,"internal_metadata":150274048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.408094"},"pg_stats":[{"pgid":"7.f","version":"137'557","reported_seq":590,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.117773+0000","last_change":"2024-09-16T07:58:32.124703+0000","last_active":"2024-09-16T07:58:32.124703+0000","last_peered":"2024-09-16T07:58:13.076723+0000","last_clean":"2024-09-16T07:58:13.076723+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:33.117773+0000","last_undegraded":"2024-09-16T07:58:33.117773+0000","last_fullsized":"2024-09-16T07:58:33.117773+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071891+0000","last_change":"2024-09-16T07:57:21.730082+0000","last_active":"2024-09-16T07:58:13.071891+0000","last_peered":"2024-09-16T07:58:13.071891+0000","last_clean":"2024-09-16T07:58:13.071891+0000","last_became_active":"2024-09-16T07:57:21.701780+0000","last_became_peered":"2024-09-16T07:57:21.701780+0000","last_unstale":"2024-09-16T07:58:13.071891+0000","last_undegraded":"2024-09-16T07:58:13.071891+0000","last_fullsized":"2024-09-16T07:58:13.071891+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.066949+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:13.066949+0000","last_peered":"2024-09-16T07:58:13.066949+0000","last_clean":"2024-09-16T07:58:13.066949+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:13.066949+0000","last_undegraded":"2024-09-16T07:58:13.066949+0000","last_fullsized":"2024-09-16T07:58:13.066949+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"137'533","reported_seq":563,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.072390+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:13.072390+0000","last_peered":"2024-09-16T07:58:13.072390+0000","last_clean":"2024-09-16T07:58:13.072390+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:13.072390+0000","last_undegraded":"2024-09-16T07:58:13.072390+0000","last_fullsized":"2024-09-16T07:58:13.072390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"137'508","reported_seq":541,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.116150+0000","last_change":"2024-09-16T07:58:32.142013+0000","last_active":"2024-09-16T07:58:32.142013+0000","last_peered":"2024-09-16T07:58:13.076585+0000","last_clean":"2024-09-16T07:58:13.076585+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:33.116150+0000","last_undegraded":"2024-09-16T07:58:33.116150+0000","last_fullsized":"2024-09-16T07:58:33.116150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"137'554","reported_seq":586,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.106969+0000","last_change":"2024-09-16T07:58:32.106969+0000","last_active":"2024-09-16T07:58:32.106969+0000","last_peered":"2024-09-16T07:58:13.070933+0000","last_clean":"2024-09-16T07:58:13.070933+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:32.106969+0000","last_undegraded":"2024-09-16T07:58:32.106969+0000","last_fullsized":"2024-09-16T07:58:32.106969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"137'603","reported_seq":633,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073722+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:13.073722+0000","last_peered":"2024-09-16T07:58:13.073722+0000","last_clean":"2024-09-16T07:58:13.073722+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:13.073722+0000","last_undegraded":"2024-09-16T07:58:13.073722+0000","last_fullsized":"2024-09-16T07:58:13.073722+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"137'543","reported_seq":573,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073405+0000","last_change":"2024-09-16T07:57:21.754262+0000","last_active":"2024-09-16T07:58:13.073405+0000","last_peered":"2024-09-16T07:58:13.073405+0000","last_clean":"2024-09-16T07:58:13.073405+0000","last_became_active":"2024-09-16T07:57:21.743887+0000","last_became_peered":"2024-09-16T07:57:21.743887+0000","last_unstale":"2024-09-16T07:58:13.073405+0000","last_undegraded":"2024-09-16T07:58:13.073405+0000","last_fullsized":"2024-09-16T07:58:13.073405+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"137'576","reported_seq":608,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.132254+0000","last_change":"2024-09-16T07:58:32.132254+0000","last_active":"2024-09-16T07:58:32.132254+0000","last_peered":"2024-09-16T07:58:13.074775+0000","last_clean":"2024-09-16T07:58:13.074775+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:32.132254+0000","last_undegraded":"2024-09-16T07:58:32.132254+0000","last_fullsized":"2024-09-16T07:58:32.132254+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":417,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.095446+0000","last_change":"2024-09-16T07:58:32.095446+0000","last_active":"2024-09-16T07:58:32.095446+0000","last_peered":"2024-09-16T07:58:13.070190+0000","last_clean":"2024-09-16T07:58:13.070190+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:58:32.095446+0000","last_undegraded":"2024-09-16T07:58:32.095446+0000","last_fullsized":"2024-09-16T07:58:32.095446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":352,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.068775+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:13.068775+0000","last_peered":"2024-09-16T07:58:13.068775+0000","last_clean":"2024-09-16T07:58:13.068775+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:13.068775+0000","last_undegraded":"2024-09-16T07:58:13.068775+0000","last_fullsized":"2024-09-16T07:58:13.068775+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067625+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:13.067625+0000","last_peered":"2024-09-16T07:58:13.067625+0000","last_clean":"2024-09-16T07:58:13.067625+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:13.067625+0000","last_undegraded":"2024-09-16T07:58:13.067625+0000","last_fullsized":"2024-09-16T07:58:13.067625+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:58:32.069085+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"137'597","reported_seq":627,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071646+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:58:13.071646+0000","last_peered":"2024-09-16T07:58:13.071646+0000","last_clean":"2024-09-16T07:58:13.071646+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:58:13.071646+0000","last_undegraded":"2024-09-16T07:58:13.071646+0000","last_fullsized":"2024-09-16T07:58:13.071646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":333,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.074065+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:13.074065+0000","last_peered":"2024-09-16T07:58:13.074065+0000","last_clean":"2024-09-16T07:58:13.074065+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:13.074065+0000","last_undegraded":"2024-09-16T07:58:13.074065+0000","last_fullsized":"2024-09-16T07:58:13.074065+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069554+0000","last_change":"2024-09-16T07:57:21.704253+0000","last_active":"2024-09-16T07:58:13.069554+0000","last_peered":"2024-09-16T07:58:13.069554+0000","last_clean":"2024-09-16T07:58:13.069554+0000","last_became_active":"2024-09-16T07:57:21.683562+0000","last_became_peered":"2024-09-16T07:57:21.683562+0000","last_unstale":"2024-09-16T07:58:13.069554+0000","last_undegraded":"2024-09-16T07:58:13.069554+0000","last_fullsized":"2024-09-16T07:58:13.069554+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:58:32.069088+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:58:32.069090+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067638+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:58:13.067638+0000","last_peered":"2024-09-16T07:58:13.067638+0000","last_clean":"2024-09-16T07:58:13.067638+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:58:13.067638+0000","last_undegraded":"2024-09-16T07:58:13.067638+0000","last_fullsized":"2024-09-16T07:58:13.067638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"137'529","reported_seq":559,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071467+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:13.071467+0000","last_peered":"2024-09-16T07:58:13.071467+0000","last_clean":"2024-09-16T07:58:13.071467+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:13.071467+0000","last_undegraded":"2024-09-16T07:58:13.071467+0000","last_fullsized":"2024-09-16T07:58:13.071467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":352,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.093504+0000","last_change":"2024-09-16T07:58:32.093504+0000","last_active":"2024-09-16T07:58:32.093504+0000","last_peered":"2024-09-16T07:58:13.071163+0000","last_clean":"2024-09-16T07:58:13.071163+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:58:32.093504+0000","last_undegraded":"2024-09-16T07:58:32.093504+0000","last_fullsized":"2024-09-16T07:58:32.093504+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"137'545","reported_seq":577,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.118586+0000","last_change":"2024-09-16T07:58:32.118586+0000","last_active":"2024-09-16T07:58:32.118586+0000","last_peered":"2024-09-16T07:58:13.067147+0000","last_clean":"2024-09-16T07:58:13.067147+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:32.118586+0000","last_undegraded":"2024-09-16T07:58:32.118586+0000","last_fullsized":"2024-09-16T07:58:32.118586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069861+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:58:13.069861+0000","last_peered":"2024-09-16T07:58:13.069861+0000","last_clean":"2024-09-16T07:58:13.069861+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:58:13.069861+0000","last_undegraded":"2024-09-16T07:58:13.069861+0000","last_fullsized":"2024-09-16T07:58:13.069861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"137'528","reported_seq":560,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.123332+0000","last_change":"2024-09-16T07:58:32.123332+0000","last_active":"2024-09-16T07:58:32.123332+0000","last_peered":"2024-09-16T07:58:13.073897+0000","last_clean":"2024-09-16T07:58:13.073897+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:32.123332+0000","last_undegraded":"2024-09-16T07:58:32.123332+0000","last_fullsized":"2024-09-16T07:58:32.123332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":345,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073235+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:58:13.073235+0000","last_peered":"2024-09-16T07:58:13.073235+0000","last_clean":"2024-09-16T07:58:13.073235+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:58:13.073235+0000","last_undegraded":"2024-09-16T07:58:13.073235+0000","last_fullsized":"2024-09-16T07:58:13.073235+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":563609600,"num_objects":8600,"num_object_clones":0,"num_object_copies":25800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8600,"num_write_kb":550400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99176448,"data_stored":1586823168,"data_compressed":75347526,"data_compressed_allocated":99176448,"data_compressed_original":1586823168,"omap_allocated":0,"internal_metadata":0},"log_size":8600,"ondisk_log_size":8600,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86060,"kb_used_data":34204,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94285780,"statfs":{"total":96636764160,"available":96548638720,"internally_reserved":0,"allocated":35024896,"data_stored":541930791,"data_compressed":25712339,"data_compressed_allocated":33845248,"data_compressed_original":541442048,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500792,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50372,"kb_used_data":21236,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94321468,"statfs":{"total":96636764160,"available":96585183232,"internally_reserved":0,"allocated":21745664,"data_stored":329524946,"data_compressed":15626743,"data_compressed_allocated":20570112,"data_compressed_original":329039872,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075608,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66704,"kb_used_data":29568,"kb_used_omap":0,"kb_used_meta":37120,"kb_avail":94305136,"statfs":{"total":96636764160,"available":96568459264,"internally_reserved":0,"allocated":30277632,"data_stored":466429106,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":38010880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29122560,"data_stored":465960960,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20529152,"data_stored":328466432,"data_compressed":15596702,"data_compressed_allocated":20529152,"data_compressed_original":328466432,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33804288,"data_stored":540868608,"data_compressed":25682298,"data_compressed_allocated":33804288,"data_compressed_original":540868608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:58:40.672 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:58:40.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:40.824+0000 7f5aa4751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:40.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:40.837+0000 7f5aa4751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:41.234 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":823,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":142,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473513,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":14},{"state_name":"peering","count":8},{"state_name":"stale+active+clean","count":3}],"num_pgs":25,"num_pools":3,"num_objects":8604,"data_bytes":564199976,"bytes_used":254205952,"bytes_avail":386292850688,"bytes_total":386547056640,"inactive_pgs_ratio":0.31999999284744263,"write_bytes_sec":3883630,"read_op_per_sec":0,"write_op_per_sec":59},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:58:41.254 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:58:41.254 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:41.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:41.384+0000 7f6c31d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:41.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:41.396+0000 7f6c31d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:41.631 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 79 16 10044 10028 7.93271 10.125 0.0348944 0.125921 2024-09-16T07:58:41.646 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:41.647 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:58:41.665 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2024-09-16T07:58:40.467566+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":564199976,"num_objects":8604,"num_object_clones":0,"num_object_copies":25812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8680,"num_write_kb":551507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8655,"ondisk_log_size":8655,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248248,"kb_used_data":101432,"kb_used_omap":0,"kb_used_meta":146752,"kb_avail":377239112,"statfs":{"total":386547056640,"available":386292850688,"internally_reserved":0,"allocated":103866368,"data_stored":1589336617,"data_compressed":75384745,"data_compressed_allocated":99229696,"data_compressed_original":1587429376,"omap_allocated":0,"internal_metadata":150274048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":28096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.408094"},"pg_stats":[{"pgid":"7.f","version":"137'557","reported_seq":590,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.117773+0000","last_change":"2024-09-16T07:58:32.124703+0000","last_active":"2024-09-16T07:58:32.124703+0000","last_peered":"2024-09-16T07:58:13.076723+0000","last_clean":"2024-09-16T07:58:13.076723+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:33.117773+0000","last_undegraded":"2024-09-16T07:58:33.117773+0000","last_fullsized":"2024-09-16T07:58:33.117773+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071891+0000","last_change":"2024-09-16T07:57:21.730082+0000","last_active":"2024-09-16T07:58:13.071891+0000","last_peered":"2024-09-16T07:58:13.071891+0000","last_clean":"2024-09-16T07:58:13.071891+0000","last_became_active":"2024-09-16T07:57:21.701780+0000","last_became_peered":"2024-09-16T07:57:21.701780+0000","last_unstale":"2024-09-16T07:58:13.071891+0000","last_undegraded":"2024-09-16T07:58:13.071891+0000","last_fullsized":"2024-09-16T07:58:13.071891+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.066949+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:13.066949+0000","last_peered":"2024-09-16T07:58:13.066949+0000","last_clean":"2024-09-16T07:58:13.066949+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:13.066949+0000","last_undegraded":"2024-09-16T07:58:13.066949+0000","last_fullsized":"2024-09-16T07:58:13.066949+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"137'533","reported_seq":563,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.072390+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:13.072390+0000","last_peered":"2024-09-16T07:58:13.072390+0000","last_clean":"2024-09-16T07:58:13.072390+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:13.072390+0000","last_undegraded":"2024-09-16T07:58:13.072390+0000","last_fullsized":"2024-09-16T07:58:13.072390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"137'508","reported_seq":541,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.116150+0000","last_change":"2024-09-16T07:58:32.142013+0000","last_active":"2024-09-16T07:58:32.142013+0000","last_peered":"2024-09-16T07:58:13.076585+0000","last_clean":"2024-09-16T07:58:13.076585+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:33.116150+0000","last_undegraded":"2024-09-16T07:58:33.116150+0000","last_fullsized":"2024-09-16T07:58:33.116150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"137'554","reported_seq":586,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.106969+0000","last_change":"2024-09-16T07:58:32.106969+0000","last_active":"2024-09-16T07:58:32.106969+0000","last_peered":"2024-09-16T07:58:13.070933+0000","last_clean":"2024-09-16T07:58:13.070933+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:32.106969+0000","last_undegraded":"2024-09-16T07:58:32.106969+0000","last_fullsized":"2024-09-16T07:58:32.106969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"137'603","reported_seq":633,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073722+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:13.073722+0000","last_peered":"2024-09-16T07:58:13.073722+0000","last_clean":"2024-09-16T07:58:13.073722+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:13.073722+0000","last_undegraded":"2024-09-16T07:58:13.073722+0000","last_fullsized":"2024-09-16T07:58:13.073722+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"137'543","reported_seq":573,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073405+0000","last_change":"2024-09-16T07:57:21.754262+0000","last_active":"2024-09-16T07:58:13.073405+0000","last_peered":"2024-09-16T07:58:13.073405+0000","last_clean":"2024-09-16T07:58:13.073405+0000","last_became_active":"2024-09-16T07:57:21.743887+0000","last_became_peered":"2024-09-16T07:57:21.743887+0000","last_unstale":"2024-09-16T07:58:13.073405+0000","last_undegraded":"2024-09-16T07:58:13.073405+0000","last_fullsized":"2024-09-16T07:58:13.073405+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"137'576","reported_seq":608,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.132254+0000","last_change":"2024-09-16T07:58:32.132254+0000","last_active":"2024-09-16T07:58:32.132254+0000","last_peered":"2024-09-16T07:58:13.074775+0000","last_clean":"2024-09-16T07:58:13.074775+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:32.132254+0000","last_undegraded":"2024-09-16T07:58:32.132254+0000","last_fullsized":"2024-09-16T07:58:32.132254+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":417,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.095446+0000","last_change":"2024-09-16T07:58:32.095446+0000","last_active":"2024-09-16T07:58:32.095446+0000","last_peered":"2024-09-16T07:58:13.070190+0000","last_clean":"2024-09-16T07:58:13.070190+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:58:32.095446+0000","last_undegraded":"2024-09-16T07:58:32.095446+0000","last_fullsized":"2024-09-16T07:58:32.095446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":352,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.068775+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:13.068775+0000","last_peered":"2024-09-16T07:58:13.068775+0000","last_clean":"2024-09-16T07:58:13.068775+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:13.068775+0000","last_undegraded":"2024-09-16T07:58:13.068775+0000","last_fullsized":"2024-09-16T07:58:13.068775+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067625+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:13.067625+0000","last_peered":"2024-09-16T07:58:13.067625+0000","last_clean":"2024-09-16T07:58:13.067625+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:13.067625+0000","last_undegraded":"2024-09-16T07:58:13.067625+0000","last_fullsized":"2024-09-16T07:58:13.067625+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:58:32.069085+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"137'597","reported_seq":627,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071646+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:58:13.071646+0000","last_peered":"2024-09-16T07:58:13.071646+0000","last_clean":"2024-09-16T07:58:13.071646+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:58:13.071646+0000","last_undegraded":"2024-09-16T07:58:13.071646+0000","last_fullsized":"2024-09-16T07:58:13.071646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":333,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.074065+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:13.074065+0000","last_peered":"2024-09-16T07:58:13.074065+0000","last_clean":"2024-09-16T07:58:13.074065+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:13.074065+0000","last_undegraded":"2024-09-16T07:58:13.074065+0000","last_fullsized":"2024-09-16T07:58:13.074065+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069554+0000","last_change":"2024-09-16T07:57:21.704253+0000","last_active":"2024-09-16T07:58:13.069554+0000","last_peered":"2024-09-16T07:58:13.069554+0000","last_clean":"2024-09-16T07:58:13.069554+0000","last_became_active":"2024-09-16T07:57:21.683562+0000","last_became_peered":"2024-09-16T07:57:21.683562+0000","last_unstale":"2024-09-16T07:58:13.069554+0000","last_undegraded":"2024-09-16T07:58:13.069554+0000","last_fullsized":"2024-09-16T07:58:13.069554+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:58:32.069088+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:58:32.069090+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067638+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:58:13.067638+0000","last_peered":"2024-09-16T07:58:13.067638+0000","last_clean":"2024-09-16T07:58:13.067638+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:58:13.067638+0000","last_undegraded":"2024-09-16T07:58:13.067638+0000","last_fullsized":"2024-09-16T07:58:13.067638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"137'529","reported_seq":559,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071467+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:13.071467+0000","last_peered":"2024-09-16T07:58:13.071467+0000","last_clean":"2024-09-16T07:58:13.071467+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:13.071467+0000","last_undegraded":"2024-09-16T07:58:13.071467+0000","last_fullsized":"2024-09-16T07:58:13.071467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":352,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.093504+0000","last_change":"2024-09-16T07:58:32.093504+0000","last_active":"2024-09-16T07:58:32.093504+0000","last_peered":"2024-09-16T07:58:13.071163+0000","last_clean":"2024-09-16T07:58:13.071163+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:58:32.093504+0000","last_undegraded":"2024-09-16T07:58:32.093504+0000","last_fullsized":"2024-09-16T07:58:32.093504+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"137'545","reported_seq":577,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.118586+0000","last_change":"2024-09-16T07:58:32.118586+0000","last_active":"2024-09-16T07:58:32.118586+0000","last_peered":"2024-09-16T07:58:13.067147+0000","last_clean":"2024-09-16T07:58:13.067147+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:32.118586+0000","last_undegraded":"2024-09-16T07:58:32.118586+0000","last_fullsized":"2024-09-16T07:58:32.118586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069861+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:58:13.069861+0000","last_peered":"2024-09-16T07:58:13.069861+0000","last_clean":"2024-09-16T07:58:13.069861+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:58:13.069861+0000","last_undegraded":"2024-09-16T07:58:13.069861+0000","last_fullsized":"2024-09-16T07:58:13.069861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"137'528","reported_seq":560,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.123332+0000","last_change":"2024-09-16T07:58:32.123332+0000","last_active":"2024-09-16T07:58:32.123332+0000","last_peered":"2024-09-16T07:58:13.073897+0000","last_clean":"2024-09-16T07:58:13.073897+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:32.123332+0000","last_undegraded":"2024-09-16T07:58:32.123332+0000","last_fullsized":"2024-09-16T07:58:32.123332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":345,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073235+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:58:13.073235+0000","last_peered":"2024-09-16T07:58:13.073235+0000","last_clean":"2024-09-16T07:58:13.073235+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:58:13.073235+0000","last_undegraded":"2024-09-16T07:58:13.073235+0000","last_fullsized":"2024-09-16T07:58:13.073235+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":563609600,"num_objects":8600,"num_object_clones":0,"num_object_copies":25800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8600,"num_write_kb":550400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99176448,"data_stored":1586823168,"data_compressed":75347526,"data_compressed_allocated":99176448,"data_compressed_original":1586823168,"omap_allocated":0,"internal_metadata":0},"log_size":8600,"ondisk_log_size":8600,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86060,"kb_used_data":34204,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94285780,"statfs":{"total":96636764160,"available":96548638720,"internally_reserved":0,"allocated":35024896,"data_stored":541930791,"data_compressed":25712339,"data_compressed_allocated":33845248,"data_compressed_original":541442048,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500792,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50372,"kb_used_data":21236,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94321468,"statfs":{"total":96636764160,"available":96585183232,"internally_reserved":0,"allocated":21745664,"data_stored":329524946,"data_compressed":15626743,"data_compressed_allocated":20570112,"data_compressed_original":329039872,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075608,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66704,"kb_used_data":29568,"kb_used_omap":0,"kb_used_meta":37120,"kb_avail":94305136,"statfs":{"total":96636764160,"available":96568459264,"internally_reserved":0,"allocated":30277632,"data_stored":466429106,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":38010880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29122560,"data_stored":465960960,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20529152,"data_stored":328466432,"data_compressed":15596702,"data_compressed_allocated":20529152,"data_compressed_original":328466432,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33804288,"data_stored":540868608,"data_compressed":25682298,"data_compressed_allocated":33804288,"data_compressed_original":540868608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:58:42.011 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:58:42.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:42.157+0000 7f12be311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:42.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:42.165+0000 7f12be311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:42.631 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:2024-09-16T07:58:42.633136+0000 min lat: 0.0156257 max lat: 24.3438 avg lat: 0.125448 2024-09-16T07:58:42.631 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:58:42.632 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 80 16 10213 10197 7.96557 10.5625 0.0687213 0.125448 2024-09-16T07:58:43.631 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 81 16 10379 10363 7.99531 10.375 0.170605 0.124949 2024-09-16T07:58:44.571 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:58:44.631 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 82 16 10569 10553 8.04261 11.875 0.0896291 0.124272 2024-09-16T07:58:44.668 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:44.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:44.746+0000 7f59980d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:44.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:44.758+0000 7f59980d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:44.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:44.841+0000 7fc12686c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:44.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:44.856+0000 7fc12686c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:45.153 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:45.154 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:58:45.174 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":544,"stamp":"2024-09-16T07:58:44.468396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":564199976,"num_objects":8604,"num_object_clones":0,"num_object_copies":25812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8680,"num_write_kb":551507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8655,"ondisk_log_size":8655,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248248,"kb_used_data":101432,"kb_used_omap":0,"kb_used_meta":146752,"kb_avail":377239112,"statfs":{"total":386547056640,"available":386292850688,"internally_reserved":0,"allocated":103866368,"data_stored":1589336617,"data_compressed":75384745,"data_compressed_allocated":99229696,"data_compressed_original":1587429376,"omap_allocated":0,"internal_metadata":150274048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001982"},"pg_stats":[{"pgid":"7.f","version":"137'557","reported_seq":590,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.117773+0000","last_change":"2024-09-16T07:58:32.124703+0000","last_active":"2024-09-16T07:58:32.124703+0000","last_peered":"2024-09-16T07:58:13.076723+0000","last_clean":"2024-09-16T07:58:13.076723+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:33.117773+0000","last_undegraded":"2024-09-16T07:58:33.117773+0000","last_fullsized":"2024-09-16T07:58:33.117773+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071891+0000","last_change":"2024-09-16T07:57:21.730082+0000","last_active":"2024-09-16T07:58:13.071891+0000","last_peered":"2024-09-16T07:58:13.071891+0000","last_clean":"2024-09-16T07:58:13.071891+0000","last_became_active":"2024-09-16T07:57:21.701780+0000","last_became_peered":"2024-09-16T07:57:21.701780+0000","last_unstale":"2024-09-16T07:58:13.071891+0000","last_undegraded":"2024-09-16T07:58:13.071891+0000","last_fullsized":"2024-09-16T07:58:13.071891+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.066949+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:13.066949+0000","last_peered":"2024-09-16T07:58:13.066949+0000","last_clean":"2024-09-16T07:58:13.066949+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:13.066949+0000","last_undegraded":"2024-09-16T07:58:13.066949+0000","last_fullsized":"2024-09-16T07:58:13.066949+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"137'533","reported_seq":563,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.072390+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:13.072390+0000","last_peered":"2024-09-16T07:58:13.072390+0000","last_clean":"2024-09-16T07:58:13.072390+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:13.072390+0000","last_undegraded":"2024-09-16T07:58:13.072390+0000","last_fullsized":"2024-09-16T07:58:13.072390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"137'508","reported_seq":541,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.116150+0000","last_change":"2024-09-16T07:58:32.142013+0000","last_active":"2024-09-16T07:58:32.142013+0000","last_peered":"2024-09-16T07:58:13.076585+0000","last_clean":"2024-09-16T07:58:13.076585+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:33.116150+0000","last_undegraded":"2024-09-16T07:58:33.116150+0000","last_fullsized":"2024-09-16T07:58:33.116150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"137'554","reported_seq":586,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.106969+0000","last_change":"2024-09-16T07:58:32.106969+0000","last_active":"2024-09-16T07:58:32.106969+0000","last_peered":"2024-09-16T07:58:13.070933+0000","last_clean":"2024-09-16T07:58:13.070933+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:32.106969+0000","last_undegraded":"2024-09-16T07:58:32.106969+0000","last_fullsized":"2024-09-16T07:58:32.106969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"137'603","reported_seq":633,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073722+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:13.073722+0000","last_peered":"2024-09-16T07:58:13.073722+0000","last_clean":"2024-09-16T07:58:13.073722+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:13.073722+0000","last_undegraded":"2024-09-16T07:58:13.073722+0000","last_fullsized":"2024-09-16T07:58:13.073722+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"137'543","reported_seq":573,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073405+0000","last_change":"2024-09-16T07:57:21.754262+0000","last_active":"2024-09-16T07:58:13.073405+0000","last_peered":"2024-09-16T07:58:13.073405+0000","last_clean":"2024-09-16T07:58:13.073405+0000","last_became_active":"2024-09-16T07:57:21.743887+0000","last_became_peered":"2024-09-16T07:57:21.743887+0000","last_unstale":"2024-09-16T07:58:13.073405+0000","last_undegraded":"2024-09-16T07:58:13.073405+0000","last_fullsized":"2024-09-16T07:58:13.073405+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"137'576","reported_seq":608,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.132254+0000","last_change":"2024-09-16T07:58:32.132254+0000","last_active":"2024-09-16T07:58:32.132254+0000","last_peered":"2024-09-16T07:58:13.074775+0000","last_clean":"2024-09-16T07:58:13.074775+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:32.132254+0000","last_undegraded":"2024-09-16T07:58:32.132254+0000","last_fullsized":"2024-09-16T07:58:32.132254+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":417,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.095446+0000","last_change":"2024-09-16T07:58:32.095446+0000","last_active":"2024-09-16T07:58:32.095446+0000","last_peered":"2024-09-16T07:58:13.070190+0000","last_clean":"2024-09-16T07:58:13.070190+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:58:32.095446+0000","last_undegraded":"2024-09-16T07:58:32.095446+0000","last_fullsized":"2024-09-16T07:58:32.095446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":352,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.068775+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:13.068775+0000","last_peered":"2024-09-16T07:58:13.068775+0000","last_clean":"2024-09-16T07:58:13.068775+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:13.068775+0000","last_undegraded":"2024-09-16T07:58:13.068775+0000","last_fullsized":"2024-09-16T07:58:13.068775+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067625+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:13.067625+0000","last_peered":"2024-09-16T07:58:13.067625+0000","last_clean":"2024-09-16T07:58:13.067625+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:13.067625+0000","last_undegraded":"2024-09-16T07:58:13.067625+0000","last_fullsized":"2024-09-16T07:58:13.067625+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:58:32.069085+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"137'597","reported_seq":627,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071646+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:58:13.071646+0000","last_peered":"2024-09-16T07:58:13.071646+0000","last_clean":"2024-09-16T07:58:13.071646+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:58:13.071646+0000","last_undegraded":"2024-09-16T07:58:13.071646+0000","last_fullsized":"2024-09-16T07:58:13.071646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":333,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.074065+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:13.074065+0000","last_peered":"2024-09-16T07:58:13.074065+0000","last_clean":"2024-09-16T07:58:13.074065+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:13.074065+0000","last_undegraded":"2024-09-16T07:58:13.074065+0000","last_fullsized":"2024-09-16T07:58:13.074065+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069554+0000","last_change":"2024-09-16T07:57:21.704253+0000","last_active":"2024-09-16T07:58:13.069554+0000","last_peered":"2024-09-16T07:58:13.069554+0000","last_clean":"2024-09-16T07:58:13.069554+0000","last_became_active":"2024-09-16T07:57:21.683562+0000","last_became_peered":"2024-09-16T07:57:21.683562+0000","last_unstale":"2024-09-16T07:58:13.069554+0000","last_undegraded":"2024-09-16T07:58:13.069554+0000","last_fullsized":"2024-09-16T07:58:13.069554+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:58:32.069088+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:58:32.069090+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067638+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:58:13.067638+0000","last_peered":"2024-09-16T07:58:13.067638+0000","last_clean":"2024-09-16T07:58:13.067638+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:58:13.067638+0000","last_undegraded":"2024-09-16T07:58:13.067638+0000","last_fullsized":"2024-09-16T07:58:13.067638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"137'529","reported_seq":559,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071467+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:13.071467+0000","last_peered":"2024-09-16T07:58:13.071467+0000","last_clean":"2024-09-16T07:58:13.071467+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:13.071467+0000","last_undegraded":"2024-09-16T07:58:13.071467+0000","last_fullsized":"2024-09-16T07:58:13.071467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":352,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.093504+0000","last_change":"2024-09-16T07:58:32.093504+0000","last_active":"2024-09-16T07:58:32.093504+0000","last_peered":"2024-09-16T07:58:13.071163+0000","last_clean":"2024-09-16T07:58:13.071163+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:58:32.093504+0000","last_undegraded":"2024-09-16T07:58:32.093504+0000","last_fullsized":"2024-09-16T07:58:32.093504+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"137'545","reported_seq":577,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.118586+0000","last_change":"2024-09-16T07:58:32.118586+0000","last_active":"2024-09-16T07:58:32.118586+0000","last_peered":"2024-09-16T07:58:13.067147+0000","last_clean":"2024-09-16T07:58:13.067147+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:32.118586+0000","last_undegraded":"2024-09-16T07:58:32.118586+0000","last_fullsized":"2024-09-16T07:58:32.118586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069861+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:58:13.069861+0000","last_peered":"2024-09-16T07:58:13.069861+0000","last_clean":"2024-09-16T07:58:13.069861+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:58:13.069861+0000","last_undegraded":"2024-09-16T07:58:13.069861+0000","last_fullsized":"2024-09-16T07:58:13.069861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"137'528","reported_seq":560,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.123332+0000","last_change":"2024-09-16T07:58:32.123332+0000","last_active":"2024-09-16T07:58:32.123332+0000","last_peered":"2024-09-16T07:58:13.073897+0000","last_clean":"2024-09-16T07:58:13.073897+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:32.123332+0000","last_undegraded":"2024-09-16T07:58:32.123332+0000","last_fullsized":"2024-09-16T07:58:32.123332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":345,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073235+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:58:13.073235+0000","last_peered":"2024-09-16T07:58:13.073235+0000","last_clean":"2024-09-16T07:58:13.073235+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:58:13.073235+0000","last_undegraded":"2024-09-16T07:58:13.073235+0000","last_fullsized":"2024-09-16T07:58:13.073235+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":563609600,"num_objects":8600,"num_object_clones":0,"num_object_copies":25800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8600,"num_write_kb":550400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99176448,"data_stored":1586823168,"data_compressed":75347526,"data_compressed_allocated":99176448,"data_compressed_original":1586823168,"omap_allocated":0,"internal_metadata":0},"log_size":8600,"ondisk_log_size":8600,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86060,"kb_used_data":34204,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94285780,"statfs":{"total":96636764160,"available":96548638720,"internally_reserved":0,"allocated":35024896,"data_stored":541930791,"data_compressed":25712339,"data_compressed_allocated":33845248,"data_compressed_original":541442048,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500792,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50372,"kb_used_data":21236,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94321468,"statfs":{"total":96636764160,"available":96585183232,"internally_reserved":0,"allocated":21745664,"data_stored":329524946,"data_compressed":15626743,"data_compressed_allocated":20570112,"data_compressed_original":329039872,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075608,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66704,"kb_used_data":29568,"kb_used_omap":0,"kb_used_meta":37120,"kb_avail":94305136,"statfs":{"total":96636764160,"available":96568459264,"internally_reserved":0,"allocated":30277632,"data_stored":466429106,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":38010880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29122560,"data_stored":465960960,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20529152,"data_stored":328466432,"data_compressed":15596702,"data_compressed_allocated":20529152,"data_compressed_original":328466432,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33804288,"data_stored":540868608,"data_compressed":25682298,"data_compressed_allocated":33804288,"data_compressed_original":540868608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:58:45.175 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:58:45.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:45.377+0000 7f339dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:45.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:45.389+0000 7f339dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:45.631 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 83 16 10744 10728 8.07747 10.9375 0.0923489 0.123707 2024-09-16T07:58:45.904 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:45.905 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":827,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":142,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473513,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":14},{"state_name":"peering","count":8},{"state_name":"stale+active+clean","count":3}],"num_pgs":25,"num_pools":3,"num_objects":8604,"data_bytes":564199976,"bytes_used":254205952,"bytes_avail":386292850688,"bytes_total":386547056640,"inactive_pgs_ratio":0.31999999284744263},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:58:45.924 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:58:45.924 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:46.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:46.076+0000 7fe46545c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:46.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:46.090+0000 7fe46545c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:46.385 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:46.385 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:58:46.407 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":544,"stamp":"2024-09-16T07:58:44.468396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":564199976,"num_objects":8604,"num_object_clones":0,"num_object_copies":25812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8680,"num_write_kb":551507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8655,"ondisk_log_size":8655,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248248,"kb_used_data":101432,"kb_used_omap":0,"kb_used_meta":146752,"kb_avail":377239112,"statfs":{"total":386547056640,"available":386292850688,"internally_reserved":0,"allocated":103866368,"data_stored":1589336617,"data_compressed":75384745,"data_compressed_allocated":99229696,"data_compressed_original":1587429376,"omap_allocated":0,"internal_metadata":150274048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001982"},"pg_stats":[{"pgid":"7.f","version":"137'557","reported_seq":590,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.117773+0000","last_change":"2024-09-16T07:58:32.124703+0000","last_active":"2024-09-16T07:58:32.124703+0000","last_peered":"2024-09-16T07:58:13.076723+0000","last_clean":"2024-09-16T07:58:13.076723+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:33.117773+0000","last_undegraded":"2024-09-16T07:58:33.117773+0000","last_fullsized":"2024-09-16T07:58:33.117773+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071891+0000","last_change":"2024-09-16T07:57:21.730082+0000","last_active":"2024-09-16T07:58:13.071891+0000","last_peered":"2024-09-16T07:58:13.071891+0000","last_clean":"2024-09-16T07:58:13.071891+0000","last_became_active":"2024-09-16T07:57:21.701780+0000","last_became_peered":"2024-09-16T07:57:21.701780+0000","last_unstale":"2024-09-16T07:58:13.071891+0000","last_undegraded":"2024-09-16T07:58:13.071891+0000","last_fullsized":"2024-09-16T07:58:13.071891+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.066949+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:13.066949+0000","last_peered":"2024-09-16T07:58:13.066949+0000","last_clean":"2024-09-16T07:58:13.066949+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:13.066949+0000","last_undegraded":"2024-09-16T07:58:13.066949+0000","last_fullsized":"2024-09-16T07:58:13.066949+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"137'533","reported_seq":563,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.072390+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:13.072390+0000","last_peered":"2024-09-16T07:58:13.072390+0000","last_clean":"2024-09-16T07:58:13.072390+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:13.072390+0000","last_undegraded":"2024-09-16T07:58:13.072390+0000","last_fullsized":"2024-09-16T07:58:13.072390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"137'508","reported_seq":541,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.116150+0000","last_change":"2024-09-16T07:58:32.142013+0000","last_active":"2024-09-16T07:58:32.142013+0000","last_peered":"2024-09-16T07:58:13.076585+0000","last_clean":"2024-09-16T07:58:13.076585+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:33.116150+0000","last_undegraded":"2024-09-16T07:58:33.116150+0000","last_fullsized":"2024-09-16T07:58:33.116150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"137'554","reported_seq":586,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.106969+0000","last_change":"2024-09-16T07:58:32.106969+0000","last_active":"2024-09-16T07:58:32.106969+0000","last_peered":"2024-09-16T07:58:13.070933+0000","last_clean":"2024-09-16T07:58:13.070933+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:32.106969+0000","last_undegraded":"2024-09-16T07:58:32.106969+0000","last_fullsized":"2024-09-16T07:58:32.106969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"137'603","reported_seq":633,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073722+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:13.073722+0000","last_peered":"2024-09-16T07:58:13.073722+0000","last_clean":"2024-09-16T07:58:13.073722+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:13.073722+0000","last_undegraded":"2024-09-16T07:58:13.073722+0000","last_fullsized":"2024-09-16T07:58:13.073722+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"137'543","reported_seq":573,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073405+0000","last_change":"2024-09-16T07:57:21.754262+0000","last_active":"2024-09-16T07:58:13.073405+0000","last_peered":"2024-09-16T07:58:13.073405+0000","last_clean":"2024-09-16T07:58:13.073405+0000","last_became_active":"2024-09-16T07:57:21.743887+0000","last_became_peered":"2024-09-16T07:57:21.743887+0000","last_unstale":"2024-09-16T07:58:13.073405+0000","last_undegraded":"2024-09-16T07:58:13.073405+0000","last_fullsized":"2024-09-16T07:58:13.073405+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"137'576","reported_seq":608,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.132254+0000","last_change":"2024-09-16T07:58:32.132254+0000","last_active":"2024-09-16T07:58:32.132254+0000","last_peered":"2024-09-16T07:58:13.074775+0000","last_clean":"2024-09-16T07:58:13.074775+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:32.132254+0000","last_undegraded":"2024-09-16T07:58:32.132254+0000","last_fullsized":"2024-09-16T07:58:32.132254+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":417,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.095446+0000","last_change":"2024-09-16T07:58:32.095446+0000","last_active":"2024-09-16T07:58:32.095446+0000","last_peered":"2024-09-16T07:58:13.070190+0000","last_clean":"2024-09-16T07:58:13.070190+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:58:32.095446+0000","last_undegraded":"2024-09-16T07:58:32.095446+0000","last_fullsized":"2024-09-16T07:58:32.095446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":352,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.068775+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:13.068775+0000","last_peered":"2024-09-16T07:58:13.068775+0000","last_clean":"2024-09-16T07:58:13.068775+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:13.068775+0000","last_undegraded":"2024-09-16T07:58:13.068775+0000","last_fullsized":"2024-09-16T07:58:13.068775+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067625+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:13.067625+0000","last_peered":"2024-09-16T07:58:13.067625+0000","last_clean":"2024-09-16T07:58:13.067625+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:13.067625+0000","last_undegraded":"2024-09-16T07:58:13.067625+0000","last_fullsized":"2024-09-16T07:58:13.067625+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:58:32.069085+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"137'597","reported_seq":627,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071646+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:58:13.071646+0000","last_peered":"2024-09-16T07:58:13.071646+0000","last_clean":"2024-09-16T07:58:13.071646+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:58:13.071646+0000","last_undegraded":"2024-09-16T07:58:13.071646+0000","last_fullsized":"2024-09-16T07:58:13.071646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":333,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.074065+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:13.074065+0000","last_peered":"2024-09-16T07:58:13.074065+0000","last_clean":"2024-09-16T07:58:13.074065+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:13.074065+0000","last_undegraded":"2024-09-16T07:58:13.074065+0000","last_fullsized":"2024-09-16T07:58:13.074065+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069554+0000","last_change":"2024-09-16T07:57:21.704253+0000","last_active":"2024-09-16T07:58:13.069554+0000","last_peered":"2024-09-16T07:58:13.069554+0000","last_clean":"2024-09-16T07:58:13.069554+0000","last_became_active":"2024-09-16T07:57:21.683562+0000","last_became_peered":"2024-09-16T07:57:21.683562+0000","last_unstale":"2024-09-16T07:58:13.069554+0000","last_undegraded":"2024-09-16T07:58:13.069554+0000","last_fullsized":"2024-09-16T07:58:13.069554+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:58:32.069088+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:58:32.069090+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067638+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:58:13.067638+0000","last_peered":"2024-09-16T07:58:13.067638+0000","last_clean":"2024-09-16T07:58:13.067638+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:58:13.067638+0000","last_undegraded":"2024-09-16T07:58:13.067638+0000","last_fullsized":"2024-09-16T07:58:13.067638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"137'529","reported_seq":559,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071467+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:13.071467+0000","last_peered":"2024-09-16T07:58:13.071467+0000","last_clean":"2024-09-16T07:58:13.071467+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:13.071467+0000","last_undegraded":"2024-09-16T07:58:13.071467+0000","last_fullsized":"2024-09-16T07:58:13.071467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":352,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.093504+0000","last_change":"2024-09-16T07:58:32.093504+0000","last_active":"2024-09-16T07:58:32.093504+0000","last_peered":"2024-09-16T07:58:13.071163+0000","last_clean":"2024-09-16T07:58:13.071163+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:58:32.093504+0000","last_undegraded":"2024-09-16T07:58:32.093504+0000","last_fullsized":"2024-09-16T07:58:32.093504+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"137'545","reported_seq":577,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.118586+0000","last_change":"2024-09-16T07:58:32.118586+0000","last_active":"2024-09-16T07:58:32.118586+0000","last_peered":"2024-09-16T07:58:13.067147+0000","last_clean":"2024-09-16T07:58:13.067147+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:32.118586+0000","last_undegraded":"2024-09-16T07:58:32.118586+0000","last_fullsized":"2024-09-16T07:58:32.118586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069861+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:58:13.069861+0000","last_peered":"2024-09-16T07:58:13.069861+0000","last_clean":"2024-09-16T07:58:13.069861+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:58:13.069861+0000","last_undegraded":"2024-09-16T07:58:13.069861+0000","last_fullsized":"2024-09-16T07:58:13.069861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"137'528","reported_seq":560,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.123332+0000","last_change":"2024-09-16T07:58:32.123332+0000","last_active":"2024-09-16T07:58:32.123332+0000","last_peered":"2024-09-16T07:58:13.073897+0000","last_clean":"2024-09-16T07:58:13.073897+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:32.123332+0000","last_undegraded":"2024-09-16T07:58:32.123332+0000","last_fullsized":"2024-09-16T07:58:32.123332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":345,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073235+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:58:13.073235+0000","last_peered":"2024-09-16T07:58:13.073235+0000","last_clean":"2024-09-16T07:58:13.073235+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:58:13.073235+0000","last_undegraded":"2024-09-16T07:58:13.073235+0000","last_fullsized":"2024-09-16T07:58:13.073235+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":563609600,"num_objects":8600,"num_object_clones":0,"num_object_copies":25800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8600,"num_write_kb":550400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99176448,"data_stored":1586823168,"data_compressed":75347526,"data_compressed_allocated":99176448,"data_compressed_original":1586823168,"omap_allocated":0,"internal_metadata":0},"log_size":8600,"ondisk_log_size":8600,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86060,"kb_used_data":34204,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94285780,"statfs":{"total":96636764160,"available":96548638720,"internally_reserved":0,"allocated":35024896,"data_stored":541930791,"data_compressed":25712339,"data_compressed_allocated":33845248,"data_compressed_original":541442048,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500792,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50372,"kb_used_data":21236,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94321468,"statfs":{"total":96636764160,"available":96585183232,"internally_reserved":0,"allocated":21745664,"data_stored":329524946,"data_compressed":15626743,"data_compressed_allocated":20570112,"data_compressed_original":329039872,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075608,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66704,"kb_used_data":29568,"kb_used_omap":0,"kb_used_meta":37120,"kb_avail":94305136,"statfs":{"total":96636764160,"available":96568459264,"internally_reserved":0,"allocated":30277632,"data_stored":466429106,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":38010880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29122560,"data_stored":465960960,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20529152,"data_stored":328466432,"data_compressed":15596702,"data_compressed_allocated":20529152,"data_compressed_original":328466432,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33804288,"data_stored":540868608,"data_compressed":25682298,"data_compressed_allocated":33804288,"data_compressed_original":540868608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:58:46.631 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 84 16 10907 10891 8.10258 10.1875 0.0957468 0.123312 2024-09-16T07:58:47.153 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:58:47.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:47.305+0000 7f1698791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:47.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:47.312+0000 7f1698791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:47.631 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 85 16 11093 11077 8.144 11.625 0.125228 0.12271 2024-09-16T07:58:48.631 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 86 16 11266 11250 8.17502 10.8125 0.109671 0.122249 2024-09-16T07:58:49.409 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:49.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:49.551+0000 7ff186151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:49.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:49.565+0000 7ff186151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:49.631 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 87 16 11441 11425 8.20676 10.9375 0.101735 0.121779 2024-09-16T07:58:49.742 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:58:49.855 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:49.856 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:58:49.875 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":546,"stamp":"2024-09-16T07:58:48.469296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":564199976,"num_objects":8604,"num_object_clones":0,"num_object_copies":25812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8680,"num_write_kb":551507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8655,"ondisk_log_size":8655,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248248,"kb_used_data":101432,"kb_used_omap":0,"kb_used_meta":146752,"kb_avail":377239112,"statfs":{"total":386547056640,"available":386292850688,"internally_reserved":0,"allocated":103866368,"data_stored":1589336617,"data_compressed":75384745,"data_compressed_allocated":99229696,"data_compressed_original":1587429376,"omap_allocated":0,"internal_metadata":150274048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002504"},"pg_stats":[{"pgid":"7.f","version":"137'557","reported_seq":590,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.117773+0000","last_change":"2024-09-16T07:58:32.124703+0000","last_active":"2024-09-16T07:58:32.124703+0000","last_peered":"2024-09-16T07:58:13.076723+0000","last_clean":"2024-09-16T07:58:13.076723+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:33.117773+0000","last_undegraded":"2024-09-16T07:58:33.117773+0000","last_fullsized":"2024-09-16T07:58:33.117773+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071891+0000","last_change":"2024-09-16T07:57:21.730082+0000","last_active":"2024-09-16T07:58:13.071891+0000","last_peered":"2024-09-16T07:58:13.071891+0000","last_clean":"2024-09-16T07:58:13.071891+0000","last_became_active":"2024-09-16T07:57:21.701780+0000","last_became_peered":"2024-09-16T07:57:21.701780+0000","last_unstale":"2024-09-16T07:58:13.071891+0000","last_undegraded":"2024-09-16T07:58:13.071891+0000","last_fullsized":"2024-09-16T07:58:13.071891+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.066949+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:13.066949+0000","last_peered":"2024-09-16T07:58:13.066949+0000","last_clean":"2024-09-16T07:58:13.066949+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:13.066949+0000","last_undegraded":"2024-09-16T07:58:13.066949+0000","last_fullsized":"2024-09-16T07:58:13.066949+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"137'533","reported_seq":563,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.072390+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:13.072390+0000","last_peered":"2024-09-16T07:58:13.072390+0000","last_clean":"2024-09-16T07:58:13.072390+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:13.072390+0000","last_undegraded":"2024-09-16T07:58:13.072390+0000","last_fullsized":"2024-09-16T07:58:13.072390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"137'508","reported_seq":541,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.116150+0000","last_change":"2024-09-16T07:58:32.142013+0000","last_active":"2024-09-16T07:58:32.142013+0000","last_peered":"2024-09-16T07:58:13.076585+0000","last_clean":"2024-09-16T07:58:13.076585+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:33.116150+0000","last_undegraded":"2024-09-16T07:58:33.116150+0000","last_fullsized":"2024-09-16T07:58:33.116150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"137'554","reported_seq":586,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.106969+0000","last_change":"2024-09-16T07:58:32.106969+0000","last_active":"2024-09-16T07:58:32.106969+0000","last_peered":"2024-09-16T07:58:13.070933+0000","last_clean":"2024-09-16T07:58:13.070933+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:32.106969+0000","last_undegraded":"2024-09-16T07:58:32.106969+0000","last_fullsized":"2024-09-16T07:58:32.106969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"137'603","reported_seq":633,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073722+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:13.073722+0000","last_peered":"2024-09-16T07:58:13.073722+0000","last_clean":"2024-09-16T07:58:13.073722+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:13.073722+0000","last_undegraded":"2024-09-16T07:58:13.073722+0000","last_fullsized":"2024-09-16T07:58:13.073722+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"137'543","reported_seq":573,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073405+0000","last_change":"2024-09-16T07:57:21.754262+0000","last_active":"2024-09-16T07:58:13.073405+0000","last_peered":"2024-09-16T07:58:13.073405+0000","last_clean":"2024-09-16T07:58:13.073405+0000","last_became_active":"2024-09-16T07:57:21.743887+0000","last_became_peered":"2024-09-16T07:57:21.743887+0000","last_unstale":"2024-09-16T07:58:13.073405+0000","last_undegraded":"2024-09-16T07:58:13.073405+0000","last_fullsized":"2024-09-16T07:58:13.073405+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"137'576","reported_seq":608,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.132254+0000","last_change":"2024-09-16T07:58:32.132254+0000","last_active":"2024-09-16T07:58:32.132254+0000","last_peered":"2024-09-16T07:58:13.074775+0000","last_clean":"2024-09-16T07:58:13.074775+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:32.132254+0000","last_undegraded":"2024-09-16T07:58:32.132254+0000","last_fullsized":"2024-09-16T07:58:32.132254+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":417,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.095446+0000","last_change":"2024-09-16T07:58:32.095446+0000","last_active":"2024-09-16T07:58:32.095446+0000","last_peered":"2024-09-16T07:58:13.070190+0000","last_clean":"2024-09-16T07:58:13.070190+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:58:32.095446+0000","last_undegraded":"2024-09-16T07:58:32.095446+0000","last_fullsized":"2024-09-16T07:58:32.095446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":352,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.068775+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:13.068775+0000","last_peered":"2024-09-16T07:58:13.068775+0000","last_clean":"2024-09-16T07:58:13.068775+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:13.068775+0000","last_undegraded":"2024-09-16T07:58:13.068775+0000","last_fullsized":"2024-09-16T07:58:13.068775+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067625+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:13.067625+0000","last_peered":"2024-09-16T07:58:13.067625+0000","last_clean":"2024-09-16T07:58:13.067625+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:13.067625+0000","last_undegraded":"2024-09-16T07:58:13.067625+0000","last_fullsized":"2024-09-16T07:58:13.067625+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:58:32.069085+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"137'597","reported_seq":627,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071646+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:58:13.071646+0000","last_peered":"2024-09-16T07:58:13.071646+0000","last_clean":"2024-09-16T07:58:13.071646+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:58:13.071646+0000","last_undegraded":"2024-09-16T07:58:13.071646+0000","last_fullsized":"2024-09-16T07:58:13.071646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":333,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.074065+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:13.074065+0000","last_peered":"2024-09-16T07:58:13.074065+0000","last_clean":"2024-09-16T07:58:13.074065+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:13.074065+0000","last_undegraded":"2024-09-16T07:58:13.074065+0000","last_fullsized":"2024-09-16T07:58:13.074065+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"137'553","reported_seq":583,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069554+0000","last_change":"2024-09-16T07:57:21.704253+0000","last_active":"2024-09-16T07:58:13.069554+0000","last_peered":"2024-09-16T07:58:13.069554+0000","last_clean":"2024-09-16T07:58:13.069554+0000","last_became_active":"2024-09-16T07:57:21.683562+0000","last_became_peered":"2024-09-16T07:57:21.683562+0000","last_unstale":"2024-09-16T07:58:13.069554+0000","last_undegraded":"2024-09-16T07:58:13.069554+0000","last_fullsized":"2024-09-16T07:58:13.069554+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:58:32.069088+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:58:32.069090+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067638+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:58:13.067638+0000","last_peered":"2024-09-16T07:58:13.067638+0000","last_clean":"2024-09-16T07:58:13.067638+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:58:13.067638+0000","last_undegraded":"2024-09-16T07:58:13.067638+0000","last_fullsized":"2024-09-16T07:58:13.067638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"137'529","reported_seq":559,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071467+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:13.071467+0000","last_peered":"2024-09-16T07:58:13.071467+0000","last_clean":"2024-09-16T07:58:13.071467+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:13.071467+0000","last_undegraded":"2024-09-16T07:58:13.071467+0000","last_fullsized":"2024-09-16T07:58:13.071467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":352,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.093504+0000","last_change":"2024-09-16T07:58:32.093504+0000","last_active":"2024-09-16T07:58:32.093504+0000","last_peered":"2024-09-16T07:58:13.071163+0000","last_clean":"2024-09-16T07:58:13.071163+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:58:32.093504+0000","last_undegraded":"2024-09-16T07:58:32.093504+0000","last_fullsized":"2024-09-16T07:58:32.093504+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"137'545","reported_seq":577,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.118586+0000","last_change":"2024-09-16T07:58:32.118586+0000","last_active":"2024-09-16T07:58:32.118586+0000","last_peered":"2024-09-16T07:58:13.067147+0000","last_clean":"2024-09-16T07:58:13.067147+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:32.118586+0000","last_undegraded":"2024-09-16T07:58:32.118586+0000","last_fullsized":"2024-09-16T07:58:32.118586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069861+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:58:13.069861+0000","last_peered":"2024-09-16T07:58:13.069861+0000","last_clean":"2024-09-16T07:58:13.069861+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:58:13.069861+0000","last_undegraded":"2024-09-16T07:58:13.069861+0000","last_fullsized":"2024-09-16T07:58:13.069861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"137'528","reported_seq":560,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.123332+0000","last_change":"2024-09-16T07:58:32.123332+0000","last_active":"2024-09-16T07:58:32.123332+0000","last_peered":"2024-09-16T07:58:13.073897+0000","last_clean":"2024-09-16T07:58:13.073897+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:32.123332+0000","last_undegraded":"2024-09-16T07:58:32.123332+0000","last_fullsized":"2024-09-16T07:58:32.123332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":345,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073235+0000","last_change":"2024-09-16T07:56:53.083740+0000","last_active":"2024-09-16T07:58:13.073235+0000","last_peered":"2024-09-16T07:58:13.073235+0000","last_clean":"2024-09-16T07:58:13.073235+0000","last_became_active":"2024-09-16T07:56:52.295842+0000","last_became_peered":"2024-09-16T07:56:52.295842+0000","last_unstale":"2024-09-16T07:58:13.073235+0000","last_undegraded":"2024-09-16T07:58:13.073235+0000","last_fullsized":"2024-09-16T07:58:13.073235+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":563609600,"num_objects":8600,"num_object_clones":0,"num_object_copies":25800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8600,"num_write_kb":550400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99176448,"data_stored":1586823168,"data_compressed":75347526,"data_compressed_allocated":99176448,"data_compressed_original":1586823168,"omap_allocated":0,"internal_metadata":0},"log_size":8600,"ondisk_log_size":8600,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86060,"kb_used_data":34204,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94285780,"statfs":{"total":96636764160,"available":96548638720,"internally_reserved":0,"allocated":35024896,"data_stored":541930791,"data_compressed":25712339,"data_compressed_allocated":33845248,"data_compressed_original":541442048,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500792,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50372,"kb_used_data":21236,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94321468,"statfs":{"total":96636764160,"available":96585183232,"internally_reserved":0,"allocated":21745664,"data_stored":329524946,"data_compressed":15626743,"data_compressed_allocated":20570112,"data_compressed_original":329039872,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075608,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66704,"kb_used_data":29568,"kb_used_omap":0,"kb_used_meta":37120,"kb_avail":94305136,"statfs":{"total":96636764160,"available":96568459264,"internally_reserved":0,"allocated":30277632,"data_stored":466429106,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":38010880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29122560,"data_stored":465960960,"data_compressed":22125428,"data_compressed_allocated":29122560,"data_compressed_original":465960960,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20529152,"data_stored":328466432,"data_compressed":15596702,"data_compressed_allocated":20529152,"data_compressed_original":328466432,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33804288,"data_stored":540868608,"data_compressed":25682298,"data_compressed_allocated":33804288,"data_compressed_original":540868608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:58:49.877 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:58:49.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:49.916+0000 7f7453551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:49.924 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:49.925+0000 7f7453551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:50.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:50.036+0000 7f6a0509c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:50.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:50.047+0000 7f6a0509c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:50.407 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:50.407 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":832,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":142,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473513,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":14},{"state_name":"peering","count":8},{"state_name":"stale+active+clean","count":3}],"num_pgs":25,"num_pools":3,"num_objects":8604,"data_bytes":564199976,"bytes_used":254205952,"bytes_avail":386292850688,"bytes_total":386547056640,"inactive_pgs_ratio":0.31999999284744263},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:58:50.427 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T07:58:50.427 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:50.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:50.607+0000 7f8167391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:50.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:50.620+0000 7f8167391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:50.632 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 88 16 11601 11585 8.22713 10 0.0810267 0.12145 2024-09-16T07:58:50.874 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:50.874 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:58:50.891 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":547,"stamp":"2024-09-16T07:58:50.469671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":608567848,"num_objects":9281,"num_object_clones":0,"num_object_copies":27843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9357,"num_write_kb":594835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9332,"ondisk_log_size":9332,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248344,"kb_used_data":109848,"kb_used_omap":0,"kb_used_meta":138432,"kb_avail":377239016,"statfs":{"total":386547056640,"available":386292752384,"internally_reserved":0,"allocated":112484352,"data_stored":1726714339,"data_compressed":81907496,"data_compressed_allocated":107814912,"data_compressed_original":1724792832,"omap_allocated":0,"internal_metadata":141754368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":44367872,"num_objects":677,"num_object_clones":0,"num_object_copies":2031,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":43328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002510"},"pg_stats":[{"pgid":"7.f","version":"137'557","reported_seq":590,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.117773+0000","last_change":"2024-09-16T07:58:32.124703+0000","last_active":"2024-09-16T07:58:32.124703+0000","last_peered":"2024-09-16T07:58:13.076723+0000","last_clean":"2024-09-16T07:58:13.076723+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:33.117773+0000","last_undegraded":"2024-09-16T07:58:33.117773+0000","last_fullsized":"2024-09-16T07:58:33.117773+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"142'733","reported_seq":776,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.944012+0000","last_change":"2024-09-16T07:58:34.224845+0000","last_active":"2024-09-16T07:58:49.944012+0000","last_peered":"2024-09-16T07:58:49.944012+0000","last_clean":"2024-09-16T07:58:49.944012+0000","last_became_active":"2024-09-16T07:58:34.204525+0000","last_became_peered":"2024-09-16T07:58:34.204525+0000","last_unstale":"2024-09-16T07:58:49.944012+0000","last_undegraded":"2024-09-16T07:58:49.944012+0000","last_fullsized":"2024-09-16T07:58:49.944012+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.066949+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:13.066949+0000","last_peered":"2024-09-16T07:58:13.066949+0000","last_clean":"2024-09-16T07:58:13.066949+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:13.066949+0000","last_undegraded":"2024-09-16T07:58:13.066949+0000","last_fullsized":"2024-09-16T07:58:13.066949+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"137'533","reported_seq":563,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.072390+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:13.072390+0000","last_peered":"2024-09-16T07:58:13.072390+0000","last_clean":"2024-09-16T07:58:13.072390+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:13.072390+0000","last_undegraded":"2024-09-16T07:58:13.072390+0000","last_fullsized":"2024-09-16T07:58:13.072390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"137'508","reported_seq":541,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.116150+0000","last_change":"2024-09-16T07:58:32.142013+0000","last_active":"2024-09-16T07:58:32.142013+0000","last_peered":"2024-09-16T07:58:13.076585+0000","last_clean":"2024-09-16T07:58:13.076585+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:33.116150+0000","last_undegraded":"2024-09-16T07:58:33.116150+0000","last_fullsized":"2024-09-16T07:58:33.116150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"137'554","reported_seq":586,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.106969+0000","last_change":"2024-09-16T07:58:32.106969+0000","last_active":"2024-09-16T07:58:32.106969+0000","last_peered":"2024-09-16T07:58:13.070933+0000","last_clean":"2024-09-16T07:58:13.070933+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:32.106969+0000","last_undegraded":"2024-09-16T07:58:32.106969+0000","last_fullsized":"2024-09-16T07:58:32.106969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"137'603","reported_seq":633,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073722+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:13.073722+0000","last_peered":"2024-09-16T07:58:13.073722+0000","last_clean":"2024-09-16T07:58:13.073722+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:13.073722+0000","last_undegraded":"2024-09-16T07:58:13.073722+0000","last_fullsized":"2024-09-16T07:58:13.073722+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"142'704","reported_seq":754,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:50.032986+0000","last_change":"2024-09-16T07:58:34.626925+0000","last_active":"2024-09-16T07:58:50.032986+0000","last_peered":"2024-09-16T07:58:50.032986+0000","last_clean":"2024-09-16T07:58:50.032986+0000","last_became_active":"2024-09-16T07:58:34.283717+0000","last_became_peered":"2024-09-16T07:58:34.283717+0000","last_unstale":"2024-09-16T07:58:50.032986+0000","last_undegraded":"2024-09-16T07:58:50.032986+0000","last_fullsized":"2024-09-16T07:58:50.032986+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":704,"num_object_clones":0,"num_object_copies":2112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"137'576","reported_seq":608,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.132254+0000","last_change":"2024-09-16T07:58:32.132254+0000","last_active":"2024-09-16T07:58:32.132254+0000","last_peered":"2024-09-16T07:58:13.074775+0000","last_clean":"2024-09-16T07:58:13.074775+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:32.132254+0000","last_undegraded":"2024-09-16T07:58:32.132254+0000","last_fullsized":"2024-09-16T07:58:32.132254+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":417,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.095446+0000","last_change":"2024-09-16T07:58:32.095446+0000","last_active":"2024-09-16T07:58:32.095446+0000","last_peered":"2024-09-16T07:58:13.070190+0000","last_clean":"2024-09-16T07:58:13.070190+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:58:32.095446+0000","last_undegraded":"2024-09-16T07:58:32.095446+0000","last_fullsized":"2024-09-16T07:58:32.095446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":364,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.140808+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:35.140808+0000","last_peered":"2024-09-16T07:58:35.140808+0000","last_clean":"2024-09-16T07:58:35.140808+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:35.140808+0000","last_undegraded":"2024-09-16T07:58:35.140808+0000","last_fullsized":"2024-09-16T07:58:35.140808+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"142'721","reported_seq":763,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.889219+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:49.889219+0000","last_peered":"2024-09-16T07:58:49.889219+0000","last_clean":"2024-09-16T07:58:49.889219+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:49.889219+0000","last_undegraded":"2024-09-16T07:58:49.889219+0000","last_fullsized":"2024-09-16T07:58:49.889219+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:58:32.069085+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"137'597","reported_seq":627,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071646+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:58:13.071646+0000","last_peered":"2024-09-16T07:58:13.071646+0000","last_clean":"2024-09-16T07:58:13.071646+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:58:13.071646+0000","last_undegraded":"2024-09-16T07:58:13.071646+0000","last_fullsized":"2024-09-16T07:58:13.071646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":345,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.147860+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:35.147860+0000","last_peered":"2024-09-16T07:58:35.147860+0000","last_clean":"2024-09-16T07:58:35.147860+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:35.147860+0000","last_undegraded":"2024-09-16T07:58:35.147860+0000","last_fullsized":"2024-09-16T07:58:35.147860+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"142'717","reported_seq":773,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.741569+0000","last_change":"2024-09-16T07:58:34.475137+0000","last_active":"2024-09-16T07:58:49.741569+0000","last_peered":"2024-09-16T07:58:49.741569+0000","last_clean":"2024-09-16T07:58:49.741569+0000","last_became_active":"2024-09-16T07:58:34.211141+0000","last_became_peered":"2024-09-16T07:58:34.211141+0000","last_unstale":"2024-09-16T07:58:49.741569+0000","last_undegraded":"2024-09-16T07:58:49.741569+0000","last_fullsized":"2024-09-16T07:58:49.741569+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46989312,"num_objects":717,"num_object_clones":0,"num_object_copies":2151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":45888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:58:32.069088+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:58:32.069090+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067638+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:58:13.067638+0000","last_peered":"2024-09-16T07:58:13.067638+0000","last_clean":"2024-09-16T07:58:13.067638+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:58:13.067638+0000","last_undegraded":"2024-09-16T07:58:13.067638+0000","last_fullsized":"2024-09-16T07:58:13.067638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"137'529","reported_seq":559,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071467+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:13.071467+0000","last_peered":"2024-09-16T07:58:13.071467+0000","last_clean":"2024-09-16T07:58:13.071467+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:13.071467+0000","last_undegraded":"2024-09-16T07:58:13.071467+0000","last_fullsized":"2024-09-16T07:58:13.071467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":352,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.093504+0000","last_change":"2024-09-16T07:58:32.093504+0000","last_active":"2024-09-16T07:58:32.093504+0000","last_peered":"2024-09-16T07:58:13.071163+0000","last_clean":"2024-09-16T07:58:13.071163+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:58:32.093504+0000","last_undegraded":"2024-09-16T07:58:32.093504+0000","last_fullsized":"2024-09-16T07:58:32.093504+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"137'545","reported_seq":577,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.118586+0000","last_change":"2024-09-16T07:58:32.118586+0000","last_active":"2024-09-16T07:58:32.118586+0000","last_peered":"2024-09-16T07:58:13.067147+0000","last_clean":"2024-09-16T07:58:13.067147+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:32.118586+0000","last_undegraded":"2024-09-16T07:58:32.118586+0000","last_fullsized":"2024-09-16T07:58:32.118586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069861+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:58:13.069861+0000","last_peered":"2024-09-16T07:58:13.069861+0000","last_clean":"2024-09-16T07:58:13.069861+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:58:13.069861+0000","last_undegraded":"2024-09-16T07:58:13.069861+0000","last_fullsized":"2024-09-16T07:58:13.069861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"137'528","reported_seq":560,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.123332+0000","last_change":"2024-09-16T07:58:32.123332+0000","last_active":"2024-09-16T07:58:32.123332+0000","last_peered":"2024-09-16T07:58:13.073897+0000","last_clean":"2024-09-16T07:58:13.073897+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:32.123332+0000","last_undegraded":"2024-09-16T07:58:32.123332+0000","last_fullsized":"2024-09-16T07:58:32.123332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":359,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.143353+0000","last_change":"2024-09-16T07:58:35.147645+0000","last_active":"2024-09-16T07:58:35.143353+0000","last_peered":"2024-09-16T07:58:35.143353+0000","last_clean":"2024-09-16T07:58:35.143353+0000","last_became_active":"2024-09-16T07:58:34.254789+0000","last_became_peered":"2024-09-16T07:58:34.254789+0000","last_unstale":"2024-09-16T07:58:35.143353+0000","last_undegraded":"2024-09-16T07:58:35.143353+0000","last_fullsized":"2024-09-16T07:58:35.143353+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":607977472,"num_objects":9277,"num_object_clones":0,"num_object_copies":27831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9277,"num_write_kb":593728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":108158976,"data_stored":1730543616,"data_compressed":82172141,"data_compressed_allocated":108158976,"data_compressed_original":1730543616,"omap_allocated":0,"internal_metadata":0},"log_size":9277,"ondisk_log_size":9277,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86060,"kb_used_data":34204,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94285780,"statfs":{"total":96636764160,"available":96548638720,"internally_reserved":0,"allocated":35024896,"data_stored":541930791,"data_compressed":25712339,"data_compressed_allocated":33845248,"data_compressed_original":541442048,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500792,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50372,"kb_used_data":21236,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94321468,"statfs":{"total":96636764160,"available":96585183232,"internally_reserved":0,"allocated":21745664,"data_stored":329524946,"data_compressed":15626743,"data_compressed_allocated":20570112,"data_compressed_original":329039872,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075638,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66800,"kb_used_data":37984,"kb_used_omap":0,"kb_used_meta":28800,"kb_avail":94305040,"statfs":{"total":96636764160,"available":96568360960,"internally_reserved":0,"allocated":38895616,"data_stored":603806828,"data_compressed":28648179,"data_compressed_allocated":37707776,"data_compressed_original":603324416,"omap_allocated":0,"internal_metadata":29491200},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38105088,"data_stored":609681408,"data_compressed":28950043,"data_compressed_allocated":38105088,"data_compressed_original":609681408,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20529152,"data_stored":328466432,"data_compressed":15596702,"data_compressed_allocated":20529152,"data_compressed_original":328466432,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33804288,"data_stored":540868608,"data_compressed":25682298,"data_compressed_allocated":33804288,"data_compressed_original":540868608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:58:51.632 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 89 16 11786 11770 8.2646 11.5625 0.0958879 0.120942 2024-09-16T07:58:52.398 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:58:52.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:52.552+0000 7f6e50f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:52.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:52.564+0000 7f6e50f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:52.632 INFO:tasks.radosbench.radosbench.0.smithi003.stdout: 90 15 11963 11948 8.29637 11.125 0.0986672 0.120464 2024-09-16T07:58:53.632 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Total time run: 90.0523 2024-09-16T07:58:53.633 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Total writes made: 11963 2024-09-16T07:58:53.633 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Write size: 65536 2024-09-16T07:58:53.633 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Object size: 65536 2024-09-16T07:58:53.633 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Bandwidth (MB/sec): 8.30281 2024-09-16T07:58:53.633 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev Bandwidth: 5.0961 2024-09-16T07:58:53.634 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max bandwidth (MB/sec): 12.8125 2024-09-16T07:58:53.634 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min bandwidth (MB/sec): 0 2024-09-16T07:58:53.634 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Average IOPS: 132 2024-09-16T07:58:53.634 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev IOPS: 81.5376 2024-09-16T07:58:53.634 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max IOPS: 205 2024-09-16T07:58:53.635 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min IOPS: 0 2024-09-16T07:58:53.635 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Average Latency(s): 0.120409 2024-09-16T07:58:53.635 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Stddev Latency(s): 0.882541 2024-09-16T07:58:53.635 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Max latency(s): 24.3438 2024-09-16T07:58:53.635 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Min latency(s): 0.0156257 2024-09-16T07:58:53.662 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T07:58:53.893 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:54.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:54.043+0000 7f4671ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:54.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:54.056+0000 7f4671ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:54.428 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:54.428 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:58:54.451 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":548,"stamp":"2024-09-16T07:58:52.470170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":608567848,"num_objects":9281,"num_object_clones":0,"num_object_copies":27843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9357,"num_write_kb":594835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9332,"ondisk_log_size":9332,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248344,"kb_used_data":109848,"kb_used_omap":0,"kb_used_meta":138432,"kb_avail":377239016,"statfs":{"total":386547056640,"available":386292752384,"internally_reserved":0,"allocated":112484352,"data_stored":1726714339,"data_compressed":81907496,"data_compressed_allocated":107814912,"data_compressed_original":1724792832,"omap_allocated":0,"internal_metadata":141754368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":44367872,"num_objects":677,"num_object_clones":0,"num_object_copies":2031,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":43328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002604"},"pg_stats":[{"pgid":"7.f","version":"137'557","reported_seq":590,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.117773+0000","last_change":"2024-09-16T07:58:32.124703+0000","last_active":"2024-09-16T07:58:32.124703+0000","last_peered":"2024-09-16T07:58:13.076723+0000","last_clean":"2024-09-16T07:58:13.076723+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:33.117773+0000","last_undegraded":"2024-09-16T07:58:33.117773+0000","last_fullsized":"2024-09-16T07:58:33.117773+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"142'733","reported_seq":776,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.944012+0000","last_change":"2024-09-16T07:58:34.224845+0000","last_active":"2024-09-16T07:58:49.944012+0000","last_peered":"2024-09-16T07:58:49.944012+0000","last_clean":"2024-09-16T07:58:49.944012+0000","last_became_active":"2024-09-16T07:58:34.204525+0000","last_became_peered":"2024-09-16T07:58:34.204525+0000","last_unstale":"2024-09-16T07:58:49.944012+0000","last_undegraded":"2024-09-16T07:58:49.944012+0000","last_fullsized":"2024-09-16T07:58:49.944012+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.066949+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:13.066949+0000","last_peered":"2024-09-16T07:58:13.066949+0000","last_clean":"2024-09-16T07:58:13.066949+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:13.066949+0000","last_undegraded":"2024-09-16T07:58:13.066949+0000","last_fullsized":"2024-09-16T07:58:13.066949+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"137'533","reported_seq":563,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.072390+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:13.072390+0000","last_peered":"2024-09-16T07:58:13.072390+0000","last_clean":"2024-09-16T07:58:13.072390+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:13.072390+0000","last_undegraded":"2024-09-16T07:58:13.072390+0000","last_fullsized":"2024-09-16T07:58:13.072390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"137'508","reported_seq":541,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.116150+0000","last_change":"2024-09-16T07:58:32.142013+0000","last_active":"2024-09-16T07:58:32.142013+0000","last_peered":"2024-09-16T07:58:13.076585+0000","last_clean":"2024-09-16T07:58:13.076585+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:33.116150+0000","last_undegraded":"2024-09-16T07:58:33.116150+0000","last_fullsized":"2024-09-16T07:58:33.116150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"137'554","reported_seq":586,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.106969+0000","last_change":"2024-09-16T07:58:32.106969+0000","last_active":"2024-09-16T07:58:32.106969+0000","last_peered":"2024-09-16T07:58:13.070933+0000","last_clean":"2024-09-16T07:58:13.070933+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:32.106969+0000","last_undegraded":"2024-09-16T07:58:32.106969+0000","last_fullsized":"2024-09-16T07:58:32.106969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"137'603","reported_seq":633,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073722+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:13.073722+0000","last_peered":"2024-09-16T07:58:13.073722+0000","last_clean":"2024-09-16T07:58:13.073722+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:13.073722+0000","last_undegraded":"2024-09-16T07:58:13.073722+0000","last_fullsized":"2024-09-16T07:58:13.073722+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"142'704","reported_seq":754,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:50.032986+0000","last_change":"2024-09-16T07:58:34.626925+0000","last_active":"2024-09-16T07:58:50.032986+0000","last_peered":"2024-09-16T07:58:50.032986+0000","last_clean":"2024-09-16T07:58:50.032986+0000","last_became_active":"2024-09-16T07:58:34.283717+0000","last_became_peered":"2024-09-16T07:58:34.283717+0000","last_unstale":"2024-09-16T07:58:50.032986+0000","last_undegraded":"2024-09-16T07:58:50.032986+0000","last_fullsized":"2024-09-16T07:58:50.032986+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":704,"num_object_clones":0,"num_object_copies":2112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"137'576","reported_seq":608,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.132254+0000","last_change":"2024-09-16T07:58:32.132254+0000","last_active":"2024-09-16T07:58:32.132254+0000","last_peered":"2024-09-16T07:58:13.074775+0000","last_clean":"2024-09-16T07:58:13.074775+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:32.132254+0000","last_undegraded":"2024-09-16T07:58:32.132254+0000","last_fullsized":"2024-09-16T07:58:32.132254+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":417,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.095446+0000","last_change":"2024-09-16T07:58:32.095446+0000","last_active":"2024-09-16T07:58:32.095446+0000","last_peered":"2024-09-16T07:58:13.070190+0000","last_clean":"2024-09-16T07:58:13.070190+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:58:32.095446+0000","last_undegraded":"2024-09-16T07:58:32.095446+0000","last_fullsized":"2024-09-16T07:58:32.095446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":364,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.140808+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:35.140808+0000","last_peered":"2024-09-16T07:58:35.140808+0000","last_clean":"2024-09-16T07:58:35.140808+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:35.140808+0000","last_undegraded":"2024-09-16T07:58:35.140808+0000","last_fullsized":"2024-09-16T07:58:35.140808+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"142'721","reported_seq":763,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.889219+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:49.889219+0000","last_peered":"2024-09-16T07:58:49.889219+0000","last_clean":"2024-09-16T07:58:49.889219+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:49.889219+0000","last_undegraded":"2024-09-16T07:58:49.889219+0000","last_fullsized":"2024-09-16T07:58:49.889219+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:58:32.069085+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"137'597","reported_seq":627,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071646+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:58:13.071646+0000","last_peered":"2024-09-16T07:58:13.071646+0000","last_clean":"2024-09-16T07:58:13.071646+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:58:13.071646+0000","last_undegraded":"2024-09-16T07:58:13.071646+0000","last_fullsized":"2024-09-16T07:58:13.071646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":345,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.147860+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:35.147860+0000","last_peered":"2024-09-16T07:58:35.147860+0000","last_clean":"2024-09-16T07:58:35.147860+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:35.147860+0000","last_undegraded":"2024-09-16T07:58:35.147860+0000","last_fullsized":"2024-09-16T07:58:35.147860+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"142'717","reported_seq":773,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.741569+0000","last_change":"2024-09-16T07:58:34.475137+0000","last_active":"2024-09-16T07:58:49.741569+0000","last_peered":"2024-09-16T07:58:49.741569+0000","last_clean":"2024-09-16T07:58:49.741569+0000","last_became_active":"2024-09-16T07:58:34.211141+0000","last_became_peered":"2024-09-16T07:58:34.211141+0000","last_unstale":"2024-09-16T07:58:49.741569+0000","last_undegraded":"2024-09-16T07:58:49.741569+0000","last_fullsized":"2024-09-16T07:58:49.741569+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46989312,"num_objects":717,"num_object_clones":0,"num_object_copies":2151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":45888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:58:32.069088+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:58:32.069090+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067638+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:58:13.067638+0000","last_peered":"2024-09-16T07:58:13.067638+0000","last_clean":"2024-09-16T07:58:13.067638+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:58:13.067638+0000","last_undegraded":"2024-09-16T07:58:13.067638+0000","last_fullsized":"2024-09-16T07:58:13.067638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"137'529","reported_seq":559,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071467+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:13.071467+0000","last_peered":"2024-09-16T07:58:13.071467+0000","last_clean":"2024-09-16T07:58:13.071467+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:13.071467+0000","last_undegraded":"2024-09-16T07:58:13.071467+0000","last_fullsized":"2024-09-16T07:58:13.071467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":352,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.093504+0000","last_change":"2024-09-16T07:58:32.093504+0000","last_active":"2024-09-16T07:58:32.093504+0000","last_peered":"2024-09-16T07:58:13.071163+0000","last_clean":"2024-09-16T07:58:13.071163+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:58:32.093504+0000","last_undegraded":"2024-09-16T07:58:32.093504+0000","last_fullsized":"2024-09-16T07:58:32.093504+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"137'545","reported_seq":577,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.118586+0000","last_change":"2024-09-16T07:58:32.118586+0000","last_active":"2024-09-16T07:58:32.118586+0000","last_peered":"2024-09-16T07:58:13.067147+0000","last_clean":"2024-09-16T07:58:13.067147+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:32.118586+0000","last_undegraded":"2024-09-16T07:58:32.118586+0000","last_fullsized":"2024-09-16T07:58:32.118586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069861+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:58:13.069861+0000","last_peered":"2024-09-16T07:58:13.069861+0000","last_clean":"2024-09-16T07:58:13.069861+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:58:13.069861+0000","last_undegraded":"2024-09-16T07:58:13.069861+0000","last_fullsized":"2024-09-16T07:58:13.069861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"137'528","reported_seq":560,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.123332+0000","last_change":"2024-09-16T07:58:32.123332+0000","last_active":"2024-09-16T07:58:32.123332+0000","last_peered":"2024-09-16T07:58:13.073897+0000","last_clean":"2024-09-16T07:58:13.073897+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:32.123332+0000","last_undegraded":"2024-09-16T07:58:32.123332+0000","last_fullsized":"2024-09-16T07:58:32.123332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":359,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.143353+0000","last_change":"2024-09-16T07:58:35.147645+0000","last_active":"2024-09-16T07:58:35.143353+0000","last_peered":"2024-09-16T07:58:35.143353+0000","last_clean":"2024-09-16T07:58:35.143353+0000","last_became_active":"2024-09-16T07:58:34.254789+0000","last_became_peered":"2024-09-16T07:58:34.254789+0000","last_unstale":"2024-09-16T07:58:35.143353+0000","last_undegraded":"2024-09-16T07:58:35.143353+0000","last_fullsized":"2024-09-16T07:58:35.143353+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":607977472,"num_objects":9277,"num_object_clones":0,"num_object_copies":27831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9277,"num_write_kb":593728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":108158976,"data_stored":1730543616,"data_compressed":82172141,"data_compressed_allocated":108158976,"data_compressed_original":1730543616,"omap_allocated":0,"internal_metadata":0},"log_size":9277,"ondisk_log_size":9277,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86060,"kb_used_data":34204,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94285780,"statfs":{"total":96636764160,"available":96548638720,"internally_reserved":0,"allocated":35024896,"data_stored":541930791,"data_compressed":25712339,"data_compressed_allocated":33845248,"data_compressed_original":541442048,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500792,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50372,"kb_used_data":21236,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94321468,"statfs":{"total":96636764160,"available":96585183232,"internally_reserved":0,"allocated":21745664,"data_stored":329524946,"data_compressed":15626743,"data_compressed_allocated":20570112,"data_compressed_original":329039872,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075638,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66800,"kb_used_data":37984,"kb_used_omap":0,"kb_used_meta":28800,"kb_avail":94305040,"statfs":{"total":96636764160,"available":96568360960,"internally_reserved":0,"allocated":38895616,"data_stored":603806828,"data_compressed":28648179,"data_compressed_allocated":37707776,"data_compressed_original":603324416,"omap_allocated":0,"internal_metadata":29491200},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38105088,"data_stored":609681408,"data_compressed":28950043,"data_compressed_allocated":38105088,"data_compressed_original":609681408,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20529152,"data_stored":328466432,"data_compressed":15596702,"data_compressed_allocated":20529152,"data_compressed_original":328466432,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33804288,"data_stored":540868608,"data_compressed":25682298,"data_compressed_allocated":33804288,"data_compressed_original":540868608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:58:54.453 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:58:54.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:54.620+0000 7fc2a3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:54.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:54.630+0000 7fc2a3591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:54.727 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:58:54.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:54.888+0000 7fa89d151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:54.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:54.896+0000 7fa89d151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:55.158 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:55.158 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":837,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":142,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473513,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":14},{"state_name":"peering","count":8},{"state_name":"stale+active+clean","count":3}],"num_pgs":25,"num_pools":3,"num_objects":9281,"data_bytes":608567848,"bytes_used":254304256,"bytes_avail":386292752384,"bytes_total":386547056640,"inactive_pgs_ratio":0.31999999284744263,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":38221,"recovering_keys_per_sec":0,"num_objects_recovered":7,"num_bytes_recovered":458752,"num_keys_recovered":0,"write_bytes_sec":3696544,"read_op_per_sec":0,"write_op_per_sec":56},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:58:55.180 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:58:55.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:55.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:55.374+0000 7fca55ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:55.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:55.385+0000 7fca55ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:55.694 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:55.695 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:58:55.715 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":549,"stamp":"2024-09-16T07:58:54.470515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":608567848,"num_objects":9281,"num_object_clones":0,"num_object_copies":27843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9357,"num_write_kb":594835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9332,"ondisk_log_size":9332,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248344,"kb_used_data":109848,"kb_used_omap":0,"kb_used_meta":138432,"kb_avail":377239016,"statfs":{"total":386547056640,"available":386292752384,"internally_reserved":0,"allocated":112484352,"data_stored":1726714339,"data_compressed":81907496,"data_compressed_allocated":107814912,"data_compressed_original":1724792832,"omap_allocated":0,"internal_metadata":141754368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":44367872,"num_objects":677,"num_object_clones":0,"num_object_copies":2031,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":43328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002526"},"pg_stats":[{"pgid":"7.f","version":"137'557","reported_seq":590,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.117773+0000","last_change":"2024-09-16T07:58:32.124703+0000","last_active":"2024-09-16T07:58:32.124703+0000","last_peered":"2024-09-16T07:58:13.076723+0000","last_clean":"2024-09-16T07:58:13.076723+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:33.117773+0000","last_undegraded":"2024-09-16T07:58:33.117773+0000","last_fullsized":"2024-09-16T07:58:33.117773+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"142'733","reported_seq":776,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.944012+0000","last_change":"2024-09-16T07:58:34.224845+0000","last_active":"2024-09-16T07:58:49.944012+0000","last_peered":"2024-09-16T07:58:49.944012+0000","last_clean":"2024-09-16T07:58:49.944012+0000","last_became_active":"2024-09-16T07:58:34.204525+0000","last_became_peered":"2024-09-16T07:58:34.204525+0000","last_unstale":"2024-09-16T07:58:49.944012+0000","last_undegraded":"2024-09-16T07:58:49.944012+0000","last_fullsized":"2024-09-16T07:58:49.944012+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.066949+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:13.066949+0000","last_peered":"2024-09-16T07:58:13.066949+0000","last_clean":"2024-09-16T07:58:13.066949+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:13.066949+0000","last_undegraded":"2024-09-16T07:58:13.066949+0000","last_fullsized":"2024-09-16T07:58:13.066949+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"137'533","reported_seq":563,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.072390+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:13.072390+0000","last_peered":"2024-09-16T07:58:13.072390+0000","last_clean":"2024-09-16T07:58:13.072390+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:13.072390+0000","last_undegraded":"2024-09-16T07:58:13.072390+0000","last_fullsized":"2024-09-16T07:58:13.072390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"137'508","reported_seq":541,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.116150+0000","last_change":"2024-09-16T07:58:32.142013+0000","last_active":"2024-09-16T07:58:32.142013+0000","last_peered":"2024-09-16T07:58:13.076585+0000","last_clean":"2024-09-16T07:58:13.076585+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:33.116150+0000","last_undegraded":"2024-09-16T07:58:33.116150+0000","last_fullsized":"2024-09-16T07:58:33.116150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"137'554","reported_seq":586,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.106969+0000","last_change":"2024-09-16T07:58:32.106969+0000","last_active":"2024-09-16T07:58:32.106969+0000","last_peered":"2024-09-16T07:58:13.070933+0000","last_clean":"2024-09-16T07:58:13.070933+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:32.106969+0000","last_undegraded":"2024-09-16T07:58:32.106969+0000","last_fullsized":"2024-09-16T07:58:32.106969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"137'603","reported_seq":633,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073722+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:13.073722+0000","last_peered":"2024-09-16T07:58:13.073722+0000","last_clean":"2024-09-16T07:58:13.073722+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:13.073722+0000","last_undegraded":"2024-09-16T07:58:13.073722+0000","last_fullsized":"2024-09-16T07:58:13.073722+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"142'704","reported_seq":754,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:50.032986+0000","last_change":"2024-09-16T07:58:34.626925+0000","last_active":"2024-09-16T07:58:50.032986+0000","last_peered":"2024-09-16T07:58:50.032986+0000","last_clean":"2024-09-16T07:58:50.032986+0000","last_became_active":"2024-09-16T07:58:34.283717+0000","last_became_peered":"2024-09-16T07:58:34.283717+0000","last_unstale":"2024-09-16T07:58:50.032986+0000","last_undegraded":"2024-09-16T07:58:50.032986+0000","last_fullsized":"2024-09-16T07:58:50.032986+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":704,"num_object_clones":0,"num_object_copies":2112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"137'576","reported_seq":608,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.132254+0000","last_change":"2024-09-16T07:58:32.132254+0000","last_active":"2024-09-16T07:58:32.132254+0000","last_peered":"2024-09-16T07:58:13.074775+0000","last_clean":"2024-09-16T07:58:13.074775+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:32.132254+0000","last_undegraded":"2024-09-16T07:58:32.132254+0000","last_fullsized":"2024-09-16T07:58:32.132254+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":417,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.095446+0000","last_change":"2024-09-16T07:58:32.095446+0000","last_active":"2024-09-16T07:58:32.095446+0000","last_peered":"2024-09-16T07:58:13.070190+0000","last_clean":"2024-09-16T07:58:13.070190+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:58:32.095446+0000","last_undegraded":"2024-09-16T07:58:32.095446+0000","last_fullsized":"2024-09-16T07:58:32.095446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":364,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.140808+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:35.140808+0000","last_peered":"2024-09-16T07:58:35.140808+0000","last_clean":"2024-09-16T07:58:35.140808+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:35.140808+0000","last_undegraded":"2024-09-16T07:58:35.140808+0000","last_fullsized":"2024-09-16T07:58:35.140808+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"142'721","reported_seq":763,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.889219+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:49.889219+0000","last_peered":"2024-09-16T07:58:49.889219+0000","last_clean":"2024-09-16T07:58:49.889219+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:49.889219+0000","last_undegraded":"2024-09-16T07:58:49.889219+0000","last_fullsized":"2024-09-16T07:58:49.889219+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:58:32.069085+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"137'597","reported_seq":627,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071646+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:58:13.071646+0000","last_peered":"2024-09-16T07:58:13.071646+0000","last_clean":"2024-09-16T07:58:13.071646+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:58:13.071646+0000","last_undegraded":"2024-09-16T07:58:13.071646+0000","last_fullsized":"2024-09-16T07:58:13.071646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":345,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.147860+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:35.147860+0000","last_peered":"2024-09-16T07:58:35.147860+0000","last_clean":"2024-09-16T07:58:35.147860+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:35.147860+0000","last_undegraded":"2024-09-16T07:58:35.147860+0000","last_fullsized":"2024-09-16T07:58:35.147860+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"142'717","reported_seq":773,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.741569+0000","last_change":"2024-09-16T07:58:34.475137+0000","last_active":"2024-09-16T07:58:49.741569+0000","last_peered":"2024-09-16T07:58:49.741569+0000","last_clean":"2024-09-16T07:58:49.741569+0000","last_became_active":"2024-09-16T07:58:34.211141+0000","last_became_peered":"2024-09-16T07:58:34.211141+0000","last_unstale":"2024-09-16T07:58:49.741569+0000","last_undegraded":"2024-09-16T07:58:49.741569+0000","last_fullsized":"2024-09-16T07:58:49.741569+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46989312,"num_objects":717,"num_object_clones":0,"num_object_copies":2151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":45888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:58:32.069088+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:58:32.069090+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067638+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:58:13.067638+0000","last_peered":"2024-09-16T07:58:13.067638+0000","last_clean":"2024-09-16T07:58:13.067638+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:58:13.067638+0000","last_undegraded":"2024-09-16T07:58:13.067638+0000","last_fullsized":"2024-09-16T07:58:13.067638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"137'529","reported_seq":559,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071467+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:13.071467+0000","last_peered":"2024-09-16T07:58:13.071467+0000","last_clean":"2024-09-16T07:58:13.071467+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:13.071467+0000","last_undegraded":"2024-09-16T07:58:13.071467+0000","last_fullsized":"2024-09-16T07:58:13.071467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":352,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.093504+0000","last_change":"2024-09-16T07:58:32.093504+0000","last_active":"2024-09-16T07:58:32.093504+0000","last_peered":"2024-09-16T07:58:13.071163+0000","last_clean":"2024-09-16T07:58:13.071163+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:58:32.093504+0000","last_undegraded":"2024-09-16T07:58:32.093504+0000","last_fullsized":"2024-09-16T07:58:32.093504+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"137'545","reported_seq":577,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.118586+0000","last_change":"2024-09-16T07:58:32.118586+0000","last_active":"2024-09-16T07:58:32.118586+0000","last_peered":"2024-09-16T07:58:13.067147+0000","last_clean":"2024-09-16T07:58:13.067147+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:32.118586+0000","last_undegraded":"2024-09-16T07:58:32.118586+0000","last_fullsized":"2024-09-16T07:58:32.118586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069861+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:58:13.069861+0000","last_peered":"2024-09-16T07:58:13.069861+0000","last_clean":"2024-09-16T07:58:13.069861+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:58:13.069861+0000","last_undegraded":"2024-09-16T07:58:13.069861+0000","last_fullsized":"2024-09-16T07:58:13.069861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"137'528","reported_seq":560,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.123332+0000","last_change":"2024-09-16T07:58:32.123332+0000","last_active":"2024-09-16T07:58:32.123332+0000","last_peered":"2024-09-16T07:58:13.073897+0000","last_clean":"2024-09-16T07:58:13.073897+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:32.123332+0000","last_undegraded":"2024-09-16T07:58:32.123332+0000","last_fullsized":"2024-09-16T07:58:32.123332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":359,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.143353+0000","last_change":"2024-09-16T07:58:35.147645+0000","last_active":"2024-09-16T07:58:35.143353+0000","last_peered":"2024-09-16T07:58:35.143353+0000","last_clean":"2024-09-16T07:58:35.143353+0000","last_became_active":"2024-09-16T07:58:34.254789+0000","last_became_peered":"2024-09-16T07:58:34.254789+0000","last_unstale":"2024-09-16T07:58:35.143353+0000","last_undegraded":"2024-09-16T07:58:35.143353+0000","last_fullsized":"2024-09-16T07:58:35.143353+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":607977472,"num_objects":9277,"num_object_clones":0,"num_object_copies":27831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9277,"num_write_kb":593728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":108158976,"data_stored":1730543616,"data_compressed":82172141,"data_compressed_allocated":108158976,"data_compressed_original":1730543616,"omap_allocated":0,"internal_metadata":0},"log_size":9277,"ondisk_log_size":9277,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86060,"kb_used_data":34204,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94285780,"statfs":{"total":96636764160,"available":96548638720,"internally_reserved":0,"allocated":35024896,"data_stored":541930791,"data_compressed":25712339,"data_compressed_allocated":33845248,"data_compressed_original":541442048,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500792,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50372,"kb_used_data":21236,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94321468,"statfs":{"total":96636764160,"available":96585183232,"internally_reserved":0,"allocated":21745664,"data_stored":329524946,"data_compressed":15626743,"data_compressed_allocated":20570112,"data_compressed_original":329039872,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075638,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66800,"kb_used_data":37984,"kb_used_omap":0,"kb_used_meta":28800,"kb_avail":94305040,"statfs":{"total":96636764160,"available":96568360960,"internally_reserved":0,"allocated":38895616,"data_stored":603806828,"data_compressed":28648179,"data_compressed_allocated":37707776,"data_compressed_original":603324416,"omap_allocated":0,"internal_metadata":29491200},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38105088,"data_stored":609681408,"data_compressed":28950043,"data_compressed_allocated":38105088,"data_compressed_original":609681408,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20529152,"data_stored":328466432,"data_compressed":15596702,"data_compressed_allocated":20529152,"data_compressed_original":328466432,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33804288,"data_stored":540868608,"data_compressed":25682298,"data_compressed_allocated":33804288,"data_compressed_original":540868608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:58:57.178 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:58:57.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:57.333+0000 7fd2cf423640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:57.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:57.342+0000 7fd2cf423640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:58.717 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:58.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:58.867+0000 7f9579d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:58.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:58.879+0000 7f9579d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:59.216 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:59.217 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:58:59.237 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":551,"stamp":"2024-09-16T07:58:58.471296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":608567848,"num_objects":9281,"num_object_clones":0,"num_object_copies":27843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9357,"num_write_kb":594835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9332,"ondisk_log_size":9332,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248344,"kb_used_data":109848,"kb_used_omap":0,"kb_used_meta":138432,"kb_avail":377239016,"statfs":{"total":386547056640,"available":386292752384,"internally_reserved":0,"allocated":112484352,"data_stored":1726714339,"data_compressed":81907496,"data_compressed_allocated":107814912,"data_compressed_original":1724792832,"omap_allocated":0,"internal_metadata":141754368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":44367872,"num_objects":677,"num_object_clones":0,"num_object_copies":2031,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":43328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002454"},"pg_stats":[{"pgid":"7.f","version":"137'557","reported_seq":590,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.117773+0000","last_change":"2024-09-16T07:58:32.124703+0000","last_active":"2024-09-16T07:58:32.124703+0000","last_peered":"2024-09-16T07:58:13.076723+0000","last_clean":"2024-09-16T07:58:13.076723+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:33.117773+0000","last_undegraded":"2024-09-16T07:58:33.117773+0000","last_fullsized":"2024-09-16T07:58:33.117773+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"142'733","reported_seq":776,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.944012+0000","last_change":"2024-09-16T07:58:34.224845+0000","last_active":"2024-09-16T07:58:49.944012+0000","last_peered":"2024-09-16T07:58:49.944012+0000","last_clean":"2024-09-16T07:58:49.944012+0000","last_became_active":"2024-09-16T07:58:34.204525+0000","last_became_peered":"2024-09-16T07:58:34.204525+0000","last_unstale":"2024-09-16T07:58:49.944012+0000","last_undegraded":"2024-09-16T07:58:49.944012+0000","last_fullsized":"2024-09-16T07:58:49.944012+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.066949+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:13.066949+0000","last_peered":"2024-09-16T07:58:13.066949+0000","last_clean":"2024-09-16T07:58:13.066949+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:13.066949+0000","last_undegraded":"2024-09-16T07:58:13.066949+0000","last_fullsized":"2024-09-16T07:58:13.066949+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"137'533","reported_seq":563,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.072390+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:13.072390+0000","last_peered":"2024-09-16T07:58:13.072390+0000","last_clean":"2024-09-16T07:58:13.072390+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:13.072390+0000","last_undegraded":"2024-09-16T07:58:13.072390+0000","last_fullsized":"2024-09-16T07:58:13.072390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"137'508","reported_seq":541,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.116150+0000","last_change":"2024-09-16T07:58:32.142013+0000","last_active":"2024-09-16T07:58:32.142013+0000","last_peered":"2024-09-16T07:58:13.076585+0000","last_clean":"2024-09-16T07:58:13.076585+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:33.116150+0000","last_undegraded":"2024-09-16T07:58:33.116150+0000","last_fullsized":"2024-09-16T07:58:33.116150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"137'554","reported_seq":586,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.106969+0000","last_change":"2024-09-16T07:58:32.106969+0000","last_active":"2024-09-16T07:58:32.106969+0000","last_peered":"2024-09-16T07:58:13.070933+0000","last_clean":"2024-09-16T07:58:13.070933+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:32.106969+0000","last_undegraded":"2024-09-16T07:58:32.106969+0000","last_fullsized":"2024-09-16T07:58:32.106969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"137'603","reported_seq":633,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073722+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:13.073722+0000","last_peered":"2024-09-16T07:58:13.073722+0000","last_clean":"2024-09-16T07:58:13.073722+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:13.073722+0000","last_undegraded":"2024-09-16T07:58:13.073722+0000","last_fullsized":"2024-09-16T07:58:13.073722+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"142'704","reported_seq":754,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:50.032986+0000","last_change":"2024-09-16T07:58:34.626925+0000","last_active":"2024-09-16T07:58:50.032986+0000","last_peered":"2024-09-16T07:58:50.032986+0000","last_clean":"2024-09-16T07:58:50.032986+0000","last_became_active":"2024-09-16T07:58:34.283717+0000","last_became_peered":"2024-09-16T07:58:34.283717+0000","last_unstale":"2024-09-16T07:58:50.032986+0000","last_undegraded":"2024-09-16T07:58:50.032986+0000","last_fullsized":"2024-09-16T07:58:50.032986+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":704,"num_object_clones":0,"num_object_copies":2112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"137'576","reported_seq":608,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.132254+0000","last_change":"2024-09-16T07:58:32.132254+0000","last_active":"2024-09-16T07:58:32.132254+0000","last_peered":"2024-09-16T07:58:13.074775+0000","last_clean":"2024-09-16T07:58:13.074775+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:32.132254+0000","last_undegraded":"2024-09-16T07:58:32.132254+0000","last_fullsized":"2024-09-16T07:58:32.132254+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":417,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.095446+0000","last_change":"2024-09-16T07:58:32.095446+0000","last_active":"2024-09-16T07:58:32.095446+0000","last_peered":"2024-09-16T07:58:13.070190+0000","last_clean":"2024-09-16T07:58:13.070190+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:58:32.095446+0000","last_undegraded":"2024-09-16T07:58:32.095446+0000","last_fullsized":"2024-09-16T07:58:32.095446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":364,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.140808+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:35.140808+0000","last_peered":"2024-09-16T07:58:35.140808+0000","last_clean":"2024-09-16T07:58:35.140808+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:35.140808+0000","last_undegraded":"2024-09-16T07:58:35.140808+0000","last_fullsized":"2024-09-16T07:58:35.140808+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"142'721","reported_seq":763,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.889219+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:49.889219+0000","last_peered":"2024-09-16T07:58:49.889219+0000","last_clean":"2024-09-16T07:58:49.889219+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:49.889219+0000","last_undegraded":"2024-09-16T07:58:49.889219+0000","last_fullsized":"2024-09-16T07:58:49.889219+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:58:32.069085+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"137'597","reported_seq":627,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071646+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:58:13.071646+0000","last_peered":"2024-09-16T07:58:13.071646+0000","last_clean":"2024-09-16T07:58:13.071646+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:58:13.071646+0000","last_undegraded":"2024-09-16T07:58:13.071646+0000","last_fullsized":"2024-09-16T07:58:13.071646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":345,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.147860+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:35.147860+0000","last_peered":"2024-09-16T07:58:35.147860+0000","last_clean":"2024-09-16T07:58:35.147860+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:35.147860+0000","last_undegraded":"2024-09-16T07:58:35.147860+0000","last_fullsized":"2024-09-16T07:58:35.147860+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"142'717","reported_seq":773,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.741569+0000","last_change":"2024-09-16T07:58:34.475137+0000","last_active":"2024-09-16T07:58:49.741569+0000","last_peered":"2024-09-16T07:58:49.741569+0000","last_clean":"2024-09-16T07:58:49.741569+0000","last_became_active":"2024-09-16T07:58:34.211141+0000","last_became_peered":"2024-09-16T07:58:34.211141+0000","last_unstale":"2024-09-16T07:58:49.741569+0000","last_undegraded":"2024-09-16T07:58:49.741569+0000","last_fullsized":"2024-09-16T07:58:49.741569+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46989312,"num_objects":717,"num_object_clones":0,"num_object_copies":2151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":45888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:58:32.069088+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:58:32.069090+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067638+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:58:13.067638+0000","last_peered":"2024-09-16T07:58:13.067638+0000","last_clean":"2024-09-16T07:58:13.067638+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:58:13.067638+0000","last_undegraded":"2024-09-16T07:58:13.067638+0000","last_fullsized":"2024-09-16T07:58:13.067638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"137'529","reported_seq":559,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071467+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:13.071467+0000","last_peered":"2024-09-16T07:58:13.071467+0000","last_clean":"2024-09-16T07:58:13.071467+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:13.071467+0000","last_undegraded":"2024-09-16T07:58:13.071467+0000","last_fullsized":"2024-09-16T07:58:13.071467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":352,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.093504+0000","last_change":"2024-09-16T07:58:32.093504+0000","last_active":"2024-09-16T07:58:32.093504+0000","last_peered":"2024-09-16T07:58:13.071163+0000","last_clean":"2024-09-16T07:58:13.071163+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:58:32.093504+0000","last_undegraded":"2024-09-16T07:58:32.093504+0000","last_fullsized":"2024-09-16T07:58:32.093504+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"137'545","reported_seq":577,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.118586+0000","last_change":"2024-09-16T07:58:32.118586+0000","last_active":"2024-09-16T07:58:32.118586+0000","last_peered":"2024-09-16T07:58:13.067147+0000","last_clean":"2024-09-16T07:58:13.067147+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:32.118586+0000","last_undegraded":"2024-09-16T07:58:32.118586+0000","last_fullsized":"2024-09-16T07:58:32.118586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069861+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:58:13.069861+0000","last_peered":"2024-09-16T07:58:13.069861+0000","last_clean":"2024-09-16T07:58:13.069861+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:58:13.069861+0000","last_undegraded":"2024-09-16T07:58:13.069861+0000","last_fullsized":"2024-09-16T07:58:13.069861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"137'528","reported_seq":560,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.123332+0000","last_change":"2024-09-16T07:58:32.123332+0000","last_active":"2024-09-16T07:58:32.123332+0000","last_peered":"2024-09-16T07:58:13.073897+0000","last_clean":"2024-09-16T07:58:13.073897+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:32.123332+0000","last_undegraded":"2024-09-16T07:58:32.123332+0000","last_fullsized":"2024-09-16T07:58:32.123332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":359,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.143353+0000","last_change":"2024-09-16T07:58:35.147645+0000","last_active":"2024-09-16T07:58:35.143353+0000","last_peered":"2024-09-16T07:58:35.143353+0000","last_clean":"2024-09-16T07:58:35.143353+0000","last_became_active":"2024-09-16T07:58:34.254789+0000","last_became_peered":"2024-09-16T07:58:34.254789+0000","last_unstale":"2024-09-16T07:58:35.143353+0000","last_undegraded":"2024-09-16T07:58:35.143353+0000","last_fullsized":"2024-09-16T07:58:35.143353+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":607977472,"num_objects":9277,"num_object_clones":0,"num_object_copies":27831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9277,"num_write_kb":593728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":108158976,"data_stored":1730543616,"data_compressed":82172141,"data_compressed_allocated":108158976,"data_compressed_original":1730543616,"omap_allocated":0,"internal_metadata":0},"log_size":9277,"ondisk_log_size":9277,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86060,"kb_used_data":34204,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94285780,"statfs":{"total":96636764160,"available":96548638720,"internally_reserved":0,"allocated":35024896,"data_stored":541930791,"data_compressed":25712339,"data_compressed_allocated":33845248,"data_compressed_original":541442048,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500792,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50372,"kb_used_data":21236,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94321468,"statfs":{"total":96636764160,"available":96585183232,"internally_reserved":0,"allocated":21745664,"data_stored":329524946,"data_compressed":15626743,"data_compressed_allocated":20570112,"data_compressed_original":329039872,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075638,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66800,"kb_used_data":37984,"kb_used_omap":0,"kb_used_meta":28800,"kb_avail":94305040,"statfs":{"total":96636764160,"available":96568360960,"internally_reserved":0,"allocated":38895616,"data_stored":603806828,"data_compressed":28648179,"data_compressed_allocated":37707776,"data_compressed_original":603324416,"omap_allocated":0,"internal_metadata":29491200},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38105088,"data_stored":609681408,"data_compressed":28950043,"data_compressed_allocated":38105088,"data_compressed_original":609681408,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20529152,"data_stored":328466432,"data_compressed":15596702,"data_compressed_allocated":20529152,"data_compressed_original":328466432,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33804288,"data_stored":540868608,"data_compressed":25682298,"data_compressed_allocated":33804288,"data_compressed_original":540868608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:58:59.239 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:58:59.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:59.404+0000 7f3065cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:59.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:59.415+0000 7f3065cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:59.770 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:58:59.852 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:58:59.852 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":841,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":142,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473513,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":14},{"state_name":"peering","count":8},{"state_name":"stale+active+clean","count":3}],"num_pgs":25,"num_pools":3,"num_objects":9281,"data_bytes":608567848,"bytes_used":254304256,"bytes_avail":386292752384,"bytes_total":386547056640,"inactive_pgs_ratio":0.31999999284744263,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":38221,"recovering_keys_per_sec":0,"num_objects_recovered":7,"num_bytes_recovered":458752,"num_keys_recovered":0,"write_bytes_sec":3696566,"read_op_per_sec":0,"write_op_per_sec":56},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:58:59.877 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:58:59.877 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:58:59.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:59.922+0000 7fe291d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:58:59.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:58:59.931+0000 7fe291d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:00.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:00.037+0000 7f5884246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:00.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:00.051+0000 7f5884246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:00.295 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:59:00.295 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:59:00.311 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":551,"stamp":"2024-09-16T07:58:58.471296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":608567848,"num_objects":9281,"num_object_clones":0,"num_object_copies":27843,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9357,"num_write_kb":594835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9332,"ondisk_log_size":9332,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":248344,"kb_used_data":109848,"kb_used_omap":0,"kb_used_meta":138432,"kb_avail":377239016,"statfs":{"total":386547056640,"available":386292752384,"internally_reserved":0,"allocated":112484352,"data_stored":1726714339,"data_compressed":81907496,"data_compressed_allocated":107814912,"data_compressed_original":1724792832,"omap_allocated":0,"internal_metadata":141754368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":44367872,"num_objects":677,"num_object_clones":0,"num_object_copies":2031,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":677,"num_write_kb":43328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002454"},"pg_stats":[{"pgid":"7.f","version":"137'557","reported_seq":590,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.117773+0000","last_change":"2024-09-16T07:58:32.124703+0000","last_active":"2024-09-16T07:58:32.124703+0000","last_peered":"2024-09-16T07:58:13.076723+0000","last_clean":"2024-09-16T07:58:13.076723+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:33.117773+0000","last_undegraded":"2024-09-16T07:58:33.117773+0000","last_fullsized":"2024-09-16T07:58:33.117773+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"142'733","reported_seq":776,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.944012+0000","last_change":"2024-09-16T07:58:34.224845+0000","last_active":"2024-09-16T07:58:49.944012+0000","last_peered":"2024-09-16T07:58:49.944012+0000","last_clean":"2024-09-16T07:58:49.944012+0000","last_became_active":"2024-09-16T07:58:34.204525+0000","last_became_peered":"2024-09-16T07:58:34.204525+0000","last_unstale":"2024-09-16T07:58:49.944012+0000","last_undegraded":"2024-09-16T07:58:49.944012+0000","last_fullsized":"2024-09-16T07:58:49.944012+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"137'549","reported_seq":579,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.066949+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:13.066949+0000","last_peered":"2024-09-16T07:58:13.066949+0000","last_clean":"2024-09-16T07:58:13.066949+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:13.066949+0000","last_undegraded":"2024-09-16T07:58:13.066949+0000","last_fullsized":"2024-09-16T07:58:13.066949+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35979264,"num_objects":549,"num_object_clones":0,"num_object_copies":1647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":35136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"137'533","reported_seq":563,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.072390+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:13.072390+0000","last_peered":"2024-09-16T07:58:13.072390+0000","last_clean":"2024-09-16T07:58:13.072390+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:13.072390+0000","last_undegraded":"2024-09-16T07:58:13.072390+0000","last_fullsized":"2024-09-16T07:58:13.072390+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":533,"num_write_kb":34112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"137'508","reported_seq":541,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.116150+0000","last_change":"2024-09-16T07:58:32.142013+0000","last_active":"2024-09-16T07:58:32.142013+0000","last_peered":"2024-09-16T07:58:13.076585+0000","last_clean":"2024-09-16T07:58:13.076585+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:33.116150+0000","last_undegraded":"2024-09-16T07:58:33.116150+0000","last_fullsized":"2024-09-16T07:58:33.116150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"137'554","reported_seq":586,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.106969+0000","last_change":"2024-09-16T07:58:32.106969+0000","last_active":"2024-09-16T07:58:32.106969+0000","last_peered":"2024-09-16T07:58:13.070933+0000","last_clean":"2024-09-16T07:58:13.070933+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:32.106969+0000","last_undegraded":"2024-09-16T07:58:32.106969+0000","last_fullsized":"2024-09-16T07:58:32.106969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"137'603","reported_seq":633,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.073722+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:13.073722+0000","last_peered":"2024-09-16T07:58:13.073722+0000","last_clean":"2024-09-16T07:58:13.073722+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:13.073722+0000","last_undegraded":"2024-09-16T07:58:13.073722+0000","last_fullsized":"2024-09-16T07:58:13.073722+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39518208,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":38592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"142'704","reported_seq":754,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:50.032986+0000","last_change":"2024-09-16T07:58:34.626925+0000","last_active":"2024-09-16T07:58:50.032986+0000","last_peered":"2024-09-16T07:58:50.032986+0000","last_clean":"2024-09-16T07:58:50.032986+0000","last_became_active":"2024-09-16T07:58:34.283717+0000","last_became_peered":"2024-09-16T07:58:34.283717+0000","last_unstale":"2024-09-16T07:58:50.032986+0000","last_undegraded":"2024-09-16T07:58:50.032986+0000","last_fullsized":"2024-09-16T07:58:50.032986+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":704,"num_object_clones":0,"num_object_copies":2112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"137'576","reported_seq":608,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.132254+0000","last_change":"2024-09-16T07:58:32.132254+0000","last_active":"2024-09-16T07:58:32.132254+0000","last_peered":"2024-09-16T07:58:13.074775+0000","last_clean":"2024-09-16T07:58:13.074775+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:32.132254+0000","last_undegraded":"2024-09-16T07:58:32.132254+0000","last_fullsized":"2024-09-16T07:58:32.132254+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":417,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.095446+0000","last_change":"2024-09-16T07:58:32.095446+0000","last_active":"2024-09-16T07:58:32.095446+0000","last_peered":"2024-09-16T07:58:13.070190+0000","last_clean":"2024-09-16T07:58:13.070190+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:58:32.095446+0000","last_undegraded":"2024-09-16T07:58:32.095446+0000","last_fullsized":"2024-09-16T07:58:32.095446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":364,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.140808+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:35.140808+0000","last_peered":"2024-09-16T07:58:35.140808+0000","last_clean":"2024-09-16T07:58:35.140808+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:35.140808+0000","last_undegraded":"2024-09-16T07:58:35.140808+0000","last_fullsized":"2024-09-16T07:58:35.140808+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"142'721","reported_seq":763,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.889219+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:49.889219+0000","last_peered":"2024-09-16T07:58:49.889219+0000","last_clean":"2024-09-16T07:58:49.889219+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:49.889219+0000","last_undegraded":"2024-09-16T07:58:49.889219+0000","last_fullsized":"2024-09-16T07:58:49.889219+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:58:32.069085+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"137'597","reported_seq":627,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071646+0000","last_change":"2024-09-16T07:57:21.626864+0000","last_active":"2024-09-16T07:58:13.071646+0000","last_peered":"2024-09-16T07:58:13.071646+0000","last_clean":"2024-09-16T07:58:13.071646+0000","last_became_active":"2024-09-16T07:57:21.621162+0000","last_became_peered":"2024-09-16T07:57:21.621162+0000","last_unstale":"2024-09-16T07:58:13.071646+0000","last_undegraded":"2024-09-16T07:58:13.071646+0000","last_fullsized":"2024-09-16T07:58:13.071646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39124992,"num_objects":597,"num_object_clones":0,"num_object_copies":1791,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597,"num_write_kb":38208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":345,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.147860+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:35.147860+0000","last_peered":"2024-09-16T07:58:35.147860+0000","last_clean":"2024-09-16T07:58:35.147860+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:35.147860+0000","last_undegraded":"2024-09-16T07:58:35.147860+0000","last_fullsized":"2024-09-16T07:58:35.147860+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"142'717","reported_seq":773,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.741569+0000","last_change":"2024-09-16T07:58:34.475137+0000","last_active":"2024-09-16T07:58:49.741569+0000","last_peered":"2024-09-16T07:58:49.741569+0000","last_clean":"2024-09-16T07:58:49.741569+0000","last_became_active":"2024-09-16T07:58:34.211141+0000","last_became_peered":"2024-09-16T07:58:34.211141+0000","last_unstale":"2024-09-16T07:58:49.741569+0000","last_undegraded":"2024-09-16T07:58:49.741569+0000","last_fullsized":"2024-09-16T07:58:49.741569+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46989312,"num_objects":717,"num_object_clones":0,"num_object_copies":2151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":45888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:58:32.069088+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:58:32.069090+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.067638+0000","last_change":"2024-09-16T07:56:30.593749+0000","last_active":"2024-09-16T07:58:13.067638+0000","last_peered":"2024-09-16T07:58:13.067638+0000","last_clean":"2024-09-16T07:58:13.067638+0000","last_became_active":"2024-09-16T07:56:29.693473+0000","last_became_peered":"2024-09-16T07:56:29.693473+0000","last_unstale":"2024-09-16T07:58:13.067638+0000","last_undegraded":"2024-09-16T07:58:13.067638+0000","last_fullsized":"2024-09-16T07:58:13.067638+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"137'529","reported_seq":559,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.071467+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:13.071467+0000","last_peered":"2024-09-16T07:58:13.071467+0000","last_clean":"2024-09-16T07:58:13.071467+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:13.071467+0000","last_undegraded":"2024-09-16T07:58:13.071467+0000","last_fullsized":"2024-09-16T07:58:13.071467+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":352,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.093504+0000","last_change":"2024-09-16T07:58:32.093504+0000","last_active":"2024-09-16T07:58:32.093504+0000","last_peered":"2024-09-16T07:58:13.071163+0000","last_clean":"2024-09-16T07:58:13.071163+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:58:32.093504+0000","last_undegraded":"2024-09-16T07:58:32.093504+0000","last_fullsized":"2024-09-16T07:58:32.093504+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"137'545","reported_seq":577,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.118586+0000","last_change":"2024-09-16T07:58:32.118586+0000","last_active":"2024-09-16T07:58:32.118586+0000","last_peered":"2024-09-16T07:58:13.067147+0000","last_clean":"2024-09-16T07:58:13.067147+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:32.118586+0000","last_undegraded":"2024-09-16T07:58:32.118586+0000","last_fullsized":"2024-09-16T07:58:32.118586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":374,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-16T07:58:13.069861+0000","last_change":"2024-09-16T07:56:30.594420+0000","last_active":"2024-09-16T07:58:13.069861+0000","last_peered":"2024-09-16T07:58:13.069861+0000","last_clean":"2024-09-16T07:58:13.069861+0000","last_became_active":"2024-09-16T07:56:29.700922+0000","last_became_peered":"2024-09-16T07:56:29.700922+0000","last_unstale":"2024-09-16T07:58:13.069861+0000","last_undegraded":"2024-09-16T07:58:13.069861+0000","last_fullsized":"2024-09-16T07:58:13.069861+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"137'528","reported_seq":560,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.123332+0000","last_change":"2024-09-16T07:58:32.123332+0000","last_active":"2024-09-16T07:58:32.123332+0000","last_peered":"2024-09-16T07:58:13.073897+0000","last_clean":"2024-09-16T07:58:13.073897+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:32.123332+0000","last_undegraded":"2024-09-16T07:58:32.123332+0000","last_fullsized":"2024-09-16T07:58:32.123332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":359,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.143353+0000","last_change":"2024-09-16T07:58:35.147645+0000","last_active":"2024-09-16T07:58:35.143353+0000","last_peered":"2024-09-16T07:58:35.143353+0000","last_clean":"2024-09-16T07:58:35.143353+0000","last_became_active":"2024-09-16T07:58:34.254789+0000","last_became_peered":"2024-09-16T07:58:34.254789+0000","last_unstale":"2024-09-16T07:58:35.143353+0000","last_undegraded":"2024-09-16T07:58:35.143353+0000","last_fullsized":"2024-09-16T07:58:35.143353+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":607977472,"num_objects":9277,"num_object_clones":0,"num_object_copies":27831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9277,"num_write_kb":593728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":458752,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":108158976,"data_stored":1730543616,"data_compressed":82172141,"data_compressed_allocated":108158976,"data_compressed_original":1730543616,"omap_allocated":0,"internal_metadata":0},"log_size":9277,"ondisk_log_size":9277,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86060,"kb_used_data":34204,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94285780,"statfs":{"total":96636764160,"available":96548638720,"internally_reserved":0,"allocated":35024896,"data_stored":541930791,"data_compressed":25712339,"data_compressed_allocated":33845248,"data_compressed_original":541442048,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500792,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50372,"kb_used_data":21236,"kb_used_omap":0,"kb_used_meta":29120,"kb_avail":94321468,"statfs":{"total":96636764160,"available":96585183232,"internally_reserved":0,"allocated":21745664,"data_stored":329524946,"data_compressed":15626743,"data_compressed_allocated":20570112,"data_compressed_original":329039872,"omap_allocated":0,"internal_metadata":29818880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075638,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66800,"kb_used_data":37984,"kb_used_omap":0,"kb_used_meta":28800,"kb_avail":94305040,"statfs":{"total":96636764160,"available":96568360960,"internally_reserved":0,"allocated":38895616,"data_stored":603806828,"data_compressed":28648179,"data_compressed_allocated":37707776,"data_compressed_original":603324416,"omap_allocated":0,"internal_metadata":29491200},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38105088,"data_stored":609681408,"data_compressed":28950043,"data_compressed_allocated":38105088,"data_compressed_original":609681408,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20529152,"data_stored":328466432,"data_compressed":15596702,"data_compressed_allocated":20529152,"data_compressed_original":328466432,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33804288,"data_stored":540868608,"data_compressed":25682298,"data_compressed_allocated":33804288,"data_compressed_original":540868608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:59:02.265 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:59:02.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:02.434+0000 7f4d14391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:02.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:02.443+0000 7f4d14391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:03.313 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:59:03.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:03.466+0000 7f2ad8591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:03.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:03.481+0000 7f2ad8591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:03.762 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:59:03.764 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:59:03.787 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":553,"stamp":"2024-09-16T07:59:02.472176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653066816,"num_objects":9961,"num_object_clones":0,"num_object_copies":29883,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":10701,"num_write_kb":659540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10676,"ondisk_log_size":10676,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":279584,"kb_used_data":114716,"kb_used_omap":0,"kb_used_meta":164800,"kb_avail":377207776,"statfs":{"total":386547056640,"available":386260762624,"internally_reserved":0,"allocated":117469184,"data_stored":1805896117,"data_compressed":85667433,"data_compressed_allocated":112762880,"data_compressed_original":1803960320,"omap_allocated":0,"internal_metadata":168755200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":44498968,"num_objects":680,"num_object_clones":0,"num_object_copies":2040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1344,"num_write_kb":64705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002505"},"pg_stats":[{"pgid":"7.f","version":"137'557","reported_seq":590,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.117773+0000","last_change":"2024-09-16T07:58:32.124703+0000","last_active":"2024-09-16T07:58:32.124703+0000","last_peered":"2024-09-16T07:58:13.076723+0000","last_clean":"2024-09-16T07:58:13.076723+0000","last_became_active":"2024-09-16T07:57:21.662577+0000","last_became_peered":"2024-09-16T07:57:21.662577+0000","last_unstale":"2024-09-16T07:58:33.117773+0000","last_undegraded":"2024-09-16T07:58:33.117773+0000","last_fullsized":"2024-09-16T07:58:33.117773+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"142'733","reported_seq":776,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.944012+0000","last_change":"2024-09-16T07:58:34.224845+0000","last_active":"2024-09-16T07:58:49.944012+0000","last_peered":"2024-09-16T07:58:49.944012+0000","last_clean":"2024-09-16T07:58:49.944012+0000","last_became_active":"2024-09-16T07:58:34.204525+0000","last_became_peered":"2024-09-16T07:58:34.204525+0000","last_unstale":"2024-09-16T07:58:49.944012+0000","last_undegraded":"2024-09-16T07:58:49.944012+0000","last_fullsized":"2024-09-16T07:58:49.944012+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"142'792","reported_seq":835,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.765707+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:58.765707+0000","last_peered":"2024-09-16T07:58:58.765707+0000","last_clean":"2024-09-16T07:58:58.765707+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:58.765707+0000","last_undegraded":"2024-09-16T07:58:58.765707+0000","last_fullsized":"2024-09-16T07:58:58.765707+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42401816,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":792,"num_write_kb":46017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"142'797","reported_seq":839,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.838345+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:58.838345+0000","last_peered":"2024-09-16T07:58:58.838345+0000","last_clean":"2024-09-16T07:58:58.838345+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:58.838345+0000","last_undegraded":"2024-09-16T07:58:58.838345+0000","last_fullsized":"2024-09-16T07:58:58.838345+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43712512,"num_objects":667,"num_object_clones":0,"num_object_copies":2001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":46848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"137'508","reported_seq":541,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:33.116150+0000","last_change":"2024-09-16T07:58:32.142013+0000","last_active":"2024-09-16T07:58:32.142013+0000","last_peered":"2024-09-16T07:58:13.076585+0000","last_clean":"2024-09-16T07:58:13.076585+0000","last_became_active":"2024-09-16T07:57:21.724542+0000","last_became_peered":"2024-09-16T07:57:21.724542+0000","last_unstale":"2024-09-16T07:58:33.116150+0000","last_undegraded":"2024-09-16T07:58:33.116150+0000","last_fullsized":"2024-09-16T07:58:33.116150+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"137'554","reported_seq":586,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.106969+0000","last_change":"2024-09-16T07:58:32.106969+0000","last_active":"2024-09-16T07:58:32.106969+0000","last_peered":"2024-09-16T07:58:13.070933+0000","last_clean":"2024-09-16T07:58:13.070933+0000","last_became_active":"2024-09-16T07:57:21.669334+0000","last_became_peered":"2024-09-16T07:57:21.669334+0000","last_unstale":"2024-09-16T07:58:32.106969+0000","last_undegraded":"2024-09-16T07:58:32.106969+0000","last_fullsized":"2024-09-16T07:58:32.106969+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36306944,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":35456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"142'874","reported_seq":916,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.829634+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:58.829634+0000","last_peered":"2024-09-16T07:58:58.829634+0000","last_clean":"2024-09-16T07:58:58.829634+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:58.829634+0000","last_undegraded":"2024-09-16T07:58:58.829634+0000","last_fullsized":"2024-09-16T07:58:58.829634+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":736,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":51520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"142'704","reported_seq":754,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:50.032986+0000","last_change":"2024-09-16T07:58:34.626925+0000","last_active":"2024-09-16T07:58:50.032986+0000","last_peered":"2024-09-16T07:58:50.032986+0000","last_clean":"2024-09-16T07:58:50.032986+0000","last_became_active":"2024-09-16T07:58:34.283717+0000","last_became_peered":"2024-09-16T07:58:34.283717+0000","last_unstale":"2024-09-16T07:58:50.032986+0000","last_undegraded":"2024-09-16T07:58:50.032986+0000","last_fullsized":"2024-09-16T07:58:50.032986+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":704,"num_object_clones":0,"num_object_copies":2112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"137'576","reported_seq":608,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.132254+0000","last_change":"2024-09-16T07:58:32.132254+0000","last_active":"2024-09-16T07:58:32.132254+0000","last_peered":"2024-09-16T07:58:13.074775+0000","last_clean":"2024-09-16T07:58:13.074775+0000","last_became_active":"2024-09-16T07:57:21.684155+0000","last_became_peered":"2024-09-16T07:57:21.684155+0000","last_unstale":"2024-09-16T07:58:32.132254+0000","last_undegraded":"2024-09-16T07:58:32.132254+0000","last_fullsized":"2024-09-16T07:58:32.132254+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":576,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":417,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.095446+0000","last_change":"2024-09-16T07:58:32.095446+0000","last_active":"2024-09-16T07:58:32.095446+0000","last_peered":"2024-09-16T07:58:13.070190+0000","last_clean":"2024-09-16T07:58:13.070190+0000","last_became_active":"2024-09-16T07:56:29.677496+0000","last_became_peered":"2024-09-16T07:56:29.677496+0000","last_unstale":"2024-09-16T07:58:32.095446+0000","last_undegraded":"2024-09-16T07:58:32.095446+0000","last_fullsized":"2024-09-16T07:58:32.095446+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":364,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.140808+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:35.140808+0000","last_peered":"2024-09-16T07:58:35.140808+0000","last_clean":"2024-09-16T07:58:35.140808+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:35.140808+0000","last_undegraded":"2024-09-16T07:58:35.140808+0000","last_fullsized":"2024-09-16T07:58:35.140808+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"142'721","reported_seq":763,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.889219+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:49.889219+0000","last_peered":"2024-09-16T07:58:49.889219+0000","last_clean":"2024-09-16T07:58:49.889219+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:49.889219+0000","last_undegraded":"2024-09-16T07:58:49.889219+0000","last_fullsized":"2024-09-16T07:58:49.889219+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":218,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.545777+0000","last_change":"2024-09-16T07:56:53.058341+0000","last_active":"2024-09-16T07:57:22.545777+0000","last_peered":"2024-09-16T07:57:22.545777+0000","last_clean":"2024-09-16T07:57:22.545777+0000","last_became_active":"2024-09-16T07:56:52.214267+0000","last_became_peered":"2024-09-16T07:56:52.214267+0000","last_unstale":"2024-09-16T07:58:32.069085+0000","last_undegraded":"2024-09-16T07:57:22.545777+0000","last_fullsized":"2024-09-16T07:57:22.545777+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"142'900","reported_seq":948,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.693399+0000","last_change":"2024-09-16T07:58:34.411825+0000","last_active":"2024-09-16T07:58:58.693399+0000","last_peered":"2024-09-16T07:58:58.693399+0000","last_clean":"2024-09-16T07:58:58.693399+0000","last_became_active":"2024-09-16T07:58:34.222465+0000","last_became_peered":"2024-09-16T07:58:34.222465+0000","last_unstale":"2024-09-16T07:58:58.693399+0000","last_undegraded":"2024-09-16T07:58:58.693399+0000","last_fullsized":"2024-09-16T07:58:58.693399+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48758784,"num_objects":744,"num_object_clones":0,"num_object_copies":2232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":52608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":345,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.147860+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:35.147860+0000","last_peered":"2024-09-16T07:58:35.147860+0000","last_clean":"2024-09-16T07:58:35.147860+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:35.147860+0000","last_undegraded":"2024-09-16T07:58:35.147860+0000","last_fullsized":"2024-09-16T07:58:35.147860+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"142'717","reported_seq":773,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.741569+0000","last_change":"2024-09-16T07:58:34.475137+0000","last_active":"2024-09-16T07:58:49.741569+0000","last_peered":"2024-09-16T07:58:49.741569+0000","last_clean":"2024-09-16T07:58:49.741569+0000","last_became_active":"2024-09-16T07:58:34.211141+0000","last_became_peered":"2024-09-16T07:58:34.211141+0000","last_unstale":"2024-09-16T07:58:49.741569+0000","last_undegraded":"2024-09-16T07:58:49.741569+0000","last_fullsized":"2024-09-16T07:58:49.741569+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46989312,"num_objects":717,"num_object_clones":0,"num_object_copies":2151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":45888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":226,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:22.550570+0000","last_change":"2024-09-16T07:56:53.064314+0000","last_active":"2024-09-16T07:57:22.550570+0000","last_peered":"2024-09-16T07:57:22.550570+0000","last_clean":"2024-09-16T07:57:22.550570+0000","last_became_active":"2024-09-16T07:56:52.244407+0000","last_became_peered":"2024-09-16T07:56:52.244407+0000","last_unstale":"2024-09-16T07:58:32.069088+0000","last_undegraded":"2024-09-16T07:57:22.550570+0000","last_fullsized":"2024-09-16T07:57:22.550570+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"132'323","reported_seq":335,"reported_epoch":132,"state":"stale+active+clean","last_fresh":"2024-09-16T07:57:52.194250+0000","last_change":"2024-09-16T07:57:21.683473+0000","last_active":"2024-09-16T07:57:52.194250+0000","last_peered":"2024-09-16T07:57:52.194250+0000","last_clean":"2024-09-16T07:57:52.194250+0000","last_became_active":"2024-09-16T07:57:21.667424+0000","last_became_peered":"2024-09-16T07:57:21.667424+0000","last_unstale":"2024-09-16T07:58:32.069090+0000","last_undegraded":"2024-09-16T07:57:52.194250+0000","last_fullsized":"2024-09-16T07:57:52.194250+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21168128,"num_objects":323,"num_object_clones":0,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":20672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":388,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.127435+0000","last_change":"2024-09-16T07:58:35.139399+0000","last_active":"2024-09-16T07:58:35.127435+0000","last_peered":"2024-09-16T07:58:35.127435+0000","last_clean":"2024-09-16T07:58:35.127435+0000","last_became_active":"2024-09-16T07:58:34.217256+0000","last_became_peered":"2024-09-16T07:58:34.217256+0000","last_unstale":"2024-09-16T07:58:35.127435+0000","last_undegraded":"2024-09-16T07:58:35.127435+0000","last_fullsized":"2024-09-16T07:58:35.127435+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"142'792","reported_seq":834,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.312837+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:58.312837+0000","last_peered":"2024-09-16T07:58:58.312837+0000","last_clean":"2024-09-16T07:58:58.312837+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:58.312837+0000","last_undegraded":"2024-09-16T07:58:58.312837+0000","last_fullsized":"2024-09-16T07:58:58.312837+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45613056,"num_objects":696,"num_object_clones":0,"num_object_copies":2088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":47616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":352,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.093504+0000","last_change":"2024-09-16T07:58:32.093504+0000","last_active":"2024-09-16T07:58:32.093504+0000","last_peered":"2024-09-16T07:58:13.071163+0000","last_clean":"2024-09-16T07:58:13.071163+0000","last_became_active":"2024-09-16T07:56:29.689273+0000","last_became_peered":"2024-09-16T07:56:29.689273+0000","last_unstale":"2024-09-16T07:58:32.093504+0000","last_undegraded":"2024-09-16T07:58:32.093504+0000","last_fullsized":"2024-09-16T07:58:32.093504+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"137'545","reported_seq":577,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.118586+0000","last_change":"2024-09-16T07:58:32.118586+0000","last_active":"2024-09-16T07:58:32.118586+0000","last_peered":"2024-09-16T07:58:13.067147+0000","last_clean":"2024-09-16T07:58:13.067147+0000","last_became_active":"2024-09-16T07:57:21.635182+0000","last_became_peered":"2024-09-16T07:57:21.635182+0000","last_unstale":"2024-09-16T07:58:32.118586+0000","last_undegraded":"2024-09-16T07:58:32.118586+0000","last_fullsized":"2024-09-16T07:58:32.118586+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":388,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.136281+0000","last_change":"2024-09-16T07:58:35.140321+0000","last_active":"2024-09-16T07:58:35.136281+0000","last_peered":"2024-09-16T07:58:35.136281+0000","last_clean":"2024-09-16T07:58:35.136281+0000","last_became_active":"2024-09-16T07:58:34.211954+0000","last_became_peered":"2024-09-16T07:58:34.211954+0000","last_unstale":"2024-09-16T07:58:35.136281+0000","last_undegraded":"2024-09-16T07:58:35.136281+0000","last_fullsized":"2024-09-16T07:58:35.136281+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"137'528","reported_seq":560,"reported_epoch":140,"state":"peering","last_fresh":"2024-09-16T07:58:32.123332+0000","last_change":"2024-09-16T07:58:32.123332+0000","last_active":"2024-09-16T07:58:32.123332+0000","last_peered":"2024-09-16T07:58:13.073897+0000","last_clean":"2024-09-16T07:58:13.073897+0000","last_became_active":"2024-09-16T07:57:21.691196+0000","last_became_peered":"2024-09-16T07:57:21.691196+0000","last_unstale":"2024-09-16T07:58:32.123332+0000","last_undegraded":"2024-09-16T07:58:32.123332+0000","last_fullsized":"2024-09-16T07:58:32.123332+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":359,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.143353+0000","last_change":"2024-09-16T07:58:35.147645+0000","last_active":"2024-09-16T07:58:35.143353+0000","last_peered":"2024-09-16T07:58:35.143353+0000","last_clean":"2024-09-16T07:58:35.143353+0000","last_became_active":"2024-09-16T07:58:34.254789+0000","last_became_peered":"2024-09-16T07:58:34.254789+0000","last_unstale":"2024-09-16T07:58:35.143353+0000","last_undegraded":"2024-09-16T07:58:35.143353+0000","last_fullsized":"2024-09-16T07:58:35.143353+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":652476440,"num_objects":9957,"num_object_clones":0,"num_object_copies":29871,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10621,"num_write_kb":658433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":524288,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":113057792,"data_stored":1808859160,"data_compressed":85891622,"data_compressed_allocated":113053696,"data_compressed_original":1808859136,"omap_allocated":0,"internal_metadata":0},"log_size":10621,"ondisk_log_size":10621,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122317,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86060,"kb_used_data":34204,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94285780,"statfs":{"total":96636764160,"available":96548638720,"internally_reserved":0,"allocated":35024896,"data_stored":541930791,"data_compressed":25712339,"data_compressed_allocated":33845248,"data_compressed_original":541442048,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81612,"kb_used_data":26104,"kb_used_omap":0,"kb_used_meta":55488,"kb_avail":94290228,"statfs":{"total":96636764160,"available":96553193472,"internally_reserved":0,"allocated":26730496,"data_stored":408706724,"data_compressed":19386680,"data_compressed_allocated":25518080,"data_compressed_original":408207360,"omap_allocated":0,"internal_metadata":56819712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075638,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66800,"kb_used_data":37984,"kb_used_omap":0,"kb_used_meta":28800,"kb_avail":94305040,"statfs":{"total":96636764160,"available":96568360960,"internally_reserved":0,"allocated":38895616,"data_stored":603806828,"data_compressed":28648179,"data_compressed_allocated":37707776,"data_compressed_original":603324416,"omap_allocated":0,"internal_metadata":29491200},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":102,"seq":438086664341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45112,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":16818176,"data_stored":251451774,"data_compressed":11920235,"data_compressed_allocated":15691776,"data_compressed_original":250986496,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":251527168,"data_compressed":11943098,"data_compressed_allocated":15720448,"data_compressed_original":251527168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38105088,"data_stored":609681408,"data_compressed":28950043,"data_compressed_allocated":38105088,"data_compressed_original":609681408,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25427968,"data_stored":406781976,"data_compressed":19316183,"data_compressed_allocated":25423872,"data_compressed_original":406781952,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33804288,"data_stored":540868608,"data_compressed":25682298,"data_compressed_allocated":33804288,"data_compressed_original":540868608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:59:03.789 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T07:59:03.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:03.946+0000 7fb361751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:03.962 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:03.963+0000 7fb361751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:04.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:59:04.419 INFO:teuthology.orchestra.run.smithi003.stdout:{"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":846,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":142,"num_osds":4,"num_up_osds":4,"osd_up_since":1726473513,"num_in_osds":4,"osd_in_since":1726472700,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":14},{"state_name":"peering","count":8},{"state_name":"stale+active+clean","count":3}],"num_pgs":25,"num_pools":3,"num_objects":9961,"data_bytes":653066816,"bytes_used":286294016,"bytes_avail":386260762624,"bytes_total":386547056640,"inactive_pgs_ratio":0.31999999284744263,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":5460,"recovering_keys_per_sec":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"read_bytes_sec":85,"write_bytes_sec":5520340,"read_op_per_sec":0,"write_op_per_sec":111},"fsmap":{"epoch":1,"btime":"2024-09-16T07:44:57:934623+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-16T07:46:04.297874+0000","services":{}},"progress_events":{}} 2024-09-16T07:59:04.440 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-09-16T07:59:04.440 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:59:04.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:04.588+0000 7f9fe9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:04.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:04.602+0000 7f9fe9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:04.862 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:59:04.920 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:59:04.921 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:59:04.933 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":554,"stamp":"2024-09-16T07:59:04.472615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":704315968,"num_objects":10743,"num_object_clones":0,"num_object_copies":32229,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13033,"num_write_kb":759188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13009,"ondisk_log_size":13009,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":302644,"kb_used_data":133104,"kb_used_omap":0,"kb_used_meta":169472,"kb_avail":377184716,"statfs":{"total":386547056640,"available":386237149184,"internally_reserved":0,"allocated":136298496,"data_stored":2105440301,"data_compressed":99891068,"data_compressed_allocated":131481600,"data_compressed_original":2103459840,"omap_allocated":0,"internal_metadata":173539328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":95748120,"num_objects":1462,"num_object_clones":0,"num_object_copies":4386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3676,"num_write_kb":164353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":589824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002444"},"pg_stats":[{"pgid":"7.f","version":"142'857","reported_seq":907,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:02.975403+0000","last_change":"2024-09-16T07:58:34.700655+0000","last_active":"2024-09-16T07:59:02.975403+0000","last_peered":"2024-09-16T07:59:02.975403+0000","last_clean":"2024-09-16T07:59:02.975403+0000","last_became_active":"2024-09-16T07:58:34.322547+0000","last_became_peered":"2024-09-16T07:58:34.322547+0000","last_unstale":"2024-09-16T07:59:02.975403+0000","last_undegraded":"2024-09-16T07:59:02.975403+0000","last_fullsized":"2024-09-16T07:59:02.975403+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41222144,"num_objects":629,"num_object_clones":0,"num_object_copies":1887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":47552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"142'733","reported_seq":776,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.944012+0000","last_change":"2024-09-16T07:58:34.224845+0000","last_active":"2024-09-16T07:58:49.944012+0000","last_peered":"2024-09-16T07:58:49.944012+0000","last_clean":"2024-09-16T07:58:49.944012+0000","last_became_active":"2024-09-16T07:58:34.204525+0000","last_became_peered":"2024-09-16T07:58:34.204525+0000","last_unstale":"2024-09-16T07:58:49.944012+0000","last_undegraded":"2024-09-16T07:58:49.944012+0000","last_fullsized":"2024-09-16T07:58:49.944012+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"142'792","reported_seq":835,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.765707+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:58.765707+0000","last_peered":"2024-09-16T07:58:58.765707+0000","last_clean":"2024-09-16T07:58:58.765707+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:58.765707+0000","last_undegraded":"2024-09-16T07:58:58.765707+0000","last_fullsized":"2024-09-16T07:58:58.765707+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42401816,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":792,"num_write_kb":46017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"142'797","reported_seq":839,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.838345+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:58.838345+0000","last_peered":"2024-09-16T07:58:58.838345+0000","last_clean":"2024-09-16T07:58:58.838345+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:58.838345+0000","last_undegraded":"2024-09-16T07:58:58.838345+0000","last_fullsized":"2024-09-16T07:58:58.838345+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43712512,"num_objects":667,"num_object_clones":0,"num_object_copies":2001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":46848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"142'811","reported_seq":861,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.133650+0000","last_change":"2024-09-16T07:58:34.777673+0000","last_active":"2024-09-16T07:59:03.133650+0000","last_peered":"2024-09-16T07:59:03.133650+0000","last_clean":"2024-09-16T07:59:03.133650+0000","last_became_active":"2024-09-16T07:58:34.331701+0000","last_became_peered":"2024-09-16T07:58:34.331701+0000","last_unstale":"2024-09-16T07:59:03.133650+0000","last_undegraded":"2024-09-16T07:59:03.133650+0000","last_fullsized":"2024-09-16T07:59:03.133650+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38731776,"num_objects":591,"num_object_clones":0,"num_object_copies":1773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":44864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"142'865","reported_seq":913,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.041876+0000","last_change":"2024-09-16T07:58:34.501653+0000","last_active":"2024-09-16T07:59:03.041876+0000","last_peered":"2024-09-16T07:59:03.041876+0000","last_clean":"2024-09-16T07:59:03.041876+0000","last_became_active":"2024-09-16T07:58:34.288196+0000","last_became_peered":"2024-09-16T07:58:34.288196+0000","last_unstale":"2024-09-16T07:59:03.041876+0000","last_undegraded":"2024-09-16T07:59:03.041876+0000","last_fullsized":"2024-09-16T07:59:03.041876+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":865,"log_dups_size":0,"ondisk_log_size":865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41091072,"num_objects":627,"num_object_clones":0,"num_object_copies":1881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":865,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"142'874","reported_seq":916,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.829634+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:58.829634+0000","last_peered":"2024-09-16T07:58:58.829634+0000","last_clean":"2024-09-16T07:58:58.829634+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:58.829634+0000","last_undegraded":"2024-09-16T07:58:58.829634+0000","last_fullsized":"2024-09-16T07:58:58.829634+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":736,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":51520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"142'704","reported_seq":754,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:50.032986+0000","last_change":"2024-09-16T07:58:34.626925+0000","last_active":"2024-09-16T07:58:50.032986+0000","last_peered":"2024-09-16T07:58:50.032986+0000","last_clean":"2024-09-16T07:58:50.032986+0000","last_became_active":"2024-09-16T07:58:34.283717+0000","last_became_peered":"2024-09-16T07:58:34.283717+0000","last_unstale":"2024-09-16T07:58:50.032986+0000","last_undegraded":"2024-09-16T07:58:50.032986+0000","last_fullsized":"2024-09-16T07:58:50.032986+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":704,"num_object_clones":0,"num_object_copies":2112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"142'873","reported_seq":916,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.141595+0000","last_change":"2024-09-16T07:58:34.314895+0000","last_active":"2024-09-16T07:59:03.141595+0000","last_peered":"2024-09-16T07:59:03.141595+0000","last_clean":"2024-09-16T07:59:03.141595+0000","last_became_active":"2024-09-16T07:58:34.299661+0000","last_became_peered":"2024-09-16T07:58:34.299661+0000","last_unstale":"2024-09-16T07:59:03.141595+0000","last_undegraded":"2024-09-16T07:59:03.141595+0000","last_fullsized":"2024-09-16T07:59:03.141595+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42270720,"num_objects":645,"num_object_clones":0,"num_object_copies":1935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":48576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":428,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.127605+0000","last_change":"2024-09-16T07:58:34.277869+0000","last_active":"2024-09-16T07:58:35.127605+0000","last_peered":"2024-09-16T07:58:35.127605+0000","last_clean":"2024-09-16T07:58:35.127605+0000","last_became_active":"2024-09-16T07:58:34.266892+0000","last_became_peered":"2024-09-16T07:58:34.266892+0000","last_unstale":"2024-09-16T07:58:35.127605+0000","last_undegraded":"2024-09-16T07:58:35.127605+0000","last_fullsized":"2024-09-16T07:58:35.127605+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":364,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.140808+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:35.140808+0000","last_peered":"2024-09-16T07:58:35.140808+0000","last_clean":"2024-09-16T07:58:35.140808+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:35.140808+0000","last_undegraded":"2024-09-16T07:58:35.140808+0000","last_fullsized":"2024-09-16T07:58:35.140808+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"142'721","reported_seq":763,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.889219+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:49.889219+0000","last_peered":"2024-09-16T07:58:49.889219+0000","last_clean":"2024-09-16T07:58:49.889219+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:49.889219+0000","last_undegraded":"2024-09-16T07:58:49.889219+0000","last_fullsized":"2024-09-16T07:58:49.889219+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.116767+0000","last_change":"2024-09-16T07:58:35.121289+0000","last_active":"2024-09-16T07:58:35.116767+0000","last_peered":"2024-09-16T07:58:35.116767+0000","last_clean":"2024-09-16T07:58:35.116767+0000","last_became_active":"2024-09-16T07:58:34.303916+0000","last_became_peered":"2024-09-16T07:58:34.303916+0000","last_unstale":"2024-09-16T07:58:35.116767+0000","last_undegraded":"2024-09-16T07:58:35.116767+0000","last_fullsized":"2024-09-16T07:58:35.116767+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"142'900","reported_seq":948,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.693399+0000","last_change":"2024-09-16T07:58:34.411825+0000","last_active":"2024-09-16T07:58:58.693399+0000","last_peered":"2024-09-16T07:58:58.693399+0000","last_clean":"2024-09-16T07:58:58.693399+0000","last_became_active":"2024-09-16T07:58:34.222465+0000","last_became_peered":"2024-09-16T07:58:34.222465+0000","last_unstale":"2024-09-16T07:58:58.693399+0000","last_undegraded":"2024-09-16T07:58:58.693399+0000","last_fullsized":"2024-09-16T07:58:58.693399+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48758784,"num_objects":744,"num_object_clones":0,"num_object_copies":2232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":52608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":345,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.147860+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:35.147860+0000","last_peered":"2024-09-16T07:58:35.147860+0000","last_clean":"2024-09-16T07:58:35.147860+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:35.147860+0000","last_undegraded":"2024-09-16T07:58:35.147860+0000","last_fullsized":"2024-09-16T07:58:35.147860+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"142'717","reported_seq":773,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.741569+0000","last_change":"2024-09-16T07:58:34.475137+0000","last_active":"2024-09-16T07:58:49.741569+0000","last_peered":"2024-09-16T07:58:49.741569+0000","last_clean":"2024-09-16T07:58:49.741569+0000","last_became_active":"2024-09-16T07:58:34.211141+0000","last_became_peered":"2024-09-16T07:58:34.211141+0000","last_unstale":"2024-09-16T07:58:49.741569+0000","last_undegraded":"2024-09-16T07:58:49.741569+0000","last_fullsized":"2024-09-16T07:58:49.741569+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46989312,"num_objects":717,"num_object_clones":0,"num_object_copies":2151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":45888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":205,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.107609+0000","last_change":"2024-09-16T07:58:35.120264+0000","last_active":"2024-09-16T07:58:35.107609+0000","last_peered":"2024-09-16T07:58:35.107609+0000","last_clean":"2024-09-16T07:58:35.107609+0000","last_became_active":"2024-09-16T07:58:34.238282+0000","last_became_peered":"2024-09-16T07:58:34.238282+0000","last_unstale":"2024-09-16T07:58:35.107609+0000","last_undegraded":"2024-09-16T07:58:35.107609+0000","last_fullsized":"2024-09-16T07:58:35.107609+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"142'835","reported_seq":873,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:02.575098+0000","last_change":"2024-09-16T07:58:34.343709+0000","last_active":"2024-09-16T07:59:02.575098+0000","last_peered":"2024-09-16T07:59:02.575098+0000","last_clean":"2024-09-16T07:59:02.575098+0000","last_became_active":"2024-09-16T07:58:34.323063+0000","last_became_peered":"2024-09-16T07:58:34.323063+0000","last_unstale":"2024-09-16T07:59:02.575098+0000","last_undegraded":"2024-09-16T07:59:02.575098+0000","last_fullsized":"2024-09-16T07:59:02.575098+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42467328,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":47424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":388,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.127435+0000","last_change":"2024-09-16T07:58:35.139399+0000","last_active":"2024-09-16T07:58:35.127435+0000","last_peered":"2024-09-16T07:58:35.127435+0000","last_clean":"2024-09-16T07:58:35.127435+0000","last_became_active":"2024-09-16T07:58:34.217256+0000","last_became_peered":"2024-09-16T07:58:34.217256+0000","last_unstale":"2024-09-16T07:58:35.127435+0000","last_undegraded":"2024-09-16T07:58:35.127435+0000","last_fullsized":"2024-09-16T07:58:35.127435+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"142'792","reported_seq":834,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.312837+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:58.312837+0000","last_peered":"2024-09-16T07:58:58.312837+0000","last_clean":"2024-09-16T07:58:58.312837+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:58.312837+0000","last_undegraded":"2024-09-16T07:58:58.312837+0000","last_fullsized":"2024-09-16T07:58:58.312837+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45613056,"num_objects":696,"num_object_clones":0,"num_object_copies":2088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":47616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":364,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.120963+0000","last_change":"2024-09-16T07:58:35.143177+0000","last_active":"2024-09-16T07:58:35.120963+0000","last_peered":"2024-09-16T07:58:35.120963+0000","last_clean":"2024-09-16T07:58:35.120963+0000","last_became_active":"2024-09-16T07:58:34.232114+0000","last_became_peered":"2024-09-16T07:58:34.232114+0000","last_unstale":"2024-09-16T07:58:35.120963+0000","last_undegraded":"2024-09-16T07:58:35.120963+0000","last_fullsized":"2024-09-16T07:58:35.120963+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"142'845","reported_seq":895,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.012265+0000","last_change":"2024-09-16T07:58:34.450488+0000","last_active":"2024-09-16T07:59:03.012265+0000","last_peered":"2024-09-16T07:59:03.012265+0000","last_clean":"2024-09-16T07:59:03.012265+0000","last_became_active":"2024-09-16T07:58:34.244429+0000","last_became_peered":"2024-09-16T07:58:34.244429+0000","last_unstale":"2024-09-16T07:59:03.012265+0000","last_undegraded":"2024-09-16T07:59:03.012265+0000","last_fullsized":"2024-09-16T07:59:03.012265+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39649280,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":46400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":388,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.136281+0000","last_change":"2024-09-16T07:58:35.140321+0000","last_active":"2024-09-16T07:58:35.136281+0000","last_peered":"2024-09-16T07:58:35.136281+0000","last_clean":"2024-09-16T07:58:35.136281+0000","last_became_active":"2024-09-16T07:58:34.211954+0000","last_became_peered":"2024-09-16T07:58:34.211954+0000","last_unstale":"2024-09-16T07:58:35.136281+0000","last_undegraded":"2024-09-16T07:58:35.136281+0000","last_fullsized":"2024-09-16T07:58:35.136281+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"142'838","reported_seq":886,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.020556+0000","last_change":"2024-09-16T07:58:34.658968+0000","last_active":"2024-09-16T07:59:03.020556+0000","last_peered":"2024-09-16T07:59:03.020556+0000","last_clean":"2024-09-16T07:59:03.020556+0000","last_became_active":"2024-09-16T07:58:34.319183+0000","last_became_peered":"2024-09-16T07:58:34.319183+0000","last_unstale":"2024-09-16T07:59:03.020556+0000","last_undegraded":"2024-09-16T07:59:03.020556+0000","last_fullsized":"2024-09-16T07:59:03.020556+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41156608,"num_objects":628,"num_object_clones":0,"num_object_copies":1884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":838,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":359,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.143353+0000","last_change":"2024-09-16T07:58:35.147645+0000","last_active":"2024-09-16T07:58:35.143353+0000","last_peered":"2024-09-16T07:58:35.143353+0000","last_clean":"2024-09-16T07:58:35.143353+0000","last_became_active":"2024-09-16T07:58:34.254789+0000","last_became_peered":"2024-09-16T07:58:34.254789+0000","last_unstale":"2024-09-16T07:58:35.143353+0000","last_undegraded":"2024-09-16T07:58:35.143353+0000","last_fullsized":"2024-09-16T07:58:35.143353+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":703725592,"num_objects":10739,"num_object_clones":0,"num_object_copies":32217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12953,"num_write_kb":758081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":130957312,"data_stored":2095185968,"data_compressed":99489745,"data_compressed_allocated":130949120,"data_compressed_original":2095185920,"omap_allocated":0,"internal_metadata":0},"log_size":12954,"ondisk_log_size":12954,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122347,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91332,"kb_used_data":39476,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94280508,"statfs":{"total":96636764160,"available":96543240192,"internally_reserved":0,"allocated":40423424,"data_stored":627859089,"data_compressed":29793208,"data_compressed_allocated":39215104,"data_compressed_original":627359744,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81612,"kb_used_data":26104,"kb_used_omap":0,"kb_used_meta":55488,"kb_avail":94290228,"statfs":{"total":96636764160,"available":96553193472,"internally_reserved":0,"allocated":26730496,"data_stored":408706724,"data_compressed":19386680,"data_compressed_allocated":25518080,"data_compressed_original":408207360,"omap_allocated":0,"internal_metadata":56819712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075638,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66800,"kb_used_data":37984,"kb_used_omap":0,"kb_used_meta":28800,"kb_avail":94305040,"statfs":{"total":96636764160,"available":96568360960,"internally_reserved":0,"allocated":38895616,"data_stored":603806828,"data_compressed":28648179,"data_compressed_allocated":37707776,"data_compressed_original":603324416,"omap_allocated":0,"internal_metadata":29491200},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":140,"seq":601295421469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62900,"kb_used_data":29540,"kb_used_omap":0,"kb_used_meta":33344,"kb_avail":94308940,"statfs":{"total":96636764160,"available":96572354560,"internally_reserved":0,"allocated":30248960,"data_stored":465067660,"data_compressed":22063001,"data_compressed_allocated":29040640,"data_compressed_original":464568320,"omap_allocated":0,"internal_metadata":34144256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28712960,"data_stored":459407360,"data_compressed":21815120,"data_compressed_allocated":28712960,"data_compressed_original":459407360,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38105088,"data_stored":609681408,"data_compressed":28950043,"data_compressed_allocated":38105088,"data_compressed_original":609681408,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25427968,"data_stored":406781976,"data_compressed":19316183,"data_compressed_allocated":25423872,"data_compressed_original":406781952,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38711296,"data_stored":619315224,"data_compressed":29408399,"data_compressed_allocated":38707200,"data_compressed_original":619315200,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:59:05.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:05.001+0000 7fe4cc191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:05.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:05.007+0000 7fe4cc191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:07.545 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:59:07.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:07.712+0000 7f10ce8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:07.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:07.724+0000 7f10ce8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:07.936 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:59:08.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:08.094+0000 7f368c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:08.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:08.106+0000 7f368c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:08.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:59:08.412 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:59:08.427 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":555,"stamp":"2024-09-16T07:59:06.473020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":704315968,"num_objects":10743,"num_object_clones":0,"num_object_copies":32229,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13033,"num_write_kb":759188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13009,"ondisk_log_size":13009,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":302644,"kb_used_data":133104,"kb_used_omap":0,"kb_used_meta":169472,"kb_avail":377184716,"statfs":{"total":386547056640,"available":386237149184,"internally_reserved":0,"allocated":136298496,"data_stored":2105440301,"data_compressed":99891068,"data_compressed_allocated":131481600,"data_compressed_original":2103459840,"omap_allocated":0,"internal_metadata":173539328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":95748120,"num_objects":1462,"num_object_clones":0,"num_object_copies":4386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3676,"num_write_kb":164353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":589824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002505"},"pg_stats":[{"pgid":"7.f","version":"142'857","reported_seq":907,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:02.975403+0000","last_change":"2024-09-16T07:58:34.700655+0000","last_active":"2024-09-16T07:59:02.975403+0000","last_peered":"2024-09-16T07:59:02.975403+0000","last_clean":"2024-09-16T07:59:02.975403+0000","last_became_active":"2024-09-16T07:58:34.322547+0000","last_became_peered":"2024-09-16T07:58:34.322547+0000","last_unstale":"2024-09-16T07:59:02.975403+0000","last_undegraded":"2024-09-16T07:59:02.975403+0000","last_fullsized":"2024-09-16T07:59:02.975403+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41222144,"num_objects":629,"num_object_clones":0,"num_object_copies":1887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":47552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"142'733","reported_seq":776,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.944012+0000","last_change":"2024-09-16T07:58:34.224845+0000","last_active":"2024-09-16T07:58:49.944012+0000","last_peered":"2024-09-16T07:58:49.944012+0000","last_clean":"2024-09-16T07:58:49.944012+0000","last_became_active":"2024-09-16T07:58:34.204525+0000","last_became_peered":"2024-09-16T07:58:34.204525+0000","last_unstale":"2024-09-16T07:58:49.944012+0000","last_undegraded":"2024-09-16T07:58:49.944012+0000","last_fullsized":"2024-09-16T07:58:49.944012+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"142'792","reported_seq":835,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.765707+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:58.765707+0000","last_peered":"2024-09-16T07:58:58.765707+0000","last_clean":"2024-09-16T07:58:58.765707+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:58.765707+0000","last_undegraded":"2024-09-16T07:58:58.765707+0000","last_fullsized":"2024-09-16T07:58:58.765707+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42401816,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":792,"num_write_kb":46017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"142'797","reported_seq":839,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.838345+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:58.838345+0000","last_peered":"2024-09-16T07:58:58.838345+0000","last_clean":"2024-09-16T07:58:58.838345+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:58.838345+0000","last_undegraded":"2024-09-16T07:58:58.838345+0000","last_fullsized":"2024-09-16T07:58:58.838345+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43712512,"num_objects":667,"num_object_clones":0,"num_object_copies":2001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":46848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"142'811","reported_seq":861,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.133650+0000","last_change":"2024-09-16T07:58:34.777673+0000","last_active":"2024-09-16T07:59:03.133650+0000","last_peered":"2024-09-16T07:59:03.133650+0000","last_clean":"2024-09-16T07:59:03.133650+0000","last_became_active":"2024-09-16T07:58:34.331701+0000","last_became_peered":"2024-09-16T07:58:34.331701+0000","last_unstale":"2024-09-16T07:59:03.133650+0000","last_undegraded":"2024-09-16T07:59:03.133650+0000","last_fullsized":"2024-09-16T07:59:03.133650+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38731776,"num_objects":591,"num_object_clones":0,"num_object_copies":1773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":44864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"142'865","reported_seq":913,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.041876+0000","last_change":"2024-09-16T07:58:34.501653+0000","last_active":"2024-09-16T07:59:03.041876+0000","last_peered":"2024-09-16T07:59:03.041876+0000","last_clean":"2024-09-16T07:59:03.041876+0000","last_became_active":"2024-09-16T07:58:34.288196+0000","last_became_peered":"2024-09-16T07:58:34.288196+0000","last_unstale":"2024-09-16T07:59:03.041876+0000","last_undegraded":"2024-09-16T07:59:03.041876+0000","last_fullsized":"2024-09-16T07:59:03.041876+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":865,"log_dups_size":0,"ondisk_log_size":865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41091072,"num_objects":627,"num_object_clones":0,"num_object_copies":1881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":865,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"142'874","reported_seq":916,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.829634+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:58.829634+0000","last_peered":"2024-09-16T07:58:58.829634+0000","last_clean":"2024-09-16T07:58:58.829634+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:58.829634+0000","last_undegraded":"2024-09-16T07:58:58.829634+0000","last_fullsized":"2024-09-16T07:58:58.829634+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":736,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":51520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"142'704","reported_seq":754,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:50.032986+0000","last_change":"2024-09-16T07:58:34.626925+0000","last_active":"2024-09-16T07:58:50.032986+0000","last_peered":"2024-09-16T07:58:50.032986+0000","last_clean":"2024-09-16T07:58:50.032986+0000","last_became_active":"2024-09-16T07:58:34.283717+0000","last_became_peered":"2024-09-16T07:58:34.283717+0000","last_unstale":"2024-09-16T07:58:50.032986+0000","last_undegraded":"2024-09-16T07:58:50.032986+0000","last_fullsized":"2024-09-16T07:58:50.032986+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":704,"num_object_clones":0,"num_object_copies":2112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"142'873","reported_seq":916,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.141595+0000","last_change":"2024-09-16T07:58:34.314895+0000","last_active":"2024-09-16T07:59:03.141595+0000","last_peered":"2024-09-16T07:59:03.141595+0000","last_clean":"2024-09-16T07:59:03.141595+0000","last_became_active":"2024-09-16T07:58:34.299661+0000","last_became_peered":"2024-09-16T07:58:34.299661+0000","last_unstale":"2024-09-16T07:59:03.141595+0000","last_undegraded":"2024-09-16T07:59:03.141595+0000","last_fullsized":"2024-09-16T07:59:03.141595+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42270720,"num_objects":645,"num_object_clones":0,"num_object_copies":1935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":48576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":428,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.127605+0000","last_change":"2024-09-16T07:58:34.277869+0000","last_active":"2024-09-16T07:58:35.127605+0000","last_peered":"2024-09-16T07:58:35.127605+0000","last_clean":"2024-09-16T07:58:35.127605+0000","last_became_active":"2024-09-16T07:58:34.266892+0000","last_became_peered":"2024-09-16T07:58:34.266892+0000","last_unstale":"2024-09-16T07:58:35.127605+0000","last_undegraded":"2024-09-16T07:58:35.127605+0000","last_fullsized":"2024-09-16T07:58:35.127605+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":364,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.140808+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:35.140808+0000","last_peered":"2024-09-16T07:58:35.140808+0000","last_clean":"2024-09-16T07:58:35.140808+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:35.140808+0000","last_undegraded":"2024-09-16T07:58:35.140808+0000","last_fullsized":"2024-09-16T07:58:35.140808+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"142'721","reported_seq":763,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.889219+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:49.889219+0000","last_peered":"2024-09-16T07:58:49.889219+0000","last_clean":"2024-09-16T07:58:49.889219+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:49.889219+0000","last_undegraded":"2024-09-16T07:58:49.889219+0000","last_fullsized":"2024-09-16T07:58:49.889219+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.116767+0000","last_change":"2024-09-16T07:58:35.121289+0000","last_active":"2024-09-16T07:58:35.116767+0000","last_peered":"2024-09-16T07:58:35.116767+0000","last_clean":"2024-09-16T07:58:35.116767+0000","last_became_active":"2024-09-16T07:58:34.303916+0000","last_became_peered":"2024-09-16T07:58:34.303916+0000","last_unstale":"2024-09-16T07:58:35.116767+0000","last_undegraded":"2024-09-16T07:58:35.116767+0000","last_fullsized":"2024-09-16T07:58:35.116767+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"142'900","reported_seq":948,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.693399+0000","last_change":"2024-09-16T07:58:34.411825+0000","last_active":"2024-09-16T07:58:58.693399+0000","last_peered":"2024-09-16T07:58:58.693399+0000","last_clean":"2024-09-16T07:58:58.693399+0000","last_became_active":"2024-09-16T07:58:34.222465+0000","last_became_peered":"2024-09-16T07:58:34.222465+0000","last_unstale":"2024-09-16T07:58:58.693399+0000","last_undegraded":"2024-09-16T07:58:58.693399+0000","last_fullsized":"2024-09-16T07:58:58.693399+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48758784,"num_objects":744,"num_object_clones":0,"num_object_copies":2232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":52608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":345,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.147860+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:35.147860+0000","last_peered":"2024-09-16T07:58:35.147860+0000","last_clean":"2024-09-16T07:58:35.147860+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:35.147860+0000","last_undegraded":"2024-09-16T07:58:35.147860+0000","last_fullsized":"2024-09-16T07:58:35.147860+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"142'717","reported_seq":773,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.741569+0000","last_change":"2024-09-16T07:58:34.475137+0000","last_active":"2024-09-16T07:58:49.741569+0000","last_peered":"2024-09-16T07:58:49.741569+0000","last_clean":"2024-09-16T07:58:49.741569+0000","last_became_active":"2024-09-16T07:58:34.211141+0000","last_became_peered":"2024-09-16T07:58:34.211141+0000","last_unstale":"2024-09-16T07:58:49.741569+0000","last_undegraded":"2024-09-16T07:58:49.741569+0000","last_fullsized":"2024-09-16T07:58:49.741569+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46989312,"num_objects":717,"num_object_clones":0,"num_object_copies":2151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":45888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":205,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.107609+0000","last_change":"2024-09-16T07:58:35.120264+0000","last_active":"2024-09-16T07:58:35.107609+0000","last_peered":"2024-09-16T07:58:35.107609+0000","last_clean":"2024-09-16T07:58:35.107609+0000","last_became_active":"2024-09-16T07:58:34.238282+0000","last_became_peered":"2024-09-16T07:58:34.238282+0000","last_unstale":"2024-09-16T07:58:35.107609+0000","last_undegraded":"2024-09-16T07:58:35.107609+0000","last_fullsized":"2024-09-16T07:58:35.107609+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"142'835","reported_seq":873,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:02.575098+0000","last_change":"2024-09-16T07:58:34.343709+0000","last_active":"2024-09-16T07:59:02.575098+0000","last_peered":"2024-09-16T07:59:02.575098+0000","last_clean":"2024-09-16T07:59:02.575098+0000","last_became_active":"2024-09-16T07:58:34.323063+0000","last_became_peered":"2024-09-16T07:58:34.323063+0000","last_unstale":"2024-09-16T07:59:02.575098+0000","last_undegraded":"2024-09-16T07:59:02.575098+0000","last_fullsized":"2024-09-16T07:59:02.575098+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42467328,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":47424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":388,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.127435+0000","last_change":"2024-09-16T07:58:35.139399+0000","last_active":"2024-09-16T07:58:35.127435+0000","last_peered":"2024-09-16T07:58:35.127435+0000","last_clean":"2024-09-16T07:58:35.127435+0000","last_became_active":"2024-09-16T07:58:34.217256+0000","last_became_peered":"2024-09-16T07:58:34.217256+0000","last_unstale":"2024-09-16T07:58:35.127435+0000","last_undegraded":"2024-09-16T07:58:35.127435+0000","last_fullsized":"2024-09-16T07:58:35.127435+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"142'792","reported_seq":834,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.312837+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:58.312837+0000","last_peered":"2024-09-16T07:58:58.312837+0000","last_clean":"2024-09-16T07:58:58.312837+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:58.312837+0000","last_undegraded":"2024-09-16T07:58:58.312837+0000","last_fullsized":"2024-09-16T07:58:58.312837+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45613056,"num_objects":696,"num_object_clones":0,"num_object_copies":2088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":47616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":364,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.120963+0000","last_change":"2024-09-16T07:58:35.143177+0000","last_active":"2024-09-16T07:58:35.120963+0000","last_peered":"2024-09-16T07:58:35.120963+0000","last_clean":"2024-09-16T07:58:35.120963+0000","last_became_active":"2024-09-16T07:58:34.232114+0000","last_became_peered":"2024-09-16T07:58:34.232114+0000","last_unstale":"2024-09-16T07:58:35.120963+0000","last_undegraded":"2024-09-16T07:58:35.120963+0000","last_fullsized":"2024-09-16T07:58:35.120963+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"142'845","reported_seq":895,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.012265+0000","last_change":"2024-09-16T07:58:34.450488+0000","last_active":"2024-09-16T07:59:03.012265+0000","last_peered":"2024-09-16T07:59:03.012265+0000","last_clean":"2024-09-16T07:59:03.012265+0000","last_became_active":"2024-09-16T07:58:34.244429+0000","last_became_peered":"2024-09-16T07:58:34.244429+0000","last_unstale":"2024-09-16T07:59:03.012265+0000","last_undegraded":"2024-09-16T07:59:03.012265+0000","last_fullsized":"2024-09-16T07:59:03.012265+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39649280,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":46400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":388,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.136281+0000","last_change":"2024-09-16T07:58:35.140321+0000","last_active":"2024-09-16T07:58:35.136281+0000","last_peered":"2024-09-16T07:58:35.136281+0000","last_clean":"2024-09-16T07:58:35.136281+0000","last_became_active":"2024-09-16T07:58:34.211954+0000","last_became_peered":"2024-09-16T07:58:34.211954+0000","last_unstale":"2024-09-16T07:58:35.136281+0000","last_undegraded":"2024-09-16T07:58:35.136281+0000","last_fullsized":"2024-09-16T07:58:35.136281+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"142'838","reported_seq":886,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.020556+0000","last_change":"2024-09-16T07:58:34.658968+0000","last_active":"2024-09-16T07:59:03.020556+0000","last_peered":"2024-09-16T07:59:03.020556+0000","last_clean":"2024-09-16T07:59:03.020556+0000","last_became_active":"2024-09-16T07:58:34.319183+0000","last_became_peered":"2024-09-16T07:58:34.319183+0000","last_unstale":"2024-09-16T07:59:03.020556+0000","last_undegraded":"2024-09-16T07:59:03.020556+0000","last_fullsized":"2024-09-16T07:59:03.020556+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41156608,"num_objects":628,"num_object_clones":0,"num_object_copies":1884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":838,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":359,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.143353+0000","last_change":"2024-09-16T07:58:35.147645+0000","last_active":"2024-09-16T07:58:35.143353+0000","last_peered":"2024-09-16T07:58:35.143353+0000","last_clean":"2024-09-16T07:58:35.143353+0000","last_became_active":"2024-09-16T07:58:34.254789+0000","last_became_peered":"2024-09-16T07:58:34.254789+0000","last_unstale":"2024-09-16T07:58:35.143353+0000","last_undegraded":"2024-09-16T07:58:35.143353+0000","last_fullsized":"2024-09-16T07:58:35.143353+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":703725592,"num_objects":10739,"num_object_clones":0,"num_object_copies":32217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12953,"num_write_kb":758081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":130957312,"data_stored":2095185968,"data_compressed":99489745,"data_compressed_allocated":130949120,"data_compressed_original":2095185920,"omap_allocated":0,"internal_metadata":0},"log_size":12954,"ondisk_log_size":12954,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122347,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91332,"kb_used_data":39476,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94280508,"statfs":{"total":96636764160,"available":96543240192,"internally_reserved":0,"allocated":40423424,"data_stored":627859089,"data_compressed":29793208,"data_compressed_allocated":39215104,"data_compressed_original":627359744,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81612,"kb_used_data":26104,"kb_used_omap":0,"kb_used_meta":55488,"kb_avail":94290228,"statfs":{"total":96636764160,"available":96553193472,"internally_reserved":0,"allocated":26730496,"data_stored":408706724,"data_compressed":19386680,"data_compressed_allocated":25518080,"data_compressed_original":408207360,"omap_allocated":0,"internal_metadata":56819712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075638,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66800,"kb_used_data":37984,"kb_used_omap":0,"kb_used_meta":28800,"kb_avail":94305040,"statfs":{"total":96636764160,"available":96568360960,"internally_reserved":0,"allocated":38895616,"data_stored":603806828,"data_compressed":28648179,"data_compressed_allocated":37707776,"data_compressed_original":603324416,"omap_allocated":0,"internal_metadata":29491200},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":140,"seq":601295421469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62900,"kb_used_data":29540,"kb_used_omap":0,"kb_used_meta":33344,"kb_avail":94308940,"statfs":{"total":96636764160,"available":96572354560,"internally_reserved":0,"allocated":30248960,"data_stored":465067660,"data_compressed":22063001,"data_compressed_allocated":29040640,"data_compressed_original":464568320,"omap_allocated":0,"internal_metadata":34144256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28712960,"data_stored":459407360,"data_compressed":21815120,"data_compressed_allocated":28712960,"data_compressed_original":459407360,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38105088,"data_stored":609681408,"data_compressed":28950043,"data_compressed_allocated":38105088,"data_compressed_original":609681408,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25427968,"data_stored":406781976,"data_compressed":19316183,"data_compressed_allocated":25423872,"data_compressed_original":406781952,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38711296,"data_stored":619315224,"data_compressed":29408399,"data_compressed_allocated":38707200,"data_compressed_original":619315200,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:59:08.428 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:59:08.428 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:59:08.429 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:59:08.429 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:59:08.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:08.584+0000 7fe846151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:08.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:08.597+0000 7fe846151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:08.644 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:59:08.644 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:59:08.644 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:59:08.644 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:59:08.644 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:59:08.644 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:59:08.644 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:59:08.644 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:59:08.644 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:59:08.644 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:59:08.645 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:59:08.645 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:59:08.648 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:59:08.649 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:59:08.649 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:59:08.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:08.811+0000 7f1ba4791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:08.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:08.829+0000 7f1ba4791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:08.898 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:59:08.898 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:59:08.898 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:59:08.898 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:59:08.898 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:59:08.898 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:59:08.898 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:59:08.898 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:59:08.898 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:59:08.898 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:59:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:59:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:59:08.902 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:59:08.902 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:59:08.902 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:59:09.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:09.062+0000 7f0498f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:09.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:09.075+0000 7f049359e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:09.154 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:59:09.154 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:59:09.154 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:59:09.154 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:59:09.154 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:59:09.154 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:59:09.154 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:59:09.154 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:59:09.154 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:59:09.154 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:59:09.155 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:59:09.155 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:59:09.158 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:59:09.159 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:59:09.159 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:59:09.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:09.309+0000 7f178dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:09.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:09.324+0000 7f178dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T07:59:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T07:59:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T07:59:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T07:59:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T07:59:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T07:59:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T07:59:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T07:59:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T07:59:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T07:59:09.533 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T07:59:09.533 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T07:59:09.536 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:59:09.537 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:59:10.202 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:59:10.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:10.487+0000 7fe824151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:10.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:10.497+0000 7fe824151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:12.875 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:59:13.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:13.035+0000 7fdce42c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:13.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:13.044+0000 7fdce42c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:14.538 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 2, 1, 0] 2024-09-16T07:59:14.538 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:59:14.538 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [3, 2, 1, 0] 2024-09-16T07:59:14.539 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T07:59:14.539 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:59:15.467 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:59:15.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:15.592+0000 7f9c76f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:15.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:15.599+0000 7f9c76f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:15.685 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-16T07:59:20.639 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T07:59:21.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-16T07:59:25.640 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [1] live_osds: [3, 2, 0] 2024-09-16T07:59:25.640 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:59:25.641 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:59:25.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:25.766+0000 7f730d26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:25.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:25.775+0000 7f730d26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:25.968 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T07:59:25.969 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T07:59:25.981 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":564,"stamp":"2024-09-16T07:59:24.476862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":704315968,"num_objects":10743,"num_object_clones":0,"num_object_copies":32229,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":13033,"num_write_kb":759188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13009,"ondisk_log_size":13009,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":302644,"kb_used_data":133104,"kb_used_omap":0,"kb_used_meta":169472,"kb_avail":377184716,"statfs":{"total":386547056640,"available":386237149184,"internally_reserved":0,"allocated":136298496,"data_stored":2105440301,"data_compressed":99891068,"data_compressed_allocated":131481600,"data_compressed_original":2103459840,"omap_allocated":0,"internal_metadata":173539328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002620"},"pg_stats":[{"pgid":"7.f","version":"142'857","reported_seq":907,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:02.975403+0000","last_change":"2024-09-16T07:58:34.700655+0000","last_active":"2024-09-16T07:59:02.975403+0000","last_peered":"2024-09-16T07:59:02.975403+0000","last_clean":"2024-09-16T07:59:02.975403+0000","last_became_active":"2024-09-16T07:58:34.322547+0000","last_became_peered":"2024-09-16T07:58:34.322547+0000","last_unstale":"2024-09-16T07:59:02.975403+0000","last_undegraded":"2024-09-16T07:59:02.975403+0000","last_fullsized":"2024-09-16T07:59:02.975403+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41222144,"num_objects":629,"num_object_clones":0,"num_object_copies":1887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":47552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"142'733","reported_seq":776,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.944012+0000","last_change":"2024-09-16T07:58:34.224845+0000","last_active":"2024-09-16T07:58:49.944012+0000","last_peered":"2024-09-16T07:58:49.944012+0000","last_clean":"2024-09-16T07:58:49.944012+0000","last_became_active":"2024-09-16T07:58:34.204525+0000","last_became_peered":"2024-09-16T07:58:34.204525+0000","last_unstale":"2024-09-16T07:58:49.944012+0000","last_undegraded":"2024-09-16T07:58:49.944012+0000","last_fullsized":"2024-09-16T07:58:49.944012+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"142'792","reported_seq":835,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.765707+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:58:58.765707+0000","last_peered":"2024-09-16T07:58:58.765707+0000","last_clean":"2024-09-16T07:58:58.765707+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:58:58.765707+0000","last_undegraded":"2024-09-16T07:58:58.765707+0000","last_fullsized":"2024-09-16T07:58:58.765707+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42401816,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":792,"num_write_kb":46017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"142'797","reported_seq":839,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.838345+0000","last_change":"2024-09-16T07:57:21.699536+0000","last_active":"2024-09-16T07:58:58.838345+0000","last_peered":"2024-09-16T07:58:58.838345+0000","last_clean":"2024-09-16T07:58:58.838345+0000","last_became_active":"2024-09-16T07:57:21.694571+0000","last_became_peered":"2024-09-16T07:57:21.694571+0000","last_unstale":"2024-09-16T07:58:58.838345+0000","last_undegraded":"2024-09-16T07:58:58.838345+0000","last_fullsized":"2024-09-16T07:58:58.838345+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43712512,"num_objects":667,"num_object_clones":0,"num_object_copies":2001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":46848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"142'811","reported_seq":861,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.133650+0000","last_change":"2024-09-16T07:58:34.777673+0000","last_active":"2024-09-16T07:59:03.133650+0000","last_peered":"2024-09-16T07:59:03.133650+0000","last_clean":"2024-09-16T07:59:03.133650+0000","last_became_active":"2024-09-16T07:58:34.331701+0000","last_became_peered":"2024-09-16T07:58:34.331701+0000","last_unstale":"2024-09-16T07:59:03.133650+0000","last_undegraded":"2024-09-16T07:59:03.133650+0000","last_fullsized":"2024-09-16T07:59:03.133650+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38731776,"num_objects":591,"num_object_clones":0,"num_object_copies":1773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":44864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"142'865","reported_seq":913,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.041876+0000","last_change":"2024-09-16T07:58:34.501653+0000","last_active":"2024-09-16T07:59:03.041876+0000","last_peered":"2024-09-16T07:59:03.041876+0000","last_clean":"2024-09-16T07:59:03.041876+0000","last_became_active":"2024-09-16T07:58:34.288196+0000","last_became_peered":"2024-09-16T07:58:34.288196+0000","last_unstale":"2024-09-16T07:59:03.041876+0000","last_undegraded":"2024-09-16T07:59:03.041876+0000","last_fullsized":"2024-09-16T07:59:03.041876+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":865,"log_dups_size":0,"ondisk_log_size":865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41091072,"num_objects":627,"num_object_clones":0,"num_object_copies":1881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":865,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"142'874","reported_seq":916,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.829634+0000","last_change":"2024-09-16T07:57:21.678743+0000","last_active":"2024-09-16T07:58:58.829634+0000","last_peered":"2024-09-16T07:58:58.829634+0000","last_clean":"2024-09-16T07:58:58.829634+0000","last_became_active":"2024-09-16T07:57:21.672854+0000","last_became_peered":"2024-09-16T07:57:21.672854+0000","last_unstale":"2024-09-16T07:58:58.829634+0000","last_undegraded":"2024-09-16T07:58:58.829634+0000","last_fullsized":"2024-09-16T07:58:58.829634+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":874,"log_dups_size":0,"ondisk_log_size":874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":736,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":874,"num_write_kb":51520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"142'704","reported_seq":754,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:50.032986+0000","last_change":"2024-09-16T07:58:34.626925+0000","last_active":"2024-09-16T07:58:50.032986+0000","last_peered":"2024-09-16T07:58:50.032986+0000","last_clean":"2024-09-16T07:58:50.032986+0000","last_became_active":"2024-09-16T07:58:34.283717+0000","last_became_peered":"2024-09-16T07:58:34.283717+0000","last_unstale":"2024-09-16T07:58:50.032986+0000","last_undegraded":"2024-09-16T07:58:50.032986+0000","last_fullsized":"2024-09-16T07:58:50.032986+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":704,"num_object_clones":0,"num_object_copies":2112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"142'873","reported_seq":916,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.141595+0000","last_change":"2024-09-16T07:58:34.314895+0000","last_active":"2024-09-16T07:59:03.141595+0000","last_peered":"2024-09-16T07:59:03.141595+0000","last_clean":"2024-09-16T07:59:03.141595+0000","last_became_active":"2024-09-16T07:58:34.299661+0000","last_became_peered":"2024-09-16T07:58:34.299661+0000","last_unstale":"2024-09-16T07:59:03.141595+0000","last_undegraded":"2024-09-16T07:59:03.141595+0000","last_fullsized":"2024-09-16T07:59:03.141595+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42270720,"num_objects":645,"num_object_clones":0,"num_object_copies":1935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":48576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":428,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.127605+0000","last_change":"2024-09-16T07:58:34.277869+0000","last_active":"2024-09-16T07:58:35.127605+0000","last_peered":"2024-09-16T07:58:35.127605+0000","last_clean":"2024-09-16T07:58:35.127605+0000","last_became_active":"2024-09-16T07:58:34.266892+0000","last_became_peered":"2024-09-16T07:58:34.266892+0000","last_unstale":"2024-09-16T07:58:35.127605+0000","last_undegraded":"2024-09-16T07:58:35.127605+0000","last_fullsized":"2024-09-16T07:58:35.127605+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":364,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.140808+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:35.140808+0000","last_peered":"2024-09-16T07:58:35.140808+0000","last_clean":"2024-09-16T07:58:35.140808+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:58:35.140808+0000","last_undegraded":"2024-09-16T07:58:35.140808+0000","last_fullsized":"2024-09-16T07:58:35.140808+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"142'721","reported_seq":763,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.889219+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:49.889219+0000","last_peered":"2024-09-16T07:58:49.889219+0000","last_clean":"2024-09-16T07:58:49.889219+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:58:49.889219+0000","last_undegraded":"2024-09-16T07:58:49.889219+0000","last_fullsized":"2024-09-16T07:58:49.889219+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.116767+0000","last_change":"2024-09-16T07:58:35.121289+0000","last_active":"2024-09-16T07:58:35.116767+0000","last_peered":"2024-09-16T07:58:35.116767+0000","last_clean":"2024-09-16T07:58:35.116767+0000","last_became_active":"2024-09-16T07:58:34.303916+0000","last_became_peered":"2024-09-16T07:58:34.303916+0000","last_unstale":"2024-09-16T07:58:35.116767+0000","last_undegraded":"2024-09-16T07:58:35.116767+0000","last_fullsized":"2024-09-16T07:58:35.116767+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"142'900","reported_seq":948,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.693399+0000","last_change":"2024-09-16T07:58:34.411825+0000","last_active":"2024-09-16T07:58:58.693399+0000","last_peered":"2024-09-16T07:58:58.693399+0000","last_clean":"2024-09-16T07:58:58.693399+0000","last_became_active":"2024-09-16T07:58:34.222465+0000","last_became_peered":"2024-09-16T07:58:34.222465+0000","last_unstale":"2024-09-16T07:58:58.693399+0000","last_undegraded":"2024-09-16T07:58:58.693399+0000","last_fullsized":"2024-09-16T07:58:58.693399+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48758784,"num_objects":744,"num_object_clones":0,"num_object_copies":2232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":900,"num_write_kb":52608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":345,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.147860+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:35.147860+0000","last_peered":"2024-09-16T07:58:35.147860+0000","last_clean":"2024-09-16T07:58:35.147860+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:58:35.147860+0000","last_undegraded":"2024-09-16T07:58:35.147860+0000","last_fullsized":"2024-09-16T07:58:35.147860+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"142'717","reported_seq":773,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:49.741569+0000","last_change":"2024-09-16T07:58:34.475137+0000","last_active":"2024-09-16T07:58:49.741569+0000","last_peered":"2024-09-16T07:58:49.741569+0000","last_clean":"2024-09-16T07:58:49.741569+0000","last_became_active":"2024-09-16T07:58:34.211141+0000","last_became_peered":"2024-09-16T07:58:34.211141+0000","last_unstale":"2024-09-16T07:58:49.741569+0000","last_undegraded":"2024-09-16T07:58:49.741569+0000","last_fullsized":"2024-09-16T07:58:49.741569+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46989312,"num_objects":717,"num_object_clones":0,"num_object_copies":2151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":45888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":205,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.107609+0000","last_change":"2024-09-16T07:58:35.120264+0000","last_active":"2024-09-16T07:58:35.107609+0000","last_peered":"2024-09-16T07:58:35.107609+0000","last_clean":"2024-09-16T07:58:35.107609+0000","last_became_active":"2024-09-16T07:58:34.238282+0000","last_became_peered":"2024-09-16T07:58:34.238282+0000","last_unstale":"2024-09-16T07:58:35.107609+0000","last_undegraded":"2024-09-16T07:58:35.107609+0000","last_fullsized":"2024-09-16T07:58:35.107609+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"142'835","reported_seq":873,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:02.575098+0000","last_change":"2024-09-16T07:58:34.343709+0000","last_active":"2024-09-16T07:59:02.575098+0000","last_peered":"2024-09-16T07:59:02.575098+0000","last_clean":"2024-09-16T07:59:02.575098+0000","last_became_active":"2024-09-16T07:58:34.323063+0000","last_became_peered":"2024-09-16T07:58:34.323063+0000","last_unstale":"2024-09-16T07:59:02.575098+0000","last_undegraded":"2024-09-16T07:59:02.575098+0000","last_fullsized":"2024-09-16T07:59:02.575098+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42467328,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":834,"num_write_kb":47424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":388,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.127435+0000","last_change":"2024-09-16T07:58:35.139399+0000","last_active":"2024-09-16T07:58:35.127435+0000","last_peered":"2024-09-16T07:58:35.127435+0000","last_clean":"2024-09-16T07:58:35.127435+0000","last_became_active":"2024-09-16T07:58:34.217256+0000","last_became_peered":"2024-09-16T07:58:34.217256+0000","last_unstale":"2024-09-16T07:58:35.127435+0000","last_undegraded":"2024-09-16T07:58:35.127435+0000","last_fullsized":"2024-09-16T07:58:35.127435+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"142'792","reported_seq":834,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:58.312837+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:58:58.312837+0000","last_peered":"2024-09-16T07:58:58.312837+0000","last_clean":"2024-09-16T07:58:58.312837+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:58:58.312837+0000","last_undegraded":"2024-09-16T07:58:58.312837+0000","last_fullsized":"2024-09-16T07:58:58.312837+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45613056,"num_objects":696,"num_object_clones":0,"num_object_copies":2088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":47616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":364,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.120963+0000","last_change":"2024-09-16T07:58:35.143177+0000","last_active":"2024-09-16T07:58:35.120963+0000","last_peered":"2024-09-16T07:58:35.120963+0000","last_clean":"2024-09-16T07:58:35.120963+0000","last_became_active":"2024-09-16T07:58:34.232114+0000","last_became_peered":"2024-09-16T07:58:34.232114+0000","last_unstale":"2024-09-16T07:58:35.120963+0000","last_undegraded":"2024-09-16T07:58:35.120963+0000","last_fullsized":"2024-09-16T07:58:35.120963+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"142'845","reported_seq":895,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.012265+0000","last_change":"2024-09-16T07:58:34.450488+0000","last_active":"2024-09-16T07:59:03.012265+0000","last_peered":"2024-09-16T07:59:03.012265+0000","last_clean":"2024-09-16T07:59:03.012265+0000","last_became_active":"2024-09-16T07:58:34.244429+0000","last_became_peered":"2024-09-16T07:58:34.244429+0000","last_unstale":"2024-09-16T07:59:03.012265+0000","last_undegraded":"2024-09-16T07:59:03.012265+0000","last_fullsized":"2024-09-16T07:59:03.012265+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39649280,"num_objects":605,"num_object_clones":0,"num_object_copies":1815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":46400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":388,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.136281+0000","last_change":"2024-09-16T07:58:35.140321+0000","last_active":"2024-09-16T07:58:35.136281+0000","last_peered":"2024-09-16T07:58:35.136281+0000","last_clean":"2024-09-16T07:58:35.136281+0000","last_became_active":"2024-09-16T07:58:34.211954+0000","last_became_peered":"2024-09-16T07:58:34.211954+0000","last_unstale":"2024-09-16T07:58:35.136281+0000","last_undegraded":"2024-09-16T07:58:35.136281+0000","last_fullsized":"2024-09-16T07:58:35.136281+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"142'838","reported_seq":886,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:03.020556+0000","last_change":"2024-09-16T07:58:34.658968+0000","last_active":"2024-09-16T07:59:03.020556+0000","last_peered":"2024-09-16T07:59:03.020556+0000","last_clean":"2024-09-16T07:59:03.020556+0000","last_became_active":"2024-09-16T07:58:34.319183+0000","last_became_peered":"2024-09-16T07:58:34.319183+0000","last_unstale":"2024-09-16T07:59:03.020556+0000","last_undegraded":"2024-09-16T07:59:03.020556+0000","last_fullsized":"2024-09-16T07:59:03.020556+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41156608,"num_objects":628,"num_object_clones":0,"num_object_copies":1884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":838,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":359,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:58:35.143353+0000","last_change":"2024-09-16T07:58:35.147645+0000","last_active":"2024-09-16T07:58:35.143353+0000","last_peered":"2024-09-16T07:58:35.143353+0000","last_clean":"2024-09-16T07:58:35.143353+0000","last_became_active":"2024-09-16T07:58:34.254789+0000","last_became_peered":"2024-09-16T07:58:34.254789+0000","last_unstale":"2024-09-16T07:58:35.143353+0000","last_undegraded":"2024-09-16T07:58:35.143353+0000","last_fullsized":"2024-09-16T07:58:35.143353+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":703725592,"num_objects":10739,"num_object_clones":0,"num_object_copies":32217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12953,"num_write_kb":758081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":130957312,"data_stored":2095185968,"data_compressed":99489745,"data_compressed_allocated":130949120,"data_compressed_original":2095185920,"omap_allocated":0,"internal_metadata":0},"log_size":12954,"ondisk_log_size":12954,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122347,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91332,"kb_used_data":39476,"kb_used_omap":0,"kb_used_meta":51840,"kb_avail":94280508,"statfs":{"total":96636764160,"available":96543240192,"internally_reserved":0,"allocated":40423424,"data_stored":627859089,"data_compressed":29793208,"data_compressed_allocated":39215104,"data_compressed_original":627359744,"omap_allocated":0,"internal_metadata":53084160},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500822,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81612,"kb_used_data":26104,"kb_used_omap":0,"kb_used_meta":55488,"kb_avail":94290228,"statfs":{"total":96636764160,"available":96553193472,"internally_reserved":0,"allocated":26730496,"data_stored":408706724,"data_compressed":19386680,"data_compressed_allocated":25518080,"data_compressed_original":408207360,"omap_allocated":0,"internal_metadata":56819712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075638,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66800,"kb_used_data":37984,"kb_used_omap":0,"kb_used_meta":28800,"kb_avail":94305040,"statfs":{"total":96636764160,"available":96568360960,"internally_reserved":0,"allocated":38895616,"data_stored":603806828,"data_compressed":28648179,"data_compressed_allocated":37707776,"data_compressed_original":603324416,"omap_allocated":0,"internal_metadata":29491200},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":140,"seq":601295421469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62900,"kb_used_data":29540,"kb_used_omap":0,"kb_used_meta":33344,"kb_avail":94308940,"statfs":{"total":96636764160,"available":96572354560,"internally_reserved":0,"allocated":30248960,"data_stored":465067660,"data_compressed":22063001,"data_compressed_allocated":29040640,"data_compressed_original":464568320,"omap_allocated":0,"internal_metadata":34144256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28712960,"data_stored":459407360,"data_compressed":21815120,"data_compressed_allocated":28712960,"data_compressed_original":459407360,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38105088,"data_stored":609681408,"data_compressed":28950043,"data_compressed_allocated":38105088,"data_compressed_original":609681408,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25427968,"data_stored":406781976,"data_compressed":19316183,"data_compressed_allocated":25423872,"data_compressed_original":406781952,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38711296,"data_stored":619315224,"data_compressed":29408399,"data_compressed_allocated":38707200,"data_compressed_original":619315200,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:59:30.983 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [1] live_osds: [3, 2, 0] 2024-09-16T07:59:30.983 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:59:30.984 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [3, 2, 0] 2024-09-16T07:59:30.984 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T07:59:30.984 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:59:32.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-16T07:59:37.085 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T07:59:37.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-16T07:59:42.087 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [1, 2] live_osds: [3, 0] 2024-09-16T07:59:42.087 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T07:59:42.087 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-09-16T07:59:42.087 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T07:59:42.088 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T07:59:42.091 INFO:tasks.ceph.osd.1:Started 2024-09-16T07:59:42.091 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T07:59:42.205 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:59:42.209 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:59:42.209 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-16T07:59:45.090 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-16T07:59:47.210 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T07:59:47.313 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:59:47.316 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:59:47.316 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-16T07:59:52.317 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T07:59:52.419 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:59:52.422 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:59:52.423 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-16T07:59:56.099 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:59:56.235 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:59:56.235 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T07:59:57.424 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T07:59:57.528 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T07:59:57.531 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:59:57.531 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-16T07:59:58.237 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:59:58.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:58.351+0000 7f5404351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:58.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T07:59:58.357+0000 7f5404351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:59:58.387 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-16T07:59:58.387 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T07:59:58.419 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T07:59:58.420 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:00:00.420 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:00:00.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:00.552+0000 7f34b329c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:00.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:00.560+0000 7f34b329c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:00.637 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T08:00:00.662 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:00:00.662 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:00:02.533 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T08:00:02.664 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:00:02.751 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T08:00:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [ 2024-09-16T08:00:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "replicated_request", 2024-09-16T08:00:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 352, 2024-09-16T08:00:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "RepRequest": { 2024-09-16T08:00:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5431.0:16317", 2024-09-16T08:00:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.c", 2024-09-16T08:00:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "map_epoch": 149, 2024-09-16T08:00:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "min_epoch": 147, 2024-09-16T08:00:02.752 INFO:teuthology.orchestra.run.smithi003.stdout: "oid": "7:32a3b99a:::benchmark_data_smithi003_49564_object4351:head", 2024-09-16T08:00:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "3" 2024-09-16T08:00:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 36, 2024-09-16T08:00:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.310281+0000" 2024-09-16T08:00:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.753 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.310307+0000" 2024-09-16T08:00:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.311209+0000" 2024-09-16T08:00:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.754 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.311591+0000" 2024-09-16T08:00:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.755 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.379134+0000" 2024-09-16T08:00:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.379457+0000" 2024-09-16T08:00:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.756 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.346793+0000" 2024-09-16T08:00:02.757 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.380095+0000" 2024-09-16T08:00:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.758 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.381230+0000" 2024-09-16T08:00:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.759 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.381556+0000" 2024-09-16T08:00:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.760 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.344682+0000" 2024-09-16T08:00:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.761 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.762 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.762 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.762 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.762 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.762 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.762 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.762 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.762 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.762 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.762 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.762 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.762 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.762 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.763 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.763 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.763 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.763 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.763 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.763 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.763 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.763 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.763 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.763 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.763 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.763 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.763 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.763 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.764 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.764 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.764 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.764 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.764 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.764 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.764 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.764 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.764 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.764 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.764 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.765 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.765 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.765 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.765 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.765 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.765 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.765 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.765 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.765 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.765 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.765 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.765 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.765 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.766 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 54, 2024-09-16T08:00:02.766 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.766 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.766 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.766 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.330700+0000" 2024-09-16T08:00:02.766 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.766 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.766 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.766 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.330711+0000" 2024-09-16T08:00:02.766 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.766 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.766 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.766 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.766 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.767 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.767 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.767 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.404706+0000" 2024-09-16T08:00:02.767 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.767 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.767 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.767 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.767 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.767 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.767 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.767 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.767 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.767 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.768 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.768 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.768 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.768 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.768 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.768 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.407929+0000" 2024-09-16T08:00:02.768 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.768 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.768 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.768 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.768 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.768 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.768 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.769 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.409113+0000" 2024-09-16T08:00:02.769 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.769 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.769 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.769 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.769 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.769 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.769 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.769 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.769 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.769 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.769 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.769 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.770 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.770 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.770 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.770 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.521014+0000" 2024-09-16T08:00:02.770 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.770 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.770 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.770 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.410505+0000" 2024-09-16T08:00:02.770 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.770 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.770 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.771 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.771 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.771 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.771 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.771 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.771 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.771 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.771 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.771 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.771 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.771 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.771 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.771 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:00.411828+0000" 2024-09-16T08:00:02.772 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.772 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.772 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.772 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.772 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.772 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.772 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.772 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.772 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.772 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.772 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.772 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.772 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.773 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.773 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.773 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.773 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.773 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.773 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.773 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.324045+0000" 2024-09-16T08:00:02.773 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.773 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.773 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.773 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.773 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.773 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.774 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.774 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.774 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.774 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.774 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.774 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.345957+0000" 2024-09-16T08:00:02.774 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.774 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.774 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.774 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.774 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.774 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.774 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.774 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.775 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.776 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.776 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.361438+0000" 2024-09-16T08:00:02.776 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.776 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.776 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.776 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.776 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.776 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.776 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.776 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.776 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.776 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.777 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.777 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.777 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.777 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.777 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.777 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.520294+0000" 2024-09-16T08:00:02.777 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.777 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.777 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.777 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.777 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.777 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.777 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.778 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.778 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.778 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.778 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.778 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.778 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.778 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 140, 2024-09-16T08:00:02.778 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.778 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.778 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.779 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.471991+0000" 2024-09-16T08:00:02.779 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.779 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.779 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.779 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.472018+0000" 2024-09-16T08:00:02.779 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.779 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.779 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.779 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.779 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.779 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.779 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.780 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.472187+0000" 2024-09-16T08:00:02.780 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.780 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.780 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.780 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.780 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.780 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.780 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.780 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.780 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.780 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.780 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.780 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.781 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.781 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.781 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.781 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.472582+0000" 2024-09-16T08:00:02.781 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.781 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.781 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.781 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.781 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.781 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.781 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.781 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.473142+0000" 2024-09-16T08:00:02.781 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.782 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.782 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.782 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.782 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.782 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.782 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.782 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.782 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.782 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.782 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.782 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.782 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.782 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.783 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.783 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.600291+0000" 2024-09-16T08:00:02.783 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.783 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.783 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.783 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.473866+0000" 2024-09-16T08:00:02.783 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.783 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.783 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.783 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.783 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.783 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.783 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.784 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.784 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.784 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.784 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.784 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.784 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.784 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.784 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.784 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.475399+0000" 2024-09-16T08:00:02.784 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.784 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.784 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.784 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.785 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.785 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.785 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.785 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.785 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.785 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.785 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.785 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.785 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.785 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.785 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.785 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.785 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.786 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.786 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.786 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.786 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.786 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.786 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.786 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.786 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.786 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.786 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.786 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.786 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.786 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.787 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.787 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.478815+0000" 2024-09-16T08:00:02.787 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.787 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.787 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.787 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.787 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.787 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.787 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.787 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.787 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.787 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.787 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.487446+0000" 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.788 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.789 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.789 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.789 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.789 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.789 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.789 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.789 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.789 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.789 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.789 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.789 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.789 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.789 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.790 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.597207+0000" 2024-09-16T08:00:02.790 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.790 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.790 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.790 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.790 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.790 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.790 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.790 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.790 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.790 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.790 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.790 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.790 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.791 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 209, 2024-09-16T08:00:02.791 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.791 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.791 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.791 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.802405+0000" 2024-09-16T08:00:02.791 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.791 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.791 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.791 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.802422+0000" 2024-09-16T08:00:02.791 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.791 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.791 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.791 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.791 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.792 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.792 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.792 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.802561+0000" 2024-09-16T08:00:02.792 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.792 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.792 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.792 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.792 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.792 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.792 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.792 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.792 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.792 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.792 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.793 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.793 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.793 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.793 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.793 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.802840+0000" 2024-09-16T08:00:02.793 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.793 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.793 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.793 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.793 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.793 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.793 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.794 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.803043+0000" 2024-09-16T08:00:02.794 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.794 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.794 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.794 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.794 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.794 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.794 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.794 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.794 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.794 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.794 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.794 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.848194+0000" 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.803677+0000" 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.795 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.796 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.796 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.796 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.796 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.796 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.796 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.796 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.796 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.796 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.803877+0000" 2024-09-16T08:00:02.796 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.796 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.796 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.797 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.797 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.797 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.797 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.797 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.797 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.797 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.797 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.797 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.797 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.797 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.797 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.797 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.797 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.798 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.804399+0000" 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.799 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.800 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.800 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.800 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.800 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.800 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.800 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.800 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.800 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.800 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.806945+0000" 2024-09-16T08:00:02.800 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.800 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.800 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.801 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.801 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.801 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.801 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.801 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.801 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.801 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.801 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.801 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.801 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.801 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.801 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.801 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.847305+0000" 2024-09-16T08:00:02.802 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.802 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.802 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.802 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.802 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.802 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.802 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.802 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.802 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.802 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.802 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.802 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.802 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.803 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 237, 2024-09-16T08:00:02.803 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.803 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.803 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.803 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.990616+0000" 2024-09-16T08:00:02.803 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.803 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.803 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.803 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.990633+0000" 2024-09-16T08:00:02.803 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.803 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.803 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.803 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.803 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.804 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.804 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.804 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.992871+0000" 2024-09-16T08:00:02.804 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.804 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.804 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.804 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.804 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.804 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.804 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.804 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.804 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.804 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.993307+0000" 2024-09-16T08:00:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.993892+0000" 2024-09-16T08:00:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.072062+0000" 2024-09-16T08:00:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.994677+0000" 2024-09-16T08:00:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.807 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.808 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.808 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.808 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.808 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.808 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.808 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.808 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.808 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.808 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.808 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.808 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.994915+0000" 2024-09-16T08:00:02.808 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.808 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.809 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.809 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.809 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.809 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.809 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.809 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.809 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.809 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.809 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.809 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.809 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.809 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.809 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.810 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.810 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.810 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.810 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.810 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.810 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.810 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.810 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.810 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.811 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.811 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.811 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.811 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.811 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.811 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.811 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.811 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.998822+0000" 2024-09-16T08:00:02.811 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.811 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.811 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.811 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.811 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.812 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.812 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.812 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.812 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.812 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.812 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.812 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.812 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.812 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.812 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.812 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.812 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.813 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.813 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.813 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.813 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.813 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.813 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.813 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.006370+0000" 2024-09-16T08:00:02.813 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.813 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.813 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.813 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.813 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.814 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.814 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.814 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.814 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.814 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.814 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.814 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.814 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.814 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.814 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.814 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.070750+0000" 2024-09-16T08:00:02.814 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.814 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.815 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.815 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.815 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.815 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.815 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.815 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.815 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.815 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.815 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.815 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.815 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.815 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 259, 2024-09-16T08:00:02.815 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.816 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.816 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.816 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.107848+0000" 2024-09-16T08:00:02.816 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.816 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.816 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.816 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.107865+0000" 2024-09-16T08:00:02.816 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.816 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.816 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.108089+0000" 2024-09-16T08:00:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.818 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.818 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.818 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.818 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.818 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.818 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.818 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.818 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.818 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.108701+0000" 2024-09-16T08:00:02.818 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.818 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.818 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.818 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.819 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.819 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.819 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.819 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.108862+0000" 2024-09-16T08:00:02.819 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.819 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.819 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.819 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.819 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.819 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.819 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.819 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.819 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.820 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.820 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.820 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.820 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.820 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.820 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.820 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.209957+0000" 2024-09-16T08:00:02.820 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.820 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.821 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.821 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.109453+0000" 2024-09-16T08:00:02.821 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.821 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.821 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.821 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.821 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.821 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.821 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.821 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.821 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.821 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.821 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.822 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.822 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.822 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.822 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.822 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.109657+0000" 2024-09-16T08:00:02.822 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.822 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.822 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.822 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.822 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.822 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.822 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.822 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.823 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.823 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.823 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.823 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.823 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.823 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.823 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.823 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.823 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.823 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.823 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.823 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.824 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.824 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.824 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.824 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.824 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.824 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.824 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.824 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.824 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.824 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.824 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.824 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.110612+0000" 2024-09-16T08:00:02.824 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.825 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.825 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.825 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.825 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.825 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.825 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.825 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.825 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.825 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.825 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.825 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.825 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.825 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.825 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.826 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.826 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.826 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.826 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.826 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.826 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.826 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.826 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.826 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.115241+0000" 2024-09-16T08:00:02.826 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.826 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.826 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.826 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.827 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.827 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.827 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.827 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.827 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.827 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.827 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.827 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.827 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.827 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.827 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.827 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.208727+0000" 2024-09-16T08:00:02.827 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.828 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.828 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.828 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.828 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.828 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.828 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.828 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.828 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.828 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.828 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.828 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.828 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.828 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 299, 2024-09-16T08:00:02.829 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.829 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.829 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.829 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.309867+0000" 2024-09-16T08:00:02.829 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.829 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.829 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.829 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.309884+0000" 2024-09-16T08:00:02.829 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.829 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.829 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.829 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.829 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.830 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.830 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.830 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.310146+0000" 2024-09-16T08:00:02.830 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.830 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.830 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.830 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.830 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.830 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.830 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.830 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.830 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.830 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.831 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.831 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.831 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.831 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.831 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.831 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.310256+0000" 2024-09-16T08:00:02.831 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.831 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.831 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.831 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.831 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.831 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.831 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.831 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.310402+0000" 2024-09-16T08:00:02.832 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.832 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.832 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.832 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.832 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.832 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.832 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.832 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.832 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.832 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.832 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.832 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.832 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.833 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.833 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.833 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.392178+0000" 2024-09-16T08:00:02.833 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.833 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.833 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.833 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.311209+0000" 2024-09-16T08:00:02.833 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.833 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.833 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.833 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.833 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.833 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.834 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.834 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.834 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.834 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.834 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.834 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.834 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.834 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.834 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.834 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.311406+0000" 2024-09-16T08:00:02.834 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.834 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.834 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.835 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.835 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.835 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.835 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.835 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.835 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.835 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.835 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.835 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.835 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.835 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.835 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.835 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.835 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.836 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.836 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.836 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.836 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.836 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.836 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.836 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.836 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.836 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.836 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.836 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.836 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.836 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.312654+0000" 2024-09-16T08:00:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.837 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.838 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.838 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.838 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.838 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.838 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.838 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.838 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.838 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.838 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.838 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.838 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.838 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.320774+0000" 2024-09-16T08:00:02.839 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.839 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.839 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.839 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.839 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.839 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.839 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.839 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.839 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.839 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.839 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.839 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.839 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.840 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.840 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.840 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.391413+0000" 2024-09-16T08:00:02.840 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.840 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.840 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.840 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.840 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.840 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.840 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.840 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.840 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.841 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.841 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.841 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.841 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.841 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 310, 2024-09-16T08:00:02.841 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.841 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.841 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.841 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.370635+0000" 2024-09-16T08:00:02.841 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.841 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.841 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.841 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.370644+0000" 2024-09-16T08:00:02.842 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.842 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.842 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.842 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.842 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.842 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.842 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.842 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.372790+0000" 2024-09-16T08:00:02.842 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.842 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.842 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.842 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.842 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.843 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.843 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.843 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.843 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.843 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.843 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.843 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.843 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.843 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.843 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.843 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.373285+0000" 2024-09-16T08:00:02.843 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.843 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.844 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.844 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.844 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.844 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.844 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.844 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.373416+0000" 2024-09-16T08:00:02.844 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.844 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.844 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.844 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.844 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.844 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.844 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.845 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.845 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.845 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.845 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.845 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.845 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.845 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.845 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.845 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.452011+0000" 2024-09-16T08:00:02.845 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.845 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.845 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.845 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.373829+0000" 2024-09-16T08:00:02.846 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.846 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.846 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.846 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.846 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.846 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.846 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.846 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.846 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.846 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.846 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.846 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.846 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.847 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.847 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.847 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.374572+0000" 2024-09-16T08:00:02.847 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.847 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.847 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.847 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.847 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.847 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.847 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.847 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.847 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.847 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.848 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.848 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.848 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.848 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.848 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.848 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.848 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.848 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.848 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.848 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.848 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.848 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.848 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.849 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.849 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.849 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.849 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.849 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.849 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.849 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.849 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.849 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.374996+0000" 2024-09-16T08:00:02.849 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.849 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.849 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.849 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.850 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.850 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.850 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.850 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.850 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.850 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.850 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.850 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.850 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.850 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.851 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.851 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.851 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.851 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.851 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.851 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.377035+0000" 2024-09-16T08:00:02.851 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.851 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.851 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.851 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.851 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.851 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.852 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.852 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.852 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.852 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.852 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.852 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.852 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.852 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.450588+0000" 2024-09-16T08:00:02.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.852 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.852 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.853 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.853 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.853 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.853 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.853 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.853 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.853 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.853 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.853 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.853 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.853 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 316, 2024-09-16T08:00:02.853 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.853 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.853 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.854 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.424286+0000" 2024-09-16T08:00:02.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.854 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.854 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.854 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.424307+0000" 2024-09-16T08:00:02.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.854 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.854 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.854 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.854 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.854 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.854 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.425230+0000" 2024-09-16T08:00:02.855 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.855 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.855 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.855 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.855 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.855 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.855 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.855 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.855 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.855 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.855 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.855 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.855 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.855 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.856 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.856 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.425645+0000" 2024-09-16T08:00:02.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.856 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.856 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.856 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.856 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.856 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.856 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.426133+0000" 2024-09-16T08:00:02.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.856 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.856 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.857 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.857 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.857 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.857 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.857 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.857 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.857 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.857 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.857 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.857 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.857 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.857 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.857 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.468638+0000" 2024-09-16T08:00:02.858 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.858 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.858 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.858 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.426616+0000" 2024-09-16T08:00:02.858 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.858 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.858 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.858 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.858 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.858 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.858 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.858 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.858 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.858 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.859 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.859 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.859 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.859 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.859 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.859 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.427384+0000" 2024-09-16T08:00:02.859 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.859 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.859 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.859 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.859 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.859 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.859 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.860 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.860 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.860 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.860 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.860 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.860 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.860 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.860 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.860 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.860 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.861 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.861 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.861 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.861 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.861 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.861 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.861 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.861 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.861 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.861 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.861 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.861 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.427871+0000" 2024-09-16T08:00:02.861 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.861 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.862 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.862 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.862 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.862 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.862 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.862 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.862 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.862 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.862 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.862 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.862 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.862 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.862 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.863 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.863 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.863 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.863 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.863 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.863 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.863 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.863 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.863 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.431776+0000" 2024-09-16T08:00:02.863 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.863 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.863 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.863 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.864 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.864 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.864 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.864 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.864 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.864 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.864 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.864 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.864 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.864 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.864 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.864 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.467284+0000" 2024-09-16T08:00:02.864 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.865 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.865 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.865 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.865 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.865 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.865 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.865 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.865 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.865 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.865 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.865 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.865 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.865 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 324, 2024-09-16T08:00:02.865 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.866 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.866 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.866 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.468324+0000" 2024-09-16T08:00:02.866 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.866 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.866 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.866 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.468338+0000" 2024-09-16T08:00:02.866 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.866 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.866 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.866 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.866 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.866 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.867 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.867 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.468700+0000" 2024-09-16T08:00:02.867 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.867 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.867 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.867 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.867 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.867 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.867 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.867 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.867 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.867 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.867 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.868 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.868 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.868 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.868 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.469588+0000" 2024-09-16T08:00:02.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.868 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.868 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.868 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.868 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.868 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.868 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.469835+0000" 2024-09-16T08:00:02.869 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.869 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.869 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.869 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.869 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.869 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.869 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.869 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.869 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.869 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.869 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.869 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.869 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.869 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.870 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.870 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.554272+0000" 2024-09-16T08:00:02.870 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.870 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.870 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.870 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.470461+0000" 2024-09-16T08:00:02.870 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.870 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.870 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.870 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.870 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.870 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.870 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.871 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.871 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.871 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.871 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.871 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.871 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.871 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.871 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.871 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.470881+0000" 2024-09-16T08:00:02.871 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.871 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.871 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.871 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.872 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.872 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.872 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.872 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.872 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.872 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.872 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.872 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.872 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.873 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.873 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.873 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.873 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.873 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.873 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.873 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.873 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.873 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.873 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.873 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.873 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.873 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.874 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.874 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.471730+0000" 2024-09-16T08:00:02.874 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.874 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.874 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.874 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.874 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.874 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.874 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.874 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.874 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.874 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.875 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.875 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.875 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.875 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.875 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.875 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.875 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.875 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.875 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.875 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.875 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.875 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.875 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.875 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.486142+0000" 2024-09-16T08:00:02.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.876 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.876 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.876 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.876 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.876 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.876 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.876 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.876 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.876 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.877 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.877 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.878 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.553101+0000" 2024-09-16T08:00:02.878 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.878 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.878 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.878 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.878 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.878 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.878 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.878 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.878 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.879 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.879 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.879 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.879 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.879 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 339, 2024-09-16T08:00:02.879 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.879 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.879 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.879 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.560296+0000" 2024-09-16T08:00:02.879 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.879 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.879 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.879 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.560323+0000" 2024-09-16T08:00:02.879 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.880 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.880 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.880 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.880 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.880 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.880 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.880 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.560694+0000" 2024-09-16T08:00:02.880 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.880 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.880 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.880 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.880 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.880 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.881 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.881 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.881 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.881 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.881 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.881 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.881 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.881 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.881 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.881 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.561214+0000" 2024-09-16T08:00:02.881 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.881 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.881 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.881 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.882 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.882 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.882 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.882 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.562639+0000" 2024-09-16T08:00:02.882 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.882 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.882 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.882 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.882 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.882 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.882 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.882 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.882 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.883 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.883 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.883 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.883 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.883 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.883 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.883 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.630228+0000" 2024-09-16T08:00:02.883 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.883 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.883 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.883 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.563202+0000" 2024-09-16T08:00:02.883 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.883 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.884 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.884 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.884 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.884 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.884 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.884 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.884 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.884 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.884 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.884 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.884 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.884 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.884 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.563935+0000" 2024-09-16T08:00:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.885 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.886 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.886 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.886 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.886 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.886 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.886 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.886 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.886 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.886 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.886 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.886 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.886 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.886 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.886 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.887 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.887 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.887 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.887 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.887 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.564761+0000" 2024-09-16T08:00:02.887 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.887 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.887 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.887 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.887 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.887 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.887 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.887 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.888 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.888 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.888 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.888 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.888 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.888 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.888 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.888 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.888 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.888 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.888 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.888 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.889 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.889 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.889 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.889 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.573232+0000" 2024-09-16T08:00:02.889 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.889 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.889 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.889 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.889 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.889 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.889 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.889 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.889 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.890 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.890 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.890 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.890 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.890 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.890 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.890 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.629313+0000" 2024-09-16T08:00:02.890 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.890 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.890 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.890 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.890 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.890 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.891 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.891 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.891 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.891 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.891 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.891 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.891 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.891 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 341, 2024-09-16T08:00:02.891 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.891 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.891 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.891 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.569086+0000" 2024-09-16T08:00:02.891 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.892 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.892 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.892 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.569101+0000" 2024-09-16T08:00:02.892 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.892 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.892 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.892 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.892 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.892 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.892 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.892 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.569377+0000" 2024-09-16T08:00:02.892 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.892 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.893 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.893 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.893 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.893 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.893 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.893 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.893 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.893 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.893 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.893 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.893 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.893 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.893 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.893 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.569540+0000" 2024-09-16T08:00:02.894 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.894 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.894 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.894 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.894 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.894 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.894 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.894 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.571532+0000" 2024-09-16T08:00:02.894 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.894 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.894 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.894 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.894 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.895 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.895 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.895 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.895 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.895 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.895 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.895 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.895 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.895 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.895 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.895 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.635751+0000" 2024-09-16T08:00:02.895 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.895 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.895 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.896 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.572283+0000" 2024-09-16T08:00:02.896 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.896 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.896 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.896 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.896 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.896 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.896 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.896 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.896 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.896 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.896 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.897 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.897 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.897 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.897 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.897 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.573454+0000" 2024-09-16T08:00:02.897 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.897 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.897 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.897 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.897 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.897 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.897 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.897 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.897 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.898 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.898 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.898 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.898 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.898 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.898 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.898 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.898 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.898 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.898 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.900 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.900 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.900 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.900 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.900 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.900 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.900 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.900 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.900 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.900 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.900 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.900 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.900 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.573922+0000" 2024-09-16T08:00:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.901 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.902 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.902 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.902 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.902 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.902 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.902 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.902 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.902 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.902 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.902 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.902 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.902 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.589092+0000" 2024-09-16T08:00:02.902 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.903 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.903 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.903 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.903 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.903 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.903 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.903 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.903 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.903 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.903 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.903 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.903 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.903 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.904 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.904 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.634910+0000" 2024-09-16T08:00:02.904 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.904 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.904 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.904 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.904 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.904 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.904 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.904 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.904 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.904 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.904 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.905 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.905 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.905 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 351, 2024-09-16T08:00:02.905 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.905 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.905 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.905 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.644220+0000" 2024-09-16T08:00:02.905 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.905 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.905 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.905 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.644232+0000" 2024-09-16T08:00:02.905 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.905 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.905 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.906 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.906 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.906 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.906 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.906 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.644394+0000" 2024-09-16T08:00:02.906 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.906 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.906 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.906 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.906 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.906 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.906 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.906 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.907 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.907 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.907 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.907 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.907 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.907 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.907 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.907 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.644627+0000" 2024-09-16T08:00:02.907 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.907 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.907 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.907 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.907 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.907 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.908 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.908 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.645016+0000" 2024-09-16T08:00:02.908 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.908 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.908 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.908 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.908 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.908 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.908 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.908 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.908 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.908 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.908 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.909 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.909 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.909 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.909 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.909 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.909 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.909 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.909 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.909 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.645740+0000" 2024-09-16T08:00:02.909 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.909 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.909 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.909 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.909 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.910 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.910 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.910 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.910 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.910 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.910 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.910 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.910 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.910 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.910 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.910 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.646086+0000" 2024-09-16T08:00:02.910 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.911 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.911 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.911 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.911 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.911 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.911 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.911 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.911 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.911 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.911 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.911 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.912 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.912 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.912 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.912 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.912 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.912 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.912 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.912 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.912 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.912 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.912 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.912 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.912 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.913 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.913 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.913 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.913 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.913 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.913 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.913 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.646718+0000" 2024-09-16T08:00:02.913 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.913 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.913 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.913 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.913 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.913 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.914 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.914 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.914 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.914 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.914 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.914 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.914 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.914 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.914 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.914 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.914 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.914 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.914 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.915 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.915 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.915 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.915 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.649576+0000" 2024-09-16T08:00:02.915 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.915 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.915 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.915 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.915 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.915 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.915 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.916 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.916 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.916 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.916 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.916 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.916 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.916 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.916 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.916 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.916 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.916 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.916 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.916 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.917 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.917 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.917 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.917 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.917 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.917 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.917 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.917 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 239, 2024-09-16T08:00:02.917 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.917 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.918 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.012874+0000" 2024-09-16T08:00:02.918 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.918 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.918 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.012890+0000" 2024-09-16T08:00:02.918 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.918 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.918 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.918 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.918 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.919 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.014179+0000" 2024-09-16T08:00:02.919 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.919 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.919 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.919 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.919 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.919 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.919 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.919 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.919 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.919 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.919 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.919 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.919 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.920 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.920 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.920 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.014590+0000" 2024-09-16T08:00:02.920 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.920 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.920 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.920 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.920 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.920 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.920 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.920 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.015465+0000" 2024-09-16T08:00:02.921 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.921 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.921 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.921 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.921 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.921 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.921 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.921 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.921 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.921 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.921 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.921 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.922 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.922 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.922 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.922 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.106827+0000" 2024-09-16T08:00:02.922 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.922 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.922 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.922 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.016131+0000" 2024-09-16T08:00:02.922 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.922 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.922 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.922 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.922 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.923 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.923 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.923 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.923 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.923 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.923 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.923 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.923 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.923 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.923 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.923 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.016476+0000" 2024-09-16T08:00:02.923 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.923 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.923 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.924 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.924 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.924 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.924 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.924 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.924 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.924 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.924 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.924 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.924 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.924 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.924 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.924 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.925 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.925 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.925 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.925 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.925 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.925 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.925 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.925 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.925 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.925 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.925 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.925 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.925 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.925 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.926 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.926 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.017303+0000" 2024-09-16T08:00:02.926 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.926 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.926 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.926 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.926 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.926 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.926 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.926 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.926 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.926 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.927 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.927 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.927 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.927 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.927 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.927 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.927 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.927 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.927 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.928 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.028684+0000" 2024-09-16T08:00:02.928 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.928 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.928 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.928 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.928 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.928 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.928 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.928 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.928 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.928 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.928 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.928 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.929 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.929 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.929 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.929 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.105759+0000" 2024-09-16T08:00:02.929 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.929 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.929 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.929 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.929 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.929 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.929 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.929 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.929 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.930 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.930 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.930 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.930 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.930 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 265, 2024-09-16T08:00:02.930 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.930 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.930 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.930 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.150009+0000" 2024-09-16T08:00:02.930 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.930 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.930 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.930 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.150031+0000" 2024-09-16T08:00:02.931 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.931 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.931 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.931 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.931 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.931 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.931 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.931 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.150292+0000" 2024-09-16T08:00:02.931 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.931 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.931 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.931 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.931 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.932 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.932 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.932 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.932 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.932 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.932 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.932 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.932 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.932 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.932 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.932 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.153113+0000" 2024-09-16T08:00:02.932 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.932 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.932 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.933 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.933 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.933 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.933 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.933 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.156361+0000" 2024-09-16T08:00:02.933 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.933 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.933 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.933 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.933 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.933 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.933 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.203709+0000" 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.157088+0000" 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.934 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.935 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.935 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.935 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.935 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.935 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.935 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.935 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.935 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.935 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.935 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.935 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.935 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.935 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.936 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.157443+0000" 2024-09-16T08:00:02.936 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.936 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.936 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.936 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.936 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.936 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.936 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.936 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.936 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.936 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.936 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.936 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.937 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.937 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.937 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.937 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.937 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.937 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.937 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.937 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.937 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.937 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.937 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.937 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.937 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.937 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.938 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.938 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.938 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.938 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.938 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.938 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.158120+0000" 2024-09-16T08:00:02.938 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.938 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.938 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.938 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.938 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.938 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.938 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.939 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.939 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.939 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.939 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.939 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.939 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.939 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.939 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.939 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.939 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.939 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.939 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.939 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.939 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.940 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.940 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.940 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.161165+0000" 2024-09-16T08:00:02.940 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.940 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.940 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.940 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.940 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.940 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.940 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.940 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.940 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.940 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.941 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.941 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.941 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.941 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.941 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.941 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.203131+0000" 2024-09-16T08:00:02.941 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.941 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.941 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.941 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.941 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.941 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.942 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.942 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.942 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.942 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.942 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.942 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.942 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.942 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 282, 2024-09-16T08:00:02.942 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.942 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.942 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.942 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.213579+0000" 2024-09-16T08:00:02.942 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.942 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.943 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.943 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.213598+0000" 2024-09-16T08:00:02.943 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.943 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.943 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.943 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.943 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.943 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.943 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.943 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.213818+0000" 2024-09-16T08:00:02.943 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.943 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.943 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.944 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.944 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.944 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.944 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.944 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.944 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.944 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.944 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.944 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.944 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.944 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.944 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.944 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.214096+0000" 2024-09-16T08:00:02.944 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.945 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.945 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.945 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.945 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.945 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.945 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.945 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.220971+0000" 2024-09-16T08:00:02.945 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.945 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.945 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.945 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.945 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.946 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.946 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.946 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.946 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.946 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.946 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.946 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.946 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.946 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.946 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.946 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.299727+0000" 2024-09-16T08:00:02.946 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.946 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.946 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.947 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.221693+0000" 2024-09-16T08:00:02.947 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.947 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.947 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.947 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.947 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.947 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.947 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.947 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.947 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.947 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.947 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.947 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.948 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.948 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.948 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.948 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.222060+0000" 2024-09-16T08:00:02.948 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.948 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.948 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.948 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.948 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.948 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.948 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.948 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.948 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.948 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.949 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.949 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.949 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.949 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.949 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.949 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.949 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.949 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.949 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.949 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.949 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.949 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.949 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.950 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.950 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.950 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.950 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.950 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.950 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.950 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.950 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.950 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.222717+0000" 2024-09-16T08:00:02.950 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.950 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.950 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.950 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.951 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.951 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.951 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.951 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.951 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.951 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.951 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.951 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.951 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.951 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.951 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.951 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.951 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.952 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.952 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.952 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.952 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.952 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.952 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.952 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.227692+0000" 2024-09-16T08:00:02.952 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.952 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.952 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.952 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.952 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.953 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.953 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.953 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.953 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.953 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.953 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.953 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.953 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.953 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.953 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.953 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.298720+0000" 2024-09-16T08:00:02.953 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.953 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.954 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.954 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.954 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.954 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.954 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.954 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.954 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.954 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.954 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.954 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.954 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.954 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 301, 2024-09-16T08:00:02.954 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.954 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.955 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.955 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.321490+0000" 2024-09-16T08:00:02.955 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.955 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.955 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.955 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.321502+0000" 2024-09-16T08:00:02.955 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.955 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.955 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.955 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.955 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.955 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.955 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.325797+0000" 2024-09-16T08:00:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.956 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.957 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.957 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.957 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.329892+0000" 2024-09-16T08:00:02.957 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.957 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.957 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.957 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.957 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.957 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.957 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.957 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.337851+0000" 2024-09-16T08:00:02.957 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.957 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.958 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.958 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.958 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.958 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.958 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.958 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.958 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.958 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.958 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.958 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.958 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.958 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.958 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.959 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.374276+0000" 2024-09-16T08:00:02.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.959 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.959 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.959 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.338295+0000" 2024-09-16T08:00:02.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.959 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.959 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.959 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.959 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.959 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.959 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.960 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.960 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.960 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.960 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.960 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.960 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.960 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.338552+0000" 2024-09-16T08:00:02.960 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.960 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.960 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.960 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.960 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.960 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.961 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.961 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.961 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.961 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.961 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.961 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.961 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.961 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.961 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.961 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.961 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.961 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.961 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.962 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.962 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.962 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.962 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.962 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.962 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.962 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.962 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.962 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.962 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.962 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.963 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.963 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.339100+0000" 2024-09-16T08:00:02.963 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.963 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.963 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.963 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.963 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.963 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.963 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.963 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.963 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.963 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.963 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.963 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.964 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.964 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.964 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.964 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.964 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.964 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.964 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.964 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.964 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.964 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.964 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.964 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.342391+0000" 2024-09-16T08:00:02.964 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.965 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.965 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.965 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.965 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.965 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.965 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.965 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.965 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.965 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.965 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.965 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.965 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.965 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.966 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.966 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.373147+0000" 2024-09-16T08:00:02.966 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.966 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.966 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.966 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.966 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.966 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.966 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.966 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.966 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.966 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.966 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.967 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.967 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.967 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 312, 2024-09-16T08:00:02.967 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.967 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.967 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.967 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.389699+0000" 2024-09-16T08:00:02.967 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.967 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.967 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.967 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.389710+0000" 2024-09-16T08:00:02.967 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.967 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.968 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.968 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.968 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.968 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.968 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.968 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.389895+0000" 2024-09-16T08:00:02.968 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.968 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.968 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.968 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.968 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.968 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.968 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.969 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.969 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.969 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.969 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.969 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.969 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.969 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.969 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.969 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.390080+0000" 2024-09-16T08:00:02.969 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.969 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.969 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.969 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.970 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.970 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.970 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.970 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.391279+0000" 2024-09-16T08:00:02.970 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.970 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.970 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.970 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.970 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.970 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.970 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.970 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.970 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.971 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.971 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.971 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.971 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.971 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.971 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.971 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.441988+0000" 2024-09-16T08:00:02.971 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.971 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.971 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.971 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.392047+0000" 2024-09-16T08:00:02.971 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.971 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.972 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.972 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.972 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.972 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.972 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.972 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.972 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.972 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.972 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.972 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.972 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.972 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.972 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.973 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.392431+0000" 2024-09-16T08:00:02.973 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.973 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.973 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.973 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.973 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.973 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.973 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.973 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.973 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.973 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.973 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.973 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.973 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.974 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.974 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.974 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.974 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.974 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.974 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.974 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.974 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.974 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.974 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.974 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.974 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.975 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.975 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.975 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.975 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.975 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.975 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.975 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.393360+0000" 2024-09-16T08:00:02.975 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.975 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.975 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.975 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.975 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.975 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.975 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.976 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.976 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.976 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.976 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.976 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.976 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.976 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.976 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.976 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.976 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.976 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.976 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.977 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.977 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.977 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.977 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.977 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.397627+0000" 2024-09-16T08:00:02.977 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.977 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.977 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.977 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.977 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.977 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.977 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.977 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.978 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.978 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.978 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.978 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.978 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.978 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.978 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.978 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.441031+0000" 2024-09-16T08:00:02.978 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.978 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.978 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.978 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.979 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.979 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.979 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.979 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.979 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.979 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.979 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.979 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.979 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.979 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 306, 2024-09-16T08:00:02.979 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.979 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.980 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.980 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.355998+0000" 2024-09-16T08:00:02.980 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.980 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.980 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.980 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.356007+0000" 2024-09-16T08:00:02.980 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.980 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.980 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.980 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.980 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.980 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.980 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.356151+0000" 2024-09-16T08:00:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.981 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.982 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.982 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.982 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.356290+0000" 2024-09-16T08:00:02.982 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.982 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.982 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.982 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.982 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.982 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.982 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.982 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.357154+0000" 2024-09-16T08:00:02.982 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.982 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.983 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.983 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.983 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.983 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.983 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.983 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.983 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.983 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.983 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.983 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.983 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.983 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.983 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.984 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.444088+0000" 2024-09-16T08:00:02.984 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.984 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.984 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.984 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.357833+0000" 2024-09-16T08:00:02.984 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.984 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.984 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.984 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.984 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.984 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.984 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.984 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.985 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.985 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.985 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.985 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.985 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.985 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.985 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.985 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.358168+0000" 2024-09-16T08:00:02.985 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.985 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.985 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.985 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.985 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.986 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.986 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.986 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.986 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.986 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.986 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.986 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.986 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.986 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.986 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.986 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.986 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.986 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.987 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.987 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.987 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.987 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.987 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.987 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.987 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.987 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.987 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.987 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.987 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.987 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.987 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:02.988 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.358824+0000" 2024-09-16T08:00:02.988 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.988 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.988 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.988 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.988 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.988 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.988 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:02.988 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.988 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.988 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.988 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.988 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.989 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.989 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.989 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:02.989 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.989 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.989 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.989 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.989 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.989 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.989 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.989 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:02.989 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.361384+0000" 2024-09-16T08:00:02.990 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.990 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.990 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.990 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.990 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.990 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.990 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:02.990 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.990 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.990 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.990 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.990 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.990 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.443126+0000" 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.991 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:02.992 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:02.992 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 309, 2024-09-16T08:00:02.992 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:02.992 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.992 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:02.992 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.364944+0000" 2024-09-16T08:00:02.992 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.992 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.992 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:02.992 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.364968+0000" 2024-09-16T08:00:02.992 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.992 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.993 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.993 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.993 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.993 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.993 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:02.993 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.365151+0000" 2024-09-16T08:00:02.993 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.993 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.993 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.993 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.993 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.993 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.993 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:02.994 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.994 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.994 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.994 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.994 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.994 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.994 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.994 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:02.994 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.365358+0000" 2024-09-16T08:00:02.994 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.994 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.994 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.994 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.995 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.995 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.995 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:02.995 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.369803+0000" 2024-09-16T08:00:02.995 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.995 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.995 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.995 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.995 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.995 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.995 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:02.995 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.995 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.995 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.996 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.996 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.996 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.996 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.996 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:02.996 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.464533+0000" 2024-09-16T08:00:02.996 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.996 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.996 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:02.996 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.370503+0000" 2024-09-16T08:00:02.996 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.996 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.996 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.997 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.997 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.997 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.997 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:02.997 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.997 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.997 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.997 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.997 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.997 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.997 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.997 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:02.997 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.370868+0000" 2024-09-16T08:00:02.998 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.998 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.998 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.998 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.998 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.998 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.998 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:02.998 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.998 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.998 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.998 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.998 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.998 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.998 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.999 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:02.999 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.999 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.999 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.999 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:02.999 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.999 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.999 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:02.999 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:02.999 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:02.999 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:02.999 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:02.999 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.000 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.000 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.000 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.000 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.000 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.371455+0000" 2024-09-16T08:00:03.000 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.000 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.000 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.000 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.000 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.000 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.000 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.000 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.001 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.001 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.001 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.001 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.001 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.001 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.001 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.001 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.001 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.001 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.001 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.001 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.001 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.002 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.002 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.002 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.376033+0000" 2024-09-16T08:00:03.002 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.002 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.002 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.002 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.002 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.002 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.002 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.002 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.002 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.002 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.002 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.003 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.003 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.003 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.003 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.003 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.462576+0000" 2024-09-16T08:00:03.003 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.003 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.003 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.003 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.003 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.003 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.003 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.003 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.004 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.004 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.004 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.004 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.004 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.004 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 317, 2024-09-16T08:00:03.004 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.004 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.004 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.004 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.444485+0000" 2024-09-16T08:00:03.004 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.004 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.004 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.005 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.444508+0000" 2024-09-16T08:00:03.005 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.005 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.005 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.005 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.005 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.005 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.005 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.005 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.444720+0000" 2024-09-16T08:00:03.005 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.005 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.005 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.005 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.006 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.006 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.006 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.006 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.006 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.006 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.006 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.006 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.006 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.006 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.006 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.006 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.446483+0000" 2024-09-16T08:00:03.006 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.007 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.007 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.007 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.007 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.007 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.007 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.007 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.448128+0000" 2024-09-16T08:00:03.007 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.007 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.007 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.007 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.007 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.007 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.007 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.008 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.008 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.008 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.008 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.008 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.008 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.008 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.008 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.008 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.501064+0000" 2024-09-16T08:00:03.008 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.008 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.008 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.009 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.448965+0000" 2024-09-16T08:00:03.009 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.009 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.009 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.009 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.009 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.009 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.009 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.009 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.009 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.009 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.009 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.009 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.010 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.010 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.010 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.010 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.449315+0000" 2024-09-16T08:00:03.010 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.010 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.010 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.010 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.010 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.010 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.010 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.010 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.010 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.011 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.011 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.011 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.011 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.011 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.011 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.011 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.011 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.011 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.011 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.012 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.012 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.012 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.012 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.012 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.012 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.012 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.012 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.012 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.012 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.012 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.012 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.012 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.450059+0000" 2024-09-16T08:00:03.013 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.013 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.013 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.013 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.013 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.013 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.013 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.013 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.013 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.013 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.013 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.013 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.013 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.013 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.014 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.014 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.014 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.014 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.014 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.014 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.014 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.014 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.014 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.014 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.455769+0000" 2024-09-16T08:00:03.014 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.014 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.014 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.015 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.015 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.015 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.015 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.015 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.015 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.015 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.015 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.015 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.015 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.015 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.015 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.015 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.500049+0000" 2024-09-16T08:00:03.016 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.016 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.016 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.016 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.016 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.016 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.016 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.016 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.016 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.016 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.016 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.016 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.016 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.017 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 319, 2024-09-16T08:00:03.017 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.017 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.017 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.017 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.448195+0000" 2024-09-16T08:00:03.017 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.017 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.017 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.017 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.448206+0000" 2024-09-16T08:00:03.017 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.017 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.017 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.017 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.018 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.018 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.018 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.018 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.448632+0000" 2024-09-16T08:00:03.018 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.018 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.018 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.018 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.018 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.018 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.018 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.018 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.018 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.449012+0000" 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.019 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.451287+0000" 2024-09-16T08:00:03.020 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.020 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.020 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.020 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.020 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.020 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.020 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.020 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.020 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.020 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.020 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.020 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.020 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.020 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.021 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.021 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.506742+0000" 2024-09-16T08:00:03.021 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.021 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.021 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.021 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.452014+0000" 2024-09-16T08:00:03.021 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.021 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.021 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.021 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.021 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.021 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.022 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.022 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.022 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.022 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.022 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.022 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.022 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.022 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.022 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.022 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.452348+0000" 2024-09-16T08:00:03.022 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.022 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.022 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.022 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.023 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.023 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.023 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.023 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.023 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.023 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.023 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.023 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.023 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.023 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.024 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.024 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.024 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.024 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.024 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.024 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.024 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.024 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.024 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.024 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.024 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.024 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.024 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.025 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.025 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.453022+0000" 2024-09-16T08:00:03.025 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.025 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.025 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.025 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.025 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.025 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.025 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.025 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.025 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.025 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.025 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.025 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.026 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.026 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.026 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.026 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.026 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.026 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.026 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.026 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.026 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.466747+0000" 2024-09-16T08:00:03.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.027 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.027 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.027 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.027 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.027 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.027 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.027 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.027 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.027 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.027 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.027 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.027 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.027 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.028 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.028 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.506136+0000" 2024-09-16T08:00:03.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.028 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.028 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.028 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.028 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.028 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.028 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.028 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.028 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.028 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.029 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.029 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 320, 2024-09-16T08:00:03.029 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.029 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.029 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.029 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.450813+0000" 2024-09-16T08:00:03.029 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.029 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.029 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.029 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.450823+0000" 2024-09-16T08:00:03.029 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.029 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.029 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.030 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.030 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.030 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.030 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.451161+0000" 2024-09-16T08:00:03.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.030 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.030 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.030 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.030 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.030 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.030 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.031 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.031 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.031 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.031 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.031 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.031 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.031 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.031 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.451891+0000" 2024-09-16T08:00:03.031 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.031 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.031 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.031 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.031 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.031 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.032 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.032 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.453182+0000" 2024-09-16T08:00:03.032 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.032 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.032 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.032 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.032 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.032 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.032 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.032 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.032 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.032 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.032 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.032 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.033 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.033 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.033 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.033 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.549585+0000" 2024-09-16T08:00:03.033 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.033 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.033 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.033 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.455687+0000" 2024-09-16T08:00:03.033 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.034 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.034 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.034 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.034 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.034 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.034 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.034 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.034 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.034 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.034 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.034 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.034 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.034 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.034 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.035 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.455994+0000" 2024-09-16T08:00:03.035 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.035 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.035 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.035 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.035 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.035 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.035 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.035 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.035 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.035 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.035 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.036 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.036 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.036 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.036 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.036 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.036 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.036 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.036 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.036 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.036 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.036 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.036 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.036 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.036 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.037 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.037 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.037 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.037 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.037 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.037 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.037 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.457719+0000" 2024-09-16T08:00:03.037 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.037 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.037 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.037 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.037 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.037 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.037 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.038 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.038 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.038 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.038 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.038 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.038 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.038 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.038 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.038 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.038 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.038 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.038 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.038 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.039 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.039 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.039 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.476503+0000" 2024-09-16T08:00:03.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.039 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.039 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.039 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.039 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.039 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.039 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.039 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.040 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.040 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.040 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.040 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.040 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.040 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.545920+0000" 2024-09-16T08:00:03.040 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.040 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.040 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.040 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.040 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.040 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.040 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.041 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.041 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.041 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.041 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.041 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.041 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.041 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 332, 2024-09-16T08:00:03.041 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.041 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.041 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.041 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.533090+0000" 2024-09-16T08:00:03.041 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.041 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.041 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.042 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.533102+0000" 2024-09-16T08:00:03.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.042 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.042 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.042 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.042 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.042 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.042 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.533800+0000" 2024-09-16T08:00:03.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.042 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.042 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.042 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.043 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.043 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.043 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.043 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.043 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.043 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.043 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.043 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.043 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.534423+0000" 2024-09-16T08:00:03.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.043 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.043 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.044 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.044 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.044 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.044 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.044 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.536366+0000" 2024-09-16T08:00:03.044 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.044 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.044 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.044 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.044 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.044 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.044 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.044 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.045 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.045 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.045 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.045 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.045 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.045 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.045 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.045 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.589586+0000" 2024-09-16T08:00:03.045 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.045 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.045 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.045 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.537959+0000" 2024-09-16T08:00:03.045 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.046 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.046 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.046 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.046 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.046 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.046 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.046 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.046 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.046 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.046 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.046 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.046 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.046 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.046 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.047 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.538200+0000" 2024-09-16T08:00:03.047 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.047 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.047 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.047 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.047 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.047 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.047 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.047 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.047 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.047 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.047 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.047 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.048 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.048 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.048 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.048 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.048 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.048 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.048 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.048 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.048 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.049 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.049 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.049 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.049 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.049 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.049 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.538815+0000" 2024-09-16T08:00:03.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.049 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.049 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.049 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.049 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.050 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.050 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.050 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.050 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.050 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.050 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.050 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.050 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.050 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.050 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.050 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.050 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.050 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.051 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.051 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.051 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.051 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.545977+0000" 2024-09-16T08:00:03.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.051 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.051 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.051 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.051 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.051 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.051 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.052 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.052 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.052 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.052 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.052 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.052 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.588621+0000" 2024-09-16T08:00:03.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.052 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.052 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.052 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.052 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 321, 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.453016+0000" 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.053 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.054 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.453027+0000" 2024-09-16T08:00:03.054 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.054 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.054 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.054 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.054 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.054 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.054 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.054 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.453276+0000" 2024-09-16T08:00:03.054 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.054 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.054 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.054 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.055 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.055 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.055 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.055 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.055 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.055 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.055 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.055 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.055 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.055 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.055 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.055 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.453392+0000" 2024-09-16T08:00:03.055 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.056 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.056 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.056 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.056 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.056 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.056 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.056 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.460712+0000" 2024-09-16T08:00:03.056 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.056 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.056 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.056 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.056 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.056 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.056 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.057 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.057 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.057 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.057 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.057 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.057 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.057 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.057 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.057 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.597727+0000" 2024-09-16T08:00:03.057 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.057 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.057 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.057 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.463149+0000" 2024-09-16T08:00:03.058 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.058 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.058 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.058 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.058 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.058 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.058 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.058 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.058 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.058 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.058 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.058 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.058 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.058 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.059 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.059 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.463604+0000" 2024-09-16T08:00:03.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.059 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.059 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.059 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.059 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.059 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.059 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.060 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.060 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.060 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.060 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.060 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.060 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.060 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.060 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.060 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.060 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.060 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.060 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.060 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.061 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.061 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.061 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.061 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.061 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.061 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.061 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.061 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.061 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.465770+0000" 2024-09-16T08:00:03.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.061 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.061 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.062 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.063 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.063 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.063 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.063 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.063 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.063 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.063 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.488347+0000" 2024-09-16T08:00:03.063 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.063 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.063 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.063 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.063 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.063 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.596765+0000" 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.064 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.065 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.065 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.065 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.065 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.065 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.065 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.065 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.065 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.065 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 327, 2024-09-16T08:00:03.065 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.065 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.065 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.065 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.503200+0000" 2024-09-16T08:00:03.066 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.066 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.066 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.066 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.503221+0000" 2024-09-16T08:00:03.066 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.066 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.066 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.066 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.066 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.066 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.066 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.066 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.509433+0000" 2024-09-16T08:00:03.066 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.067 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.067 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.067 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.067 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.067 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.067 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.067 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.067 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.067 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.067 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.067 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.067 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.067 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.068 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.068 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.511601+0000" 2024-09-16T08:00:03.068 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.068 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.068 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.068 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.068 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.068 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.068 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.068 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.514407+0000" 2024-09-16T08:00:03.068 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.068 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.068 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.069 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.069 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.069 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.069 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.069 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.069 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.069 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.069 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.069 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.069 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.069 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.069 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.069 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.603467+0000" 2024-09-16T08:00:03.070 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.070 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.070 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.070 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.515113+0000" 2024-09-16T08:00:03.070 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.070 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.070 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.070 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.070 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.070 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.070 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.070 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.070 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.071 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.071 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.071 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.071 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.071 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.071 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.071 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.515487+0000" 2024-09-16T08:00:03.071 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.071 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.071 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.071 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.071 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.071 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.072 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.072 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.072 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.072 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.072 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.072 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.072 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.072 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.072 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.072 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.072 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.072 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.072 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.072 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.073 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.073 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.073 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.073 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.073 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.073 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.073 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.073 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.073 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.073 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.073 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.073 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.516153+0000" 2024-09-16T08:00:03.073 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.074 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.074 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.074 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.074 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.074 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.074 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.074 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.074 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.074 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.074 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.074 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.074 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.074 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.075 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.075 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.075 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.075 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.075 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.075 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.075 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.075 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.075 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.075 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.518610+0000" 2024-09-16T08:00:03.075 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.075 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.075 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.075 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.076 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.076 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.076 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.076 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.076 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.076 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.076 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.076 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.076 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.076 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.076 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.076 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.601890+0000" 2024-09-16T08:00:03.076 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.077 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.077 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.077 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.077 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.077 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.077 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.077 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.077 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.077 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.077 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.077 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.077 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.078 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 330, 2024-09-16T08:00:03.078 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.078 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.078 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.078 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.525386+0000" 2024-09-16T08:00:03.078 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.078 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.078 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.078 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.525400+0000" 2024-09-16T08:00:03.078 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.079 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.079 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.079 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.079 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.079 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.079 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.079 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.525573+0000" 2024-09-16T08:00:03.079 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.079 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.079 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.079 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.079 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.079 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.080 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.080 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.080 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.080 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.080 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.080 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.080 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.080 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.080 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.080 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.528222+0000" 2024-09-16T08:00:03.080 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.080 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.080 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.081 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.081 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.081 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.081 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.081 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.528850+0000" 2024-09-16T08:00:03.081 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.081 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.081 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.081 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.081 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.081 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.081 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.081 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.081 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.082 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.082 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.082 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.082 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.082 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.082 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.082 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.604858+0000" 2024-09-16T08:00:03.082 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.082 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.082 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.082 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.529410+0000" 2024-09-16T08:00:03.082 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.082 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.083 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.083 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.083 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.083 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.083 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.083 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.083 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.083 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.083 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.083 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.083 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.083 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.083 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.084 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.529626+0000" 2024-09-16T08:00:03.084 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.084 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.084 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.084 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.084 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.084 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.084 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.084 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.084 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.084 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.084 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.084 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.084 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.085 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.085 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.085 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.085 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.085 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.085 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.085 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.085 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.085 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.085 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.085 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.085 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.085 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.086 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.086 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.086 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.086 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.086 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.086 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.530062+0000" 2024-09-16T08:00:03.086 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.086 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.086 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.086 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.086 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.086 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.086 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.087 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.087 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.087 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.087 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.087 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.087 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.087 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.087 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.087 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.087 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.087 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.087 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.087 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.088 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.088 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.088 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.088 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.532173+0000" 2024-09-16T08:00:03.088 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.088 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.088 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.088 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.088 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.088 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.088 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.088 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.088 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.089 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.089 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.089 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.089 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.089 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.089 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.089 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.603664+0000" 2024-09-16T08:00:03.089 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.089 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.089 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.089 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.089 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.089 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.090 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.090 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.090 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.090 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.090 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.090 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.090 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.090 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 333, 2024-09-16T08:00:03.090 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.090 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.090 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.090 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.535749+0000" 2024-09-16T08:00:03.090 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.090 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.091 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.091 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.535762+0000" 2024-09-16T08:00:03.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.091 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.091 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.091 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.091 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.091 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.091 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.535905+0000" 2024-09-16T08:00:03.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.091 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.092 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.092 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.092 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.092 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.092 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.092 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.092 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.092 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.092 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.092 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.092 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.092 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.092 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.093 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.536657+0000" 2024-09-16T08:00:03.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.093 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.093 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.093 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.093 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.093 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.093 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.538686+0000" 2024-09-16T08:00:03.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.093 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.093 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.093 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.629216+0000" 2024-09-16T08:00:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.094 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.095 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.095 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.540625+0000" 2024-09-16T08:00:03.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.095 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.095 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.095 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.095 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.095 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.095 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.095 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.096 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.096 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.096 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.096 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.096 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.541117+0000" 2024-09-16T08:00:03.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.096 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.096 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.096 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.096 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.096 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.096 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.097 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.097 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.097 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.097 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.097 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.097 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.097 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.097 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.097 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.098 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.098 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.098 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.098 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.098 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.098 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.098 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.098 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.098 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.541807+0000" 2024-09-16T08:00:03.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.098 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.099 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.099 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.099 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.099 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.099 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.099 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.099 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.099 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.099 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.099 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.099 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.099 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.099 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.100 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.100 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.100 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.100 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.100 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.100 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.100 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.554374+0000" 2024-09-16T08:00:03.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.100 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.100 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.100 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.101 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.101 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.101 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.101 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.101 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.101 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.101 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.101 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.101 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.101 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.101 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.628573+0000" 2024-09-16T08:00:03.101 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.101 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.102 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.102 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.102 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.102 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.102 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.102 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.102 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.102 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.102 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.102 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 336, 2024-09-16T08:00:03.102 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.102 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.103 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.103 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.542296+0000" 2024-09-16T08:00:03.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.103 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.103 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.103 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.542309+0000" 2024-09-16T08:00:03.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.103 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.103 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.104 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.104 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.104 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.104 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.542546+0000" 2024-09-16T08:00:03.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.104 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.104 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.542671+0000" 2024-09-16T08:00:03.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.106 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.106 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.106 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.106 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.106 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.106 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.548468+0000" 2024-09-16T08:00:03.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.106 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.106 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.106 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.106 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.106 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.642122+0000" 2024-09-16T08:00:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.553190+0000" 2024-09-16T08:00:03.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.108 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.108 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.108 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.108 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.108 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.108 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.108 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.108 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.108 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.108 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.109 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.109 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.556020+0000" 2024-09-16T08:00:03.109 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.109 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.109 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.109 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.109 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.109 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.109 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.109 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.109 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.109 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.109 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.110 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.110 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.110 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.110 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.110 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.110 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.110 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.110 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.110 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.110 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.111 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.111 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.111 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.111 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.111 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.111 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.557151+0000" 2024-09-16T08:00:03.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.111 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.111 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.111 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.111 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.112 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.112 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.112 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.112 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.112 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.112 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.112 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.112 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.113 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.113 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.113 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.567673+0000" 2024-09-16T08:00:03.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.113 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.113 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.113 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.113 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.113 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.113 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.114 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.114 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.114 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.114 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.114 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.114 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.639751+0000" 2024-09-16T08:00:03.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.114 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.114 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.114 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.114 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.114 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 335, 2024-09-16T08:00:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.537754+0000" 2024-09-16T08:00:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.115 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.116 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.116 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.537772+0000" 2024-09-16T08:00:03.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.116 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.116 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.116 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.116 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.116 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.116 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.538339+0000" 2024-09-16T08:00:03.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.116 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.116 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.117 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.117 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.117 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.117 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.117 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.117 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.117 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.117 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.117 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.117 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.538782+0000" 2024-09-16T08:00:03.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.118 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.118 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.118 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.118 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.118 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.118 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.542886+0000" 2024-09-16T08:00:03.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.118 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.118 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.118 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.118 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.118 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.119 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.119 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.119 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.119 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.119 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.119 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.119 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.642539+0000" 2024-09-16T08:00:03.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.119 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.119 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.119 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.544047+0000" 2024-09-16T08:00:03.119 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.120 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.120 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.120 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.120 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.120 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.120 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.121 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.121 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.121 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.545884+0000" 2024-09-16T08:00:03.121 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.121 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.121 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.121 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.121 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.121 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.121 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.121 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.121 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.121 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.121 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.122 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.122 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.122 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.122 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.122 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.122 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.122 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.122 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.122 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.122 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.123 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.123 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.123 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.123 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.123 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.123 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.548046+0000" 2024-09-16T08:00:03.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.123 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.123 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.123 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.123 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.124 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.124 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.124 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.124 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.124 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.124 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.124 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.124 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.124 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.124 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.124 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.125 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.125 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.125 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.566468+0000" 2024-09-16T08:00:03.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.125 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.125 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.125 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.125 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.125 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.125 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.126 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.126 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.126 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.126 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.126 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.126 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.640419+0000" 2024-09-16T08:00:03.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.126 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.126 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.126 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.126 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.127 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.127 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.127 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.127 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.127 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.127 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.127 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 343, 2024-09-16T08:00:03.127 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.127 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.127 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.127 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.600108+0000" 2024-09-16T08:00:03.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.128 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.128 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.128 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.600125+0000" 2024-09-16T08:00:03.128 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.128 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.128 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.128 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.128 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.128 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.128 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.128 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.600338+0000" 2024-09-16T08:00:03.128 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.128 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.128 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.129 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.129 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.129 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.129 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.129 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.129 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.129 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.129 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.129 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.129 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.600516+0000" 2024-09-16T08:00:03.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.130 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.130 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.130 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.130 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.130 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.130 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.600984+0000" 2024-09-16T08:00:03.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.130 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.130 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.130 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.130 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.130 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.682742+0000" 2024-09-16T08:00:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.601588+0000" 2024-09-16T08:00:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.133 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.133 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.133 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.133 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.602352+0000" 2024-09-16T08:00:03.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.133 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.133 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.133 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.133 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.133 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.133 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.134 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.135 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.135 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.135 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.135 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.135 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.135 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.135 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.602937+0000" 2024-09-16T08:00:03.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.135 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.135 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.135 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.136 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.136 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.136 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.136 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.136 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.136 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.136 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.136 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.136 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.136 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.136 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.136 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.136 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.137 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.137 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.137 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.137 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.137 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.137 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.605800+0000" 2024-09-16T08:00:03.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.137 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.137 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.137 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.137 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.138 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.138 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.138 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.138 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.138 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.138 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.138 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.138 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.138 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.138 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.681777+0000" 2024-09-16T08:00:03.138 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.138 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.138 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.138 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.139 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.139 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.139 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.139 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.139 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.139 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.139 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.139 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.139 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.139 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 349, 2024-09-16T08:00:03.139 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.139 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.139 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.139 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.628247+0000" 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.628266+0000" 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.628422+0000" 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.140 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.141 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.141 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.141 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.141 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.141 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.141 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.141 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.141 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.141 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.141 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.628555+0000" 2024-09-16T08:00:03.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.142 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.142 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.142 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.142 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.142 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.142 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.142 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.630549+0000" 2024-09-16T08:00:03.142 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.142 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.142 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.142 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.142 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.142 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.142 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.143 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.143 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.143 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.143 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.143 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.143 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.143 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.143 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.143 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.685150+0000" 2024-09-16T08:00:03.143 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.143 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.143 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.143 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.631019+0000" 2024-09-16T08:00:03.144 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.144 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.144 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.144 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.144 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.144 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.144 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.144 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.144 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.144 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.144 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.144 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.144 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.144 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.145 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.145 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.631257+0000" 2024-09-16T08:00:03.145 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.145 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.145 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.145 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.145 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.145 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.145 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.145 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.145 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.145 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.145 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.145 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.146 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.146 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.146 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.146 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.146 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.146 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.146 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.146 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.146 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.146 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.146 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.146 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.146 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.147 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.147 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.147 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.147 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.147 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.147 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.147 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.631660+0000" 2024-09-16T08:00:03.147 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.147 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.147 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.147 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.147 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.147 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.147 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.148 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.148 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.148 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.148 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.148 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.148 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.148 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.148 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.148 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.148 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.149 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.149 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.149 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.149 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.633603+0000" 2024-09-16T08:00:03.149 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.149 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.149 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.149 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.149 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.149 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.149 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.149 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.149 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.149 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.150 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.150 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.150 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.150 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.150 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.150 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.684391+0000" 2024-09-16T08:00:03.150 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.150 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.150 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.150 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.150 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.150 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.150 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.151 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.151 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.151 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.151 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.151 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.151 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.151 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 346, 2024-09-16T08:00:03.151 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.151 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.151 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.151 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.611767+0000" 2024-09-16T08:00:03.151 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.151 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.152 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.152 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.611784+0000" 2024-09-16T08:00:03.152 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.152 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.152 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.152 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.152 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.152 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.152 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.152 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.612064+0000" 2024-09-16T08:00:03.152 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.152 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.152 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.153 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.153 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.153 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.153 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.153 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.153 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.153 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.153 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.153 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.153 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.153 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.153 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.154 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.612244+0000" 2024-09-16T08:00:03.154 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.154 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.154 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.154 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.154 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.154 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.154 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.154 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.615198+0000" 2024-09-16T08:00:03.154 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.154 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.154 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.154 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.154 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.155 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.155 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.155 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.155 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.155 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.155 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.155 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.155 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.155 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.155 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.155 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.155 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.155 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.156 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.156 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.615637+0000" 2024-09-16T08:00:03.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.156 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.156 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.156 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.156 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.156 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.156 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.156 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.156 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.615844+0000" 2024-09-16T08:00:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.616253+0000" 2024-09-16T08:00:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.160 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.160 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.160 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.160 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.160 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.160 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.160 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.160 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.160 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.160 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.161 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.161 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.161 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.161 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.161 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.161 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.622380+0000" 2024-09-16T08:00:03.161 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.161 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.161 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.161 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.161 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.161 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.161 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.161 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.162 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.162 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.162 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.162 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.162 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.162 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.162 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.162 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.162 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.162 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.163 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.163 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.163 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.163 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.163 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.163 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.163 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.163 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 348, 2024-09-16T08:00:03.163 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.163 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.163 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.163 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.624751+0000" 2024-09-16T08:00:03.163 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.164 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.164 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.164 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.624771+0000" 2024-09-16T08:00:03.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.164 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.164 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.164 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.164 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.164 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.164 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.625023+0000" 2024-09-16T08:00:03.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.164 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.164 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.165 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.165 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.165 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.165 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.165 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.165 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.165 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.165 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.165 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.165 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.625149+0000" 2024-09-16T08:00:03.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.166 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.166 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.166 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.166 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.166 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.166 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.629796+0000" 2024-09-16T08:00:03.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.166 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.166 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.166 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.166 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.167 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.167 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.167 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.167 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.167 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.167 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.167 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.167 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.167 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.167 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.167 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.167 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.167 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.168 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.630637+0000" 2024-09-16T08:00:03.168 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.168 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.168 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.168 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.168 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.168 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.168 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.168 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.168 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.168 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.168 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.168 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.169 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.169 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.169 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.169 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.631143+0000" 2024-09-16T08:00:03.169 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.169 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.169 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.169 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.169 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.169 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.169 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.169 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.169 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.169 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.170 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.170 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.170 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.170 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.170 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.170 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.170 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.170 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.170 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.170 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.170 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.170 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.170 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.171 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.171 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.171 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.171 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.171 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.171 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.171 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.171 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.171 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.631779+0000" 2024-09-16T08:00:03.171 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.171 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.171 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.171 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.171 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.172 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.172 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.172 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.172 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.172 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.172 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.172 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.172 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.172 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.172 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.173 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.173 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.173 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.173 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.173 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.173 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.634145+0000" 2024-09-16T08:00:03.173 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.173 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.173 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.173 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.173 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.173 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.173 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.173 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.174 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.174 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.174 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.174 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.174 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.174 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.174 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.174 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.174 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.174 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.174 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.174 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.174 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.174 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.175 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.175 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.175 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.175 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.175 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.175 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.175 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.175 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 350, 2024-09-16T08:00:03.175 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.175 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.175 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.175 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.636729+0000" 2024-09-16T08:00:03.175 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.175 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.176 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.176 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.636754+0000" 2024-09-16T08:00:03.176 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.176 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.176 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.176 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.176 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.176 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.176 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.176 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.636975+0000" 2024-09-16T08:00:03.176 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.176 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.176 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.176 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.177 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.177 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.177 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.177 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.177 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.177 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.177 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.177 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.177 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.177 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.177 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.177 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.637097+0000" 2024-09-16T08:00:03.178 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.178 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.178 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.178 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.178 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.178 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.178 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.178 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.641609+0000" 2024-09-16T08:00:03.178 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.178 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.179 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.179 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.179 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.179 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.179 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.179 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.179 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.179 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.179 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.179 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.179 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.179 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.180 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.180 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.180 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.180 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.180 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.180 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.642359+0000" 2024-09-16T08:00:03.180 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.180 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.180 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.180 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.180 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.180 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.180 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.180 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.181 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.181 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.181 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.181 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.181 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.181 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.181 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.181 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.642693+0000" 2024-09-16T08:00:03.181 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.181 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.181 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.181 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.181 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.181 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.182 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.182 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.182 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.182 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.182 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.182 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.182 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.182 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.182 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.182 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.182 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.182 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.182 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.182 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.643368+0000" 2024-09-16T08:00:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.183 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.184 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.184 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.184 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.184 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.184 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.184 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.184 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.184 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.184 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.184 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.184 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.184 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.184 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.185 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.185 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.185 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.185 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.185 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.185 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.185 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.185 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.185 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.646130+0000" 2024-09-16T08:00:03.185 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.185 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.185 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.185 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.186 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.187 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.187 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.187 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.187 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.187 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.187 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.187 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.187 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.187 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.187 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.187 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 353, 2024-09-16T08:00:03.187 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.187 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.187 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.188 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.681486+0000" 2024-09-16T08:00:03.188 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.188 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.188 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.188 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.681516+0000" 2024-09-16T08:00:03.188 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.188 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.188 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.188 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.188 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.188 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.188 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.188 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.681735+0000" 2024-09-16T08:00:03.189 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.189 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.189 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.189 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.189 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.189 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.189 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.189 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.189 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.189 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.189 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.189 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.189 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.190 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.190 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.190 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.681903+0000" 2024-09-16T08:00:03.190 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.190 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.190 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.190 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.190 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.190 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.190 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.190 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.682996+0000" 2024-09-16T08:00:03.190 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.190 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.191 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.191 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.191 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.191 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.191 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.191 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.191 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.191 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.191 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.191 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.191 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.191 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.191 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.192 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.192 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.192 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.192 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.192 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.683715+0000" 2024-09-16T08:00:03.192 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.192 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.192 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.192 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.192 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.192 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.192 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.192 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.193 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.193 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.193 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.193 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.193 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.193 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.684025+0000" 2024-09-16T08:00:03.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.193 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.193 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.193 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.194 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.194 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.194 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.194 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.194 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.194 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.194 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.194 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.194 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.194 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.195 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.195 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.195 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.195 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.195 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.195 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.195 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.195 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.195 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.195 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.195 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.195 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.195 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.196 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.684640+0000" 2024-09-16T08:00:03.196 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.196 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.196 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.196 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.196 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.196 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.196 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.196 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.196 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.196 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.196 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.196 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.196 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.197 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.197 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.197 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.197 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.197 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.197 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.197 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.197 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.197 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.687196+0000" 2024-09-16T08:00:03.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.197 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.197 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.198 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.198 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.198 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.198 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.198 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.198 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.198 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.198 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.198 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.198 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.198 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.198 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.198 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.198 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 354, 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.199 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.200 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.200 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.690879+0000" 2024-09-16T08:00:03.200 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.200 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.200 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.200 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.690898+0000" 2024-09-16T08:00:03.200 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.200 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.200 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.200 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.200 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.200 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.200 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.201 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.691597+0000" 2024-09-16T08:00:03.201 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.201 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.201 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.201 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.201 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.201 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.201 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.201 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.201 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.201 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.201 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.201 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.202 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.202 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.202 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.691812+0000" 2024-09-16T08:00:03.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.202 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.202 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.202 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.202 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.202 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.202 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.692134+0000" 2024-09-16T08:00:03.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.203 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.203 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.203 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.203 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.203 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.203 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.203 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.203 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.203 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.203 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.204 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.204 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.204 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.204 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.204 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.204 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.692633+0000" 2024-09-16T08:00:03.204 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.204 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.204 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.204 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.204 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.204 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.204 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.205 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.205 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.205 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.205 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.205 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.205 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.205 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.205 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.205 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.692840+0000" 2024-09-16T08:00:03.205 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.205 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.205 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.205 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.205 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.206 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.206 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.206 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.206 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.206 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.206 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.206 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.206 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.206 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.206 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.206 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.206 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.206 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.206 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.207 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.207 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.207 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.207 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.207 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.207 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.207 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.207 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.207 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.207 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.693270+0000" 2024-09-16T08:00:03.208 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.208 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.208 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.208 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.208 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.208 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.208 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.208 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.208 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.208 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.208 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.208 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.208 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.208 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.209 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.209 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.209 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.209 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.209 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.209 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.209 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.209 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.209 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.209 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.695218+0000" 2024-09-16T08:00:03.209 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.209 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.209 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.210 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.210 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.210 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.210 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.210 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.210 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.210 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.210 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.210 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.210 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.210 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.210 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.210 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.210 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.211 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.211 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.211 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.211 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.211 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.211 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.211 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.211 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.211 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.211 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "replicated_request", 2024-09-16T08:00:03.211 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 356, 2024-09-16T08:00:03.211 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.212 INFO:teuthology.orchestra.run.smithi003.stdout: "RepRequest": { 2024-09-16T08:00:03.212 INFO:teuthology.orchestra.run.smithi003.stdout: "reqid": "client.5431.0:16319", 2024-09-16T08:00:03.212 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.b", 2024-09-16T08:00:03.212 INFO:teuthology.orchestra.run.smithi003.stdout: "map_epoch": 149, 2024-09-16T08:00:03.212 INFO:teuthology.orchestra.run.smithi003.stdout: "min_epoch": 147, 2024-09-16T08:00:03.212 INFO:teuthology.orchestra.run.smithi003.stdout: "oid": "7:d8c6d3ba:::benchmark_data_smithi003_49564_object4353:head", 2024-09-16T08:00:03.212 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "3" 2024-09-16T08:00:03.212 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.212 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.212 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.212 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.212 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.212 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 193, 2024-09-16T08:00:03.212 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.213 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.213 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.213 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.727977+0000" 2024-09-16T08:00:03.213 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.213 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.213 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.213 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.727995+0000" 2024-09-16T08:00:03.213 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.213 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.213 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.213 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.213 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.213 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.214 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.214 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.728217+0000" 2024-09-16T08:00:03.214 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.214 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.214 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.214 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.214 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.214 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.214 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.214 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.214 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.214 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.214 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.214 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.215 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.215 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.215 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.728413+0000" 2024-09-16T08:00:03.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.215 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.215 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.215 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.215 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.215 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.215 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.733741+0000" 2024-09-16T08:00:03.215 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.215 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.216 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.216 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.216 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.216 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.216 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.216 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.216 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.216 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.216 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.216 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.216 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.216 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.216 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.217 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.806167+0000" 2024-09-16T08:00:03.217 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.217 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.217 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.217 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.734566+0000" 2024-09-16T08:00:03.217 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.217 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.217 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.217 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.217 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.217 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.217 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.217 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.218 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.218 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.218 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.218 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.218 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.218 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.218 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.218 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.734760+0000" 2024-09-16T08:00:03.218 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.218 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.218 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.218 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.218 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.218 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.219 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.219 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.219 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.219 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.219 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.219 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.219 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.219 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.219 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.219 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.219 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.219 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.219 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.220 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.220 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.220 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.220 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.220 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.220 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.220 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.220 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.220 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.220 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.220 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.220 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.220 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.735313+0000" 2024-09-16T08:00:03.220 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.221 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.221 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.221 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.221 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.221 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.221 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.221 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.221 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.221 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.221 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.221 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.221 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.221 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.222 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.222 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.222 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.222 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.222 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.222 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.222 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.222 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.222 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.222 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.740908+0000" 2024-09-16T08:00:03.222 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.222 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.222 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.222 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.223 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.223 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.223 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.223 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.223 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.223 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.223 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.223 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.223 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.223 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.223 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.223 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.789165+0000" 2024-09-16T08:00:03.223 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.224 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.224 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.224 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.224 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.224 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.224 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.224 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.224 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.224 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.224 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.224 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.224 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.224 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 202, 2024-09-16T08:00:03.224 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.225 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.225 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.225 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.766812+0000" 2024-09-16T08:00:03.225 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.225 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.225 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.225 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.766827+0000" 2024-09-16T08:00:03.225 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.225 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.225 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.225 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.225 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.225 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.226 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.226 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.766993+0000" 2024-09-16T08:00:03.226 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.226 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.226 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.226 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.226 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.226 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.226 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.226 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.226 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.226 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.226 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.226 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.227 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.227 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.227 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.227 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.767309+0000" 2024-09-16T08:00:03.227 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.227 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.227 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.227 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.227 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.227 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.227 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.227 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.771840+0000" 2024-09-16T08:00:03.227 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.228 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.228 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.228 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.228 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.228 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.228 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.228 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.228 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.228 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.228 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.228 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.228 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.228 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.229 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.229 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.839188+0000" 2024-09-16T08:00:03.229 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.229 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.229 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.229 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.774011+0000" 2024-09-16T08:00:03.229 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.229 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.229 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.229 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.229 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.229 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.229 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.230 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.230 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.230 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.230 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.230 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.230 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.230 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.230 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.230 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.778134+0000" 2024-09-16T08:00:03.230 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.230 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.230 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.230 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.230 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.231 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.231 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.231 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.231 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.231 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.231 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.231 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.231 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.231 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.231 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.231 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.231 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.231 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.232 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.232 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.232 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.232 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.232 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.232 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.232 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.232 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.232 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.232 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.232 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.232 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.232 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.233 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.779696+0000" 2024-09-16T08:00:03.233 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.233 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.233 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.233 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.233 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.233 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.233 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.233 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.233 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.233 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.233 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.233 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.233 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.234 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.234 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.234 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.234 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.234 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.234 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.234 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.234 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.234 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.234 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.234 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.784909+0000" 2024-09-16T08:00:03.234 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.234 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.235 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.235 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.235 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.235 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.235 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.235 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.235 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.235 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.235 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.235 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.235 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.235 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.235 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.235 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.838210+0000" 2024-09-16T08:00:03.236 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.236 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.236 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.236 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.236 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.236 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.236 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.236 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.236 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.236 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.236 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.236 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.236 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.237 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 201, 2024-09-16T08:00:03.237 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.237 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.237 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.237 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.765421+0000" 2024-09-16T08:00:03.237 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.237 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.237 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.237 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.765439+0000" 2024-09-16T08:00:03.237 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.237 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.237 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.237 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.237 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.238 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.238 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.238 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.765570+0000" 2024-09-16T08:00:03.238 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.238 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.238 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.238 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.238 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.238 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.238 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.238 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.238 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.238 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.238 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.239 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.239 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.239 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.239 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.239 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.765706+0000" 2024-09-16T08:00:03.239 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.239 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.239 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.239 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.239 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.239 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.239 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.239 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.771730+0000" 2024-09-16T08:00:03.240 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.240 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.240 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.240 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.240 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.240 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.240 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.240 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.240 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.240 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.240 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.240 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.240 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.240 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.241 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.241 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.884469+0000" 2024-09-16T08:00:03.241 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.241 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.241 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.241 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.772661+0000" 2024-09-16T08:00:03.241 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.241 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.241 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.241 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.241 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.241 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.241 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.241 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.773271+0000" 2024-09-16T08:00:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.243 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.243 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.243 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.243 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.243 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.243 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.243 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.243 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.243 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.243 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.243 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.243 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.243 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.243 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.244 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.244 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.244 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.244 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.244 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.244 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.244 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.244 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.244 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.244 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.244 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.244 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.778181+0000" 2024-09-16T08:00:03.244 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.245 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.245 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.245 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.245 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.245 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.245 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.245 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.245 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.245 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.245 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.245 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.245 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.245 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.245 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.246 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.246 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.246 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.246 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.246 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.246 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.246 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.246 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.246 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.796003+0000" 2024-09-16T08:00:03.246 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.246 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.246 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.246 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.246 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.879858+0000" 2024-09-16T08:00:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.248 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.248 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.248 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.248 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.248 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.248 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.248 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.248 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.248 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.248 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.248 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 205, 2024-09-16T08:00:03.248 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.248 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.248 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.249 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.773024+0000" 2024-09-16T08:00:03.249 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.249 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.249 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.249 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.773041+0000" 2024-09-16T08:00:03.249 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.249 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.249 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.249 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.249 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.249 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.249 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.249 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.773295+0000" 2024-09-16T08:00:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.250 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.251 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.251 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.773451+0000" 2024-09-16T08:00:03.251 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.251 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.251 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.251 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.251 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.251 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.251 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.251 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.780810+0000" 2024-09-16T08:00:03.251 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.251 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.251 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.252 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.252 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.252 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.252 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.252 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.252 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.252 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.252 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.252 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.252 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.252 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.252 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.252 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.890034+0000" 2024-09-16T08:00:03.252 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.253 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.253 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.253 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.783737+0000" 2024-09-16T08:00:03.253 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.253 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.253 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.253 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.253 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.253 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.253 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.253 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.253 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.253 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.254 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.254 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.254 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.254 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.254 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.254 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.786844+0000" 2024-09-16T08:00:03.254 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.254 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.254 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.254 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.254 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.254 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.254 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.254 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.255 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.255 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.255 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.255 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.255 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.255 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.255 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.255 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.255 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.255 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.255 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.255 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.255 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.256 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.256 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.256 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.256 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.256 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.256 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.256 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.256 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.256 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.256 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.256 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.796752+0000" 2024-09-16T08:00:03.256 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.256 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.257 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.257 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.257 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.257 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.257 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.257 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.257 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.257 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.257 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.257 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.257 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.257 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.257 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.258 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.258 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.258 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.258 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.258 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.258 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.258 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.258 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.258 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.825360+0000" 2024-09-16T08:00:03.258 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.258 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.258 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.259 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.259 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.259 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.259 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.259 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.259 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.259 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.259 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.259 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.259 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.259 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.259 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.259 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.884752+0000" 2024-09-16T08:00:03.259 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.260 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.260 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.260 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.260 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.260 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.260 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.260 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.260 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.260 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.260 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.260 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.260 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.260 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 214, 2024-09-16T08:00:03.260 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.261 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.261 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.261 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.850250+0000" 2024-09-16T08:00:03.261 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.261 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.261 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.261 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.850270+0000" 2024-09-16T08:00:03.261 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.261 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.261 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.261 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.261 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.262 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.262 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.262 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.850427+0000" 2024-09-16T08:00:03.262 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.262 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.262 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.262 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.262 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.262 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.262 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.262 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.262 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.262 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.262 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.263 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.263 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.263 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.263 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.263 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.850527+0000" 2024-09-16T08:00:03.263 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.263 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.263 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.263 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.263 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.263 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.263 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.263 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.851151+0000" 2024-09-16T08:00:03.264 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.264 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.264 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.264 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.264 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.264 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.264 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.264 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.264 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.264 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.264 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.264 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.264 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.264 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.265 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.265 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.936746+0000" 2024-09-16T08:00:03.265 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.265 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.265 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.265 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.851851+0000" 2024-09-16T08:00:03.265 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.265 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.265 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.265 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.265 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.265 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.265 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.266 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.266 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.266 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.266 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.266 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.266 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.266 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.266 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.266 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.852557+0000" 2024-09-16T08:00:03.266 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.266 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.266 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.266 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.266 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.267 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.267 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.267 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.267 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.267 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.267 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.267 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.267 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.267 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.267 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.267 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.267 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.267 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.267 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.268 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.268 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.268 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.268 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.268 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.268 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.268 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.268 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.268 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.268 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.268 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.268 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.268 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.858209+0000" 2024-09-16T08:00:03.269 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.269 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.269 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.269 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.269 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.269 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.269 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.269 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.269 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.269 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.269 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.269 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.269 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.270 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.270 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.270 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.270 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.270 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.270 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.270 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.270 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.270 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.270 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.270 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.865559+0000" 2024-09-16T08:00:03.270 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.270 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.271 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.271 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.271 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.271 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.271 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.271 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.271 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.271 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.271 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.271 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.271 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.271 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.271 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.272 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.936151+0000" 2024-09-16T08:00:03.272 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.272 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.272 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.272 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.272 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.272 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.272 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.272 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.272 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.272 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.272 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.272 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.272 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.273 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 226, 2024-09-16T08:00:03.273 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.273 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.273 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.273 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.939364+0000" 2024-09-16T08:00:03.273 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.273 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.273 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.273 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.939381+0000" 2024-09-16T08:00:03.273 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.273 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.273 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.273 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.274 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.274 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.274 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.274 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.939510+0000" 2024-09-16T08:00:03.274 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.274 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.274 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.274 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.274 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.274 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.274 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.274 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.274 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.275 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.275 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.275 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.275 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.275 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.275 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.275 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.939657+0000" 2024-09-16T08:00:03.275 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.275 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.275 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.275 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.275 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.275 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.276 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.276 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.942729+0000" 2024-09-16T08:00:03.276 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.276 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.276 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.276 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.276 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.276 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.276 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.276 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.276 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.276 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.276 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.277 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.277 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.277 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.277 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.277 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.999662+0000" 2024-09-16T08:00:03.277 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.277 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.277 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.277 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.943309+0000" 2024-09-16T08:00:03.277 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.277 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.277 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.277 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.278 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.278 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.278 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.278 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.278 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.278 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.278 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.278 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.278 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.279 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.279 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.279 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.943511+0000" 2024-09-16T08:00:03.279 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.279 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.279 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.279 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.279 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.279 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.279 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.279 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.279 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.279 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.280 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.280 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.280 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.280 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.280 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.280 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.280 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.280 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.280 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.280 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.280 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.280 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.280 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.280 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.281 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.281 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.281 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.281 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.281 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.281 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.281 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.281 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.948033+0000" 2024-09-16T08:00:03.281 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.281 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.281 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.281 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.281 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.282 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.282 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.282 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.282 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.282 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.282 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.282 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.282 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.282 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.282 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.282 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.282 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.282 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.283 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.283 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.283 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.283 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.283 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.283 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.950609+0000" 2024-09-16T08:00:03.283 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.283 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.283 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.283 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.283 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.283 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.283 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.283 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.284 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.284 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.284 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.284 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.284 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.284 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.284 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.284 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:01.999089+0000" 2024-09-16T08:00:03.284 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.284 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.284 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.284 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.284 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.285 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.285 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.285 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.285 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.285 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.285 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.285 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.285 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.285 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 242, 2024-09-16T08:00:03.285 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.285 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.285 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.285 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.019657+0000" 2024-09-16T08:00:03.285 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.286 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.286 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.286 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.019677+0000" 2024-09-16T08:00:03.286 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.286 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.286 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.286 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.286 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.286 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.286 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.286 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.019909+0000" 2024-09-16T08:00:03.286 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.286 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.287 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.287 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.287 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.287 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.287 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.287 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.287 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.287 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.287 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.287 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.287 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.287 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.287 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.288 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.021239+0000" 2024-09-16T08:00:03.288 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.288 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.288 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.288 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.288 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.288 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.288 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.288 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.025700+0000" 2024-09-16T08:00:03.288 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.288 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.288 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.288 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.288 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.289 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.289 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.289 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.289 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.289 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.289 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.289 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.289 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.289 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.289 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.289 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.084232+0000" 2024-09-16T08:00:03.289 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.289 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.290 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.290 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.026253+0000" 2024-09-16T08:00:03.290 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.290 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.290 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.290 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.290 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.290 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.290 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.290 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.290 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.290 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.290 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.291 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.291 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.291 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.291 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.291 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.026450+0000" 2024-09-16T08:00:03.291 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.291 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.291 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.291 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.291 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.291 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.291 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.291 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.291 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.292 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.292 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.292 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.292 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.292 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.292 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.292 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.292 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.292 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.292 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.292 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.292 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.292 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.293 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.293 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.293 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.293 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.293 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.293 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.293 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.293 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.293 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.293 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.026846+0000" 2024-09-16T08:00:03.293 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.293 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.293 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.293 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.294 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.294 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.294 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.294 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.294 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.294 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.294 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.294 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.294 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.294 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.294 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.294 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.294 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.295 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.295 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.295 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.295 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.295 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.295 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.295 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.028441+0000" 2024-09-16T08:00:03.295 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.295 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.295 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.295 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.295 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.295 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.295 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.296 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.296 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.296 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.296 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.296 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.296 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.296 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.296 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.296 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.083398+0000" 2024-09-16T08:00:03.296 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.296 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.296 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.296 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.297 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.297 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.297 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.297 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.297 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.297 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.297 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.297 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.297 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.297 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 245, 2024-09-16T08:00:03.297 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.297 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.297 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.298 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.033741+0000" 2024-09-16T08:00:03.298 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.298 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.298 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.298 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.033770+0000" 2024-09-16T08:00:03.298 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.298 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.298 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.298 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.298 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.298 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.298 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.298 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.034163+0000" 2024-09-16T08:00:03.298 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.299 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.299 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.299 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.299 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.299 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.299 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.299 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.299 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.299 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.299 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.299 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.299 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.299 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.300 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.300 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.034555+0000" 2024-09-16T08:00:03.300 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.300 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.300 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.300 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.300 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.300 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.300 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.300 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.039706+0000" 2024-09-16T08:00:03.300 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.300 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.300 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.300 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.301 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.301 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.301 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.301 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.301 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.301 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.301 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.301 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.301 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.301 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.301 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.301 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.109422+0000" 2024-09-16T08:00:03.301 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.302 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.302 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.302 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.040495+0000" 2024-09-16T08:00:03.302 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.302 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.302 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.302 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.302 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.302 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.302 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.302 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.302 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.302 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.303 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.303 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.303 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.303 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.303 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.303 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.040832+0000" 2024-09-16T08:00:03.303 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.303 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.303 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.303 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.303 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.303 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.303 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.304 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.304 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.304 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.304 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.304 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.304 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.304 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.304 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.304 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.304 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.304 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.304 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.304 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.305 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.305 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.305 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.305 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.305 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.305 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.305 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.305 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.305 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.305 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.305 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.305 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.041542+0000" 2024-09-16T08:00:03.305 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.305 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.306 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.306 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.306 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.306 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.306 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.306 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.306 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.306 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.307 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.308 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.308 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.308 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.308 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.308 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.308 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.308 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.308 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.308 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.308 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.308 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.308 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.308 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.044167+0000" 2024-09-16T08:00:03.309 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.309 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.309 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.309 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.309 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.309 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.309 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.309 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.309 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.309 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.309 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.309 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.309 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.310 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.310 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.310 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.108643+0000" 2024-09-16T08:00:03.310 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.310 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.310 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.310 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.310 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.310 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.310 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.310 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.310 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.310 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.310 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.311 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.311 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.311 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 255, 2024-09-16T08:00:03.311 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.311 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.311 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.311 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.099963+0000" 2024-09-16T08:00:03.311 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.311 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.311 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.311 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.099996+0000" 2024-09-16T08:00:03.311 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.311 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.312 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.312 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.312 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.312 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.100293+0000" 2024-09-16T08:00:03.312 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.312 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.312 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.312 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.312 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.312 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.313 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.313 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.313 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.313 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.313 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.313 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.313 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.313 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.313 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.100410+0000" 2024-09-16T08:00:03.313 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.313 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.313 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.313 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.313 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.314 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.314 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.314 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.100730+0000" 2024-09-16T08:00:03.314 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.314 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.314 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.314 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.314 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.315 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.315 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.315 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.315 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.315 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.315 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.315 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.315 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.315 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.315 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.315 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.209586+0000" 2024-09-16T08:00:03.316 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.316 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.316 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.101148+0000" 2024-09-16T08:00:03.316 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.316 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.316 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.316 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.316 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.317 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.317 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.317 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.317 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.317 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.317 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.317 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.317 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.317 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.101378+0000" 2024-09-16T08:00:03.317 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.317 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.318 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.318 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.318 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.318 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.318 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.318 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.318 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.318 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.318 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.318 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.318 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.319 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.319 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.319 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.319 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.319 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.319 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.319 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.319 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.320 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.320 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.320 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.320 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.101779+0000" 2024-09-16T08:00:03.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.320 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.320 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.321 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.321 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.321 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.321 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.322 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.322 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.322 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.322 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.322 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.103544+0000" 2024-09-16T08:00:03.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.323 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.323 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.323 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.323 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.323 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.323 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.324 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.203323+0000" 2024-09-16T08:00:03.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.324 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.324 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.324 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.325 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.325 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.325 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.325 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.325 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.325 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 261, 2024-09-16T08:00:03.325 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.325 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.325 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.325 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.114439+0000" 2024-09-16T08:00:03.325 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.326 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.114468+0000" 2024-09-16T08:00:03.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.326 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.326 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.326 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.115681+0000" 2024-09-16T08:00:03.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.327 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.327 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.327 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.327 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.327 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.328 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.115877+0000" 2024-09-16T08:00:03.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.328 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.328 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.329 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.329 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.124928+0000" 2024-09-16T08:00:03.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.329 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.329 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.329 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.329 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.330 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.330 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.330 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.330 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.229258+0000" 2024-09-16T08:00:03.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.330 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.330 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.125669+0000" 2024-09-16T08:00:03.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.126029+0000" 2024-09-16T08:00:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.333 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.333 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.333 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.333 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.333 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.333 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.333 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.333 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.333 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.333 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.333 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.334 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.334 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.334 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.334 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.334 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.334 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.334 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.334 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.334 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.335 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.126732+0000" 2024-09-16T08:00:03.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.335 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.335 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.335 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.335 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.335 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.336 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.336 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.336 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.336 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.336 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.336 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.337 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.135829+0000" 2024-09-16T08:00:03.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.337 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.337 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.337 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.337 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.337 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.338 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.338 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.338 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.227702+0000" 2024-09-16T08:00:03.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.338 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.338 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.338 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.338 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.339 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.339 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.339 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.339 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.339 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 263, 2024-09-16T08:00:03.339 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.339 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.339 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.339 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.139988+0000" 2024-09-16T08:00:03.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.339 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.140007+0000" 2024-09-16T08:00:03.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.340 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.340 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.340 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.140267+0000" 2024-09-16T08:00:03.340 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.341 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.341 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.341 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.341 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.341 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.342 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.140764+0000" 2024-09-16T08:00:03.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.342 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.342 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.342 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.343 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.146488+0000" 2024-09-16T08:00:03.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.343 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.343 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.343 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.343 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.343 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.343 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.344 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.344 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.344 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.344 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.234851+0000" 2024-09-16T08:00:03.344 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.344 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.344 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.147182+0000" 2024-09-16T08:00:03.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.345 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.345 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.345 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.345 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.345 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.346 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.147525+0000" 2024-09-16T08:00:03.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.346 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.346 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.347 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.347 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.347 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.347 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.347 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.348 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.348 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.348 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.348 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.348 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.348 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.348 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.349 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.349 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.349 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.349 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.148289+0000" 2024-09-16T08:00:03.349 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.349 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.349 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.350 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.350 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.350 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.350 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.351 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.351 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.351 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.351 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.351 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.351 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.151316+0000" 2024-09-16T08:00:03.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.351 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.352 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.352 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.352 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.352 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.352 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.352 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.353 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.230220+0000" 2024-09-16T08:00:03.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.353 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.353 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.353 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.353 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.354 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.354 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.354 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.354 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 276, 2024-09-16T08:00:03.354 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.354 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.354 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.187974+0000" 2024-09-16T08:00:03.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.354 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.187995+0000" 2024-09-16T08:00:03.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.355 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.355 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.355 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.191328+0000" 2024-09-16T08:00:03.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.355 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.356 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.356 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.356 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.356 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.356 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.356 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.356 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.191600+0000" 2024-09-16T08:00:03.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.357 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.357 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.357 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.192772+0000" 2024-09-16T08:00:03.357 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.357 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.358 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.358 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.358 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.358 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.358 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.359 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.283028+0000" 2024-09-16T08:00:03.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.359 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.193202+0000" 2024-09-16T08:00:03.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.359 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.359 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.359 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.360 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.360 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.360 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.360 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.360 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.360 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.360 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.193767+0000" 2024-09-16T08:00:03.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.361 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.361 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.361 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.361 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.361 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.362 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.362 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.362 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.362 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.363 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.363 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.363 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.363 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.197372+0000" 2024-09-16T08:00:03.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.363 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.364 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.364 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.364 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.364 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.364 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.364 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.365 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.365 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.365 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.365 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.365 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.202782+0000" 2024-09-16T08:00:03.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.366 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.366 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.366 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.366 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.366 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.367 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.367 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.367 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.278899+0000" 2024-09-16T08:00:03.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.367 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.367 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.367 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.368 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.368 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.368 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.368 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.368 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.368 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.368 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 284, 2024-09-16T08:00:03.368 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.368 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.369 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.225676+0000" 2024-09-16T08:00:03.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.369 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.369 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.225693+0000" 2024-09-16T08:00:03.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.369 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.369 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.370 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.225891+0000" 2024-09-16T08:00:03.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.370 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.370 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.370 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.371 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.371 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.371 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.371 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.226029+0000" 2024-09-16T08:00:03.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.371 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.372 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.372 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.372 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.226353+0000" 2024-09-16T08:00:03.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.372 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.372 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.372 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.372 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.373 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.373 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.373 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.373 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.373 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.305681+0000" 2024-09-16T08:00:03.373 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.374 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.374 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.226775+0000" 2024-09-16T08:00:03.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.374 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.374 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.374 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.374 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.375 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.375 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.375 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.375 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.227353+0000" 2024-09-16T08:00:03.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.375 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.375 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.376 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.376 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.376 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.376 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.377 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.377 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.377 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.377 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.377 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.377 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.378 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.228149+0000" 2024-09-16T08:00:03.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.378 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.378 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.378 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.379 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.379 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.379 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.380 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.380 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.380 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.380 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.234618+0000" 2024-09-16T08:00:03.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.380 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.380 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.381 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.381 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.381 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.381 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.381 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.381 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.304220+0000" 2024-09-16T08:00:03.382 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.382 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.382 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.382 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.382 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.382 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.382 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.382 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.382 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.382 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.382 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.383 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.383 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.383 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 288, 2024-09-16T08:00:03.383 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.383 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.383 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.243992+0000" 2024-09-16T08:00:03.383 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.383 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.384 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.244026+0000" 2024-09-16T08:00:03.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.384 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.384 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.384 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.384 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.244259+0000" 2024-09-16T08:00:03.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.385 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.385 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.385 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.385 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.385 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.385 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.385 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.385 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.385 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.386 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.386 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.247058+0000" 2024-09-16T08:00:03.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.386 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.386 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.386 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.386 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.386 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.247506+0000" 2024-09-16T08:00:03.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.387 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.387 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.387 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.387 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.387 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.388 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.388 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.388 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.306832+0000" 2024-09-16T08:00:03.388 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.388 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.388 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.248152+0000" 2024-09-16T08:00:03.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.389 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.389 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.389 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.389 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.389 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.389 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.389 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.389 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.390 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.390 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.390 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.390 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.248345+0000" 2024-09-16T08:00:03.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.390 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.390 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.390 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.391 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.391 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.391 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.391 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.391 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.391 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.391 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.392 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.392 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.392 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.392 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.393 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.393 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.393 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.393 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.248782+0000" 2024-09-16T08:00:03.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.393 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.393 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.394 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.394 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.394 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.394 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.394 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.394 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.394 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.394 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.394 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.394 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.395 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.395 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.395 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.395 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.250700+0000" 2024-09-16T08:00:03.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.395 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.395 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.396 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.396 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.396 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.396 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.396 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.396 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.305792+0000" 2024-09-16T08:00:03.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.397 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.397 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.397 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.397 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.397 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.397 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.397 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.397 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.398 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.398 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.398 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 292, 2024-09-16T08:00:03.398 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.398 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.398 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.398 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.267792+0000" 2024-09-16T08:00:03.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.398 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.398 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.398 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.267811+0000" 2024-09-16T08:00:03.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.399 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.399 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.399 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.399 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.269279+0000" 2024-09-16T08:00:03.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.399 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.400 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.400 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.400 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.400 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.400 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.400 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.400 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.400 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.400 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.400 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.401 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.269420+0000" 2024-09-16T08:00:03.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.401 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.401 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.401 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.401 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.271041+0000" 2024-09-16T08:00:03.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.402 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.402 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.402 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.402 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.402 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.402 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.403 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.403 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.368702+0000" 2024-09-16T08:00:03.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.403 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.403 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.271451+0000" 2024-09-16T08:00:03.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.403 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.403 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.403 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.404 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.404 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.404 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.404 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.404 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.404 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.404 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.404 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.271653+0000" 2024-09-16T08:00:03.404 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.405 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.405 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.405 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.405 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.405 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.405 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.405 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.405 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.406 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.406 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.406 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.406 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.406 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.406 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.406 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.407 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.407 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.407 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.407 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.407 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.407 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.272057+0000" 2024-09-16T08:00:03.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.407 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.407 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.408 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.408 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.408 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.408 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.408 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.408 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.408 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.408 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.408 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.408 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.408 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.409 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.409 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.409 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.409 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.409 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.409 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.409 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.409 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.274016+0000" 2024-09-16T08:00:03.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.410 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.410 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.410 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.410 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.410 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.411 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.411 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.411 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.368043+0000" 2024-09-16T08:00:03.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.411 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.411 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.411 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.411 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.412 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.412 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.412 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.412 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.412 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.412 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 303, 2024-09-16T08:00:03.412 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.412 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.412 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.412 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.348994+0000" 2024-09-16T08:00:03.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.413 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.413 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.349014+0000" 2024-09-16T08:00:03.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.413 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.413 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.413 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.414 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.414 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.349505+0000" 2024-09-16T08:00:03.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.414 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.414 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.414 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.414 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.414 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.414 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.415 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.415 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.415 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.415 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.415 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.415 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.415 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.349778+0000" 2024-09-16T08:00:03.415 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.415 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.415 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.415 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.416 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.416 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.416 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.416 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.353229+0000" 2024-09-16T08:00:03.416 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.416 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.416 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.416 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.416 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.416 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.416 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.417 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.417 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.417 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.417 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.417 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.405446+0000" 2024-09-16T08:00:03.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.417 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.418 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.353689+0000" 2024-09-16T08:00:03.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.418 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.418 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.418 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.418 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.418 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.419 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.419 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.419 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.353959+0000" 2024-09-16T08:00:03.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.419 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.419 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.419 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.420 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.420 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.420 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.420 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.420 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.421 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.421 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.421 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.421 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.421 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.421 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.422 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.422 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.422 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.422 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.354609+0000" 2024-09-16T08:00:03.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.422 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.422 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.422 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.423 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.423 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.423 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.423 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.423 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.423 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.424 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.424 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.424 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.424 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.424 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.424 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.424 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.424 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.357642+0000" 2024-09-16T08:00:03.424 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.424 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.425 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.425 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.425 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.425 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.425 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.425 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.425 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.425 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.425 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.426 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.426 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.426 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.404844+0000" 2024-09-16T08:00:03.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.426 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.426 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.426 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.427 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.427 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.427 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.427 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.427 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.427 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.427 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.427 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 305, 2024-09-16T08:00:03.427 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.427 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.427 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.428 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.355078+0000" 2024-09-16T08:00:03.428 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.428 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.428 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.428 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.355089+0000" 2024-09-16T08:00:03.428 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.428 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.428 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.428 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.428 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.429 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.429 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.355326+0000" 2024-09-16T08:00:03.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.429 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.429 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.429 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.430 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.430 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.430 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.430 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.430 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.355471+0000" 2024-09-16T08:00:03.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.430 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.431 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.431 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.431 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.355862+0000" 2024-09-16T08:00:03.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.431 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.431 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.431 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.432 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.432 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.432 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.432 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.432 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.430142+0000" 2024-09-16T08:00:03.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.433 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.433 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.356267+0000" 2024-09-16T08:00:03.433 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.433 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.433 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.433 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.433 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.433 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.434 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.434 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.434 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.434 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.434 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.434 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.434 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.434 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.356461+0000" 2024-09-16T08:00:03.434 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.434 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.434 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.435 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.435 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.435 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.435 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.435 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.435 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.436 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.436 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.436 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.436 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.436 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.436 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.436 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.436 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.437 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.437 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.437 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.437 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.437 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.437 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.356918+0000" 2024-09-16T08:00:03.437 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.437 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.437 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.437 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.438 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.438 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.438 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.438 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.438 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.438 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.438 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.438 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.438 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.439 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.439 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.439 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.439 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.363234+0000" 2024-09-16T08:00:03.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.439 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.439 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.440 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.440 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.440 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.440 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.440 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.440 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.440 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.440 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.440 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.429472+0000" 2024-09-16T08:00:03.441 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.441 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.441 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.441 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.441 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.441 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.441 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.441 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.441 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.441 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.441 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.442 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.442 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.442 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 308, 2024-09-16T08:00:03.442 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.442 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.442 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.358034+0000" 2024-09-16T08:00:03.442 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.442 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.443 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.358044+0000" 2024-09-16T08:00:03.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.443 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.443 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.443 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.443 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.362754+0000" 2024-09-16T08:00:03.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.443 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.444 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.444 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.444 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.444 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.444 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.444 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.444 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.444 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.444 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.445 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.363125+0000" 2024-09-16T08:00:03.445 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.445 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.445 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.445 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.445 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.445 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.369022+0000" 2024-09-16T08:00:03.445 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.446 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.446 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.446 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.446 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.446 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.446 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.446 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.446 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.446 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.446 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.446 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.447 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.447 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.454342+0000" 2024-09-16T08:00:03.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.447 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.447 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.369595+0000" 2024-09-16T08:00:03.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.447 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.448 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.448 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.448 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.448 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.448 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.448 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.449 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.370000+0000" 2024-09-16T08:00:03.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.449 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.449 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.449 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.449 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.450 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.450 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.450 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.450 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.450 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.450 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.450 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.450 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.451 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.451 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.451 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.451 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.451 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.451 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.451 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.451 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.452 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.370719+0000" 2024-09-16T08:00:03.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.452 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.452 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.452 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.452 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.452 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.452 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.452 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.453 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.453 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.453 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.453 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.453 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.453 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.453 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.453 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.453 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.453 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.454 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.454 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.373284+0000" 2024-09-16T08:00:03.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.454 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.454 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.454 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.455 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.455 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.455 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.455 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.455 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.450593+0000" 2024-09-16T08:00:03.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.455 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.456 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.456 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.456 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.456 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.456 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.456 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.456 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.456 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.456 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:03.456 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:00:03.457 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 329, 2024-09-16T08:00:03.457 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:03.457 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.457 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:03.457 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.515994+0000" 2024-09-16T08:00:03.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.457 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.457 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:00:03.457 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.516006+0000" 2024-09-16T08:00:03.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.457 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.458 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.458 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.458 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:00:03.458 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.516504+0000" 2024-09-16T08:00:03.458 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.458 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.458 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.458 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.459 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.459 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:00:03.459 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.459 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.459 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.459 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.459 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.459 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.459 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.459 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:00:03.459 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.520312+0000" 2024-09-16T08:00:03.459 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.459 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.460 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.460 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.460 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.460 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.460 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:00:03.460 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.525063+0000" 2024-09-16T08:00:03.460 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.460 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.460 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.460 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.460 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.461 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.461 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:00:03.461 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.461 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.461 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.461 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.461 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.461 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.461 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.461 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.462 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.609752+0000" 2024-09-16T08:00:03.462 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.462 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.462 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:00:03.462 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.525493+0000" 2024-09-16T08:00:03.462 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.462 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.462 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.462 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.462 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.462 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.463 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:03.463 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.463 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.463 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.463 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.463 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.463 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.463 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.463 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:00:03.463 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.525699+0000" 2024-09-16T08:00:03.463 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.463 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.464 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.464 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.464 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.464 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.464 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:00:03.464 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.464 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.464 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.464 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.464 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.464 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.465 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.465 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:00:03.465 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.465 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.465 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.465 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.465 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.465 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.465 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.465 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:00:03.465 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.465 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.466 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.466 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.466 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.466 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.466 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.466 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:00:03.466 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.526132+0000" 2024-09-16T08:00:03.466 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.466 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.466 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.466 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.466 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.467 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.467 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:00:03.467 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.467 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.467 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.467 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.467 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.467 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.467 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.467 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:00:03.467 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.467 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.468 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.468 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.468 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.468 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.468 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.468 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:00:03.468 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.528746+0000" 2024-09-16T08:00:03.468 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.468 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.468 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.468 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.469 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.469 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.469 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:00:03.469 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.469 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.469 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.469 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.469 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.469 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.469 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:00:03.469 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:00:03.469 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:02.609001+0000" 2024-09-16T08:00:03.470 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.470 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.470 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:03.470 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.470 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:03.470 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:00:03.470 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:03.470 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:03.470 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.470 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.470 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:03.471 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T08:00:03.471 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T08:00:03.473 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:00:03.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:02.832+0000 7f4f7c2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:03.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:02.842+0000 7f4f7c2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:03.473 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T08:00:03.474 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:00:05.475 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:00:05.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:05.643+0000 7f7872e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:05.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:05.651+0000 7f7872e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:05.833 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T08:00:05.868 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:00:05.869 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:00:07.869 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:00:08.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:08.016+0000 7f8f4fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:08.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:08.025+0000 7f8f4fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:08.323 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T08:00:08.448 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:00:08.449 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:00:08.473 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2] live_osds: [3, 0, 1] 2024-09-16T08:00:08.473 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:00:08.473 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-09-16T08:00:08.474 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T08:00:08.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T08:00:08.476 INFO:tasks.ceph.osd.2:Started 2024-09-16T08:00:08.476 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T08:00:08.596 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T08:00:08.600 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:00:08.601 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-16T08:00:10.450 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:00:10.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:10.612+0000 7ff213abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:10.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:10.624+0000 7ff213abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:10.909 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T08:00:11.145 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:00:11.145 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:00:13.146 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:00:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:13.293+0000 7fc58a8b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:13.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:13.301+0000 7fc58a8b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:13.439 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T08:00:13.601 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T08:00:13.693 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:00:13.693 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:00:13.706 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T08:00:13.709 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:00:13.710 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-16T08:00:15.694 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:00:15.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:15.868+0000 7fde03191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:15.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:15.877+0000 7fde03191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:16.073 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T08:00:16.118 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:00:16.118 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:00:18.119 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:00:18.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:18.262+0000 7efc00b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:18.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:18.271+0000 7efc00b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:18.562 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T08:00:18.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T08:00:18.777 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:00:18.778 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:00:18.851 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T08:00:18.856 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:00:18.857 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-16T08:00:20.779 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:00:20.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:20.891+0000 7fef1e69c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:20.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:20.898+0000 7fef1e69c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:22.997 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:00:23.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:23.140+0000 7f8638111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:23.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:23.147+0000 7f8638111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:23.857 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-16T08:00:24.046 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-16T08:00:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: "ops_in_flight": [ 2024-09-16T08:00:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T08:00:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "replicated_request", 2024-09-16T08:00:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 372, 2024-09-16T08:00:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T08:00:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "RepRequest": { 2024-09-16T08:00:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "reqid": "client.5431.0:18776", 2024-09-16T08:00:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "7.3", 2024-09-16T08:00:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 156, 2024-09-16T08:00:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "min_epoch": 154, 2024-09-16T08:00:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "oid": "7:cc31a8d1:::benchmark_data_smithi003_49564_object6810:head", 2024-09-16T08:00:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "from": "3" 2024-09-16T08:00:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T08:00:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T08:00:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T08:00:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T08:00:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "background_recovery_sub", 2024-09-16T08:00:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 370, 2024-09-16T08:00:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": {} 2024-09-16T08:00:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T08:00:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T08:00:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "background_recovery_sub", 2024-09-16T08:00:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 373, 2024-09-16T08:00:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": {} 2024-09-16T08:00:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T08:00:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T08:00:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "replicated_request", 2024-09-16T08:00:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 366, 2024-09-16T08:00:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T08:00:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "RepRequest": { 2024-09-16T08:00:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "reqid": "client.5431.0:18753", 2024-09-16T08:00:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "7.b", 2024-09-16T08:00:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 156, 2024-09-16T08:00:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "min_epoch": 154, 2024-09-16T08:00:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "oid": "7:df4aeb03:::benchmark_data_smithi003_49564_object6787:head", 2024-09-16T08:00:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "from": "1" 2024-09-16T08:00:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T08:00:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T08:00:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T08:00:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T08:00:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "replicated_request", 2024-09-16T08:00:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 365, 2024-09-16T08:00:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": { 2024-09-16T08:00:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "RepRequest": { 2024-09-16T08:00:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "reqid": "client.5431.0:18747", 2024-09-16T08:00:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "pgid": "7.b", 2024-09-16T08:00:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 156, 2024-09-16T08:00:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "min_epoch": 154, 2024-09-16T08:00:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "oid": "7:da32a69e:::benchmark_data_smithi003_49564_object6781:head", 2024-09-16T08:00:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "from": "1" 2024-09-16T08:00:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T08:00:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T08:00:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-16T08:00:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-16T08:00:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "background_recovery_sub", 2024-09-16T08:00:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 373, 2024-09-16T08:00:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: "detail": {} 2024-09-16T08:00:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-16T08:00:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-16T08:00:24.051 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-16T08:00:25.410 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:00:25.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:25.573+0000 7faec2d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:25.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:25.581+0000 7faec2d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:27.947 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:00:28.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:28.090+0000 7ff69b857640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:28.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:28.101+0000 7ff69b857640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:29.061 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 0, 1, 2] 2024-09-16T08:00:29.061 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:00:29.062 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:00:29.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:29.218+0000 7f1f6127d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:29.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:29.236+0000 7f1f6127d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:29.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T08:00:29.615 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T08:00:29.638 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":610,"stamp":"2024-09-16T08:00:28.491556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":563413568,"num_objects":8593,"num_object_clones":0,"num_object_copies":25779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2383,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":15183,"num_write_kb":759188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15162,"ondisk_log_size":15162,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":274616,"kb_used_data":109240,"kb_used_omap":0,"kb_used_meta":165312,"kb_avail":377212744,"statfs":{"total":386547056640,"available":386265849856,"internally_reserved":0,"allocated":111861760,"data_stored":1712666273,"data_compressed":81237740,"data_compressed_allocated":106930176,"data_compressed_original":1710637056,"omap_allocated":0,"internal_metadata":169279488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.396050"},"pg_stats":[{"pgid":"7.f","version":"149'1026","reported_seq":1118,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-16T08:00:03.124918+0000","last_change":"2024-09-16T08:00:02.514200+0000","last_active":"2024-09-16T08:00:03.124918+0000","last_peered":"2024-09-16T08:00:03.124918+0000","last_clean":"2024-09-16T08:00:03.124918+0000","last_became_active":"2024-09-16T08:00:01.337680+0000","last_became_peered":"2024-09-16T08:00:01.337680+0000","last_unstale":"2024-09-16T08:00:03.124918+0000","last_undegraded":"2024-09-16T08:00:03.124918+0000","last_fullsized":"2024-09-16T08:00:03.124918+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1026,"log_dups_size":0,"ondisk_log_size":1026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30146560,"num_objects":460,"num_object_clones":0,"num_object_copies":1380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1026,"num_write_kb":47552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"142'733","reported_seq":776,"reported_epoch":142,"state":"stale+active+clean","last_fresh":"2024-09-16T07:58:49.944012+0000","last_change":"2024-09-16T07:58:34.224845+0000","last_active":"2024-09-16T07:58:49.944012+0000","last_peered":"2024-09-16T07:58:49.944012+0000","last_clean":"2024-09-16T07:58:49.944012+0000","last_became_active":"2024-09-16T07:58:34.204525+0000","last_became_peered":"2024-09-16T07:58:34.204525+0000","last_unstale":"2024-09-16T07:59:45.089211+0000","last_undegraded":"2024-09-16T07:58:49.944012+0000","last_fullsized":"2024-09-16T07:58:49.944012+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":733,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"142'971","reported_seq":1014,"reported_epoch":142,"state":"stale+active+clean","last_fresh":"2024-09-16T07:59:14.468138+0000","last_change":"2024-09-16T07:57:21.658292+0000","last_active":"2024-09-16T07:59:14.468138+0000","last_peered":"2024-09-16T07:59:14.468138+0000","last_clean":"2024-09-16T07:59:14.468138+0000","last_became_active":"2024-09-16T07:57:21.649725+0000","last_became_peered":"2024-09-16T07:57:21.649725+0000","last_unstale":"2024-09-16T07:59:56.098437+0000","last_undegraded":"2024-09-16T07:59:14.468138+0000","last_fullsized":"2024-09-16T07:59:14.468138+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":971,"log_dups_size":0,"ondisk_log_size":971,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30670872,"num_objects":469,"num_object_clones":0,"num_object_copies":1407,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":971,"num_write_kb":46017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"150'1026","reported_seq":1089,"reported_epoch":150,"state":"active+undersized+degraded","last_fresh":"2024-09-16T08:00:03.116268+0000","last_change":"2024-09-16T08:00:01.557608+0000","last_active":"2024-09-16T08:00:03.116268+0000","last_peered":"2024-09-16T08:00:03.116268+0000","last_clean":"2024-09-16T07:59:14.452073+0000","last_became_active":"2024-09-16T08:00:01.264559+0000","last_became_peered":"2024-09-16T08:00:01.264559+0000","last_unstale":"2024-09-16T08:00:03.116268+0000","last_undegraded":"2024-09-16T08:00:01.187933+0000","last_fullsized":"2024-09-16T08:00:01.166556+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1026,"log_dups_size":0,"ondisk_log_size":1026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28770304,"num_objects":439,"num_object_clones":0,"num_object_copies":1317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":439,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1025,"num_write_kb":46848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":439}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"142'928","reported_seq":978,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-16T07:59:14.323460+0000","last_change":"2024-09-16T07:58:34.777673+0000","last_active":"2024-09-16T07:59:14.323460+0000","last_peered":"2024-09-16T07:59:14.323460+0000","last_clean":"2024-09-16T07:59:14.323460+0000","last_became_active":"2024-09-16T07:58:34.331701+0000","last_became_peered":"2024-09-16T07:58:34.331701+0000","last_unstale":"2024-09-16T07:59:14.323460+0000","last_undegraded":"2024-09-16T07:59:14.323460+0000","last_fullsized":"2024-09-16T07:59:14.323460+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31064064,"num_objects":474,"num_object_clones":0,"num_object_copies":1422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":928,"num_write_kb":44864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"149'1033","reported_seq":1102,"reported_epoch":150,"state":"active+undersized+degraded","last_fresh":"2024-09-16T08:00:03.106916+0000","last_change":"2024-09-16T07:59:57.226164+0000","last_active":"2024-09-16T08:00:03.106916+0000","last_peered":"2024-09-16T08:00:03.106916+0000","last_clean":"2024-09-16T07:59:46.226120+0000","last_became_active":"2024-09-16T07:59:57.226164+0000","last_became_peered":"2024-09-16T07:59:57.226164+0000","last_unstale":"2024-09-16T08:00:03.106916+0000","last_undegraded":"2024-09-16T07:59:57.123405+0000","last_fullsized":"2024-09-16T07:59:57.122349+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30081024,"num_objects":459,"num_object_clones":0,"num_object_copies":1377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":459,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1033,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[{"shards":"0,3","objects":459}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"149'1097","reported_seq":1160,"reported_epoch":150,"state":"active+undersized+degraded","last_fresh":"2024-09-16T08:00:03.117396+0000","last_change":"2024-09-16T08:00:01.596355+0000","last_active":"2024-09-16T08:00:03.117396+0000","last_peered":"2024-09-16T08:00:03.117396+0000","last_clean":"2024-09-16T07:59:14.513648+0000","last_became_active":"2024-09-16T08:00:01.314141+0000","last_became_peered":"2024-09-16T08:00:01.314141+0000","last_unstale":"2024-09-16T08:00:03.117396+0000","last_undegraded":"2024-09-16T08:00:01.214999+0000","last_fullsized":"2024-09-16T08:00:01.193015+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33685504,"num_objects":514,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":514,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1096,"num_write_kb":51520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[{"shards":"1,3","objects":514}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"142'704","reported_seq":754,"reported_epoch":142,"state":"stale+active+clean","last_fresh":"2024-09-16T07:58:50.032986+0000","last_change":"2024-09-16T07:58:34.626925+0000","last_active":"2024-09-16T07:58:50.032986+0000","last_peered":"2024-09-16T07:58:50.032986+0000","last_clean":"2024-09-16T07:58:50.032986+0000","last_became_active":"2024-09-16T07:58:34.283717+0000","last_became_peered":"2024-09-16T07:58:34.283717+0000","last_unstale":"2024-09-16T07:59:45.089214+0000","last_undegraded":"2024-09-16T07:58:50.032986+0000","last_fullsized":"2024-09-16T07:58:50.032986+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":704,"num_object_clones":0,"num_object_copies":2112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"149'1064","reported_seq":1144,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-16T08:00:03.118815+0000","last_change":"2024-09-16T08:00:01.892735+0000","last_active":"2024-09-16T08:00:03.118815+0000","last_peered":"2024-09-16T08:00:03.118815+0000","last_clean":"2024-09-16T08:00:03.118815+0000","last_became_active":"2024-09-16T08:00:01.269427+0000","last_became_peered":"2024-09-16T08:00:01.269427+0000","last_unstale":"2024-09-16T08:00:03.118815+0000","last_undegraded":"2024-09-16T08:00:03.118815+0000","last_fullsized":"2024-09-16T08:00:03.118815+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1064,"log_dups_size":0,"ondisk_log_size":1064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1064,"num_write_kb":48576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":449,"reported_epoch":150,"state":"active+undersized+degraded","last_fresh":"2024-09-16T08:00:03.097018+0000","last_change":"2024-09-16T07:59:57.203544+0000","last_active":"2024-09-16T08:00:03.097018+0000","last_peered":"2024-09-16T08:00:03.097018+0000","last_clean":"2024-09-16T07:59:46.109249+0000","last_became_active":"2024-09-16T07:59:57.203544+0000","last_became_peered":"2024-09-16T07:59:57.203544+0000","last_unstale":"2024-09-16T08:00:03.097018+0000","last_undegraded":"2024-09-16T07:59:57.129840+0000","last_fullsized":"2024-09-16T07:59:57.128758+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[{"shards":"0,3","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":364,"reported_epoch":142,"state":"stale+active+clean","last_fresh":"2024-09-16T07:58:35.140808+0000","last_change":"2024-09-16T07:56:53.084080+0000","last_active":"2024-09-16T07:58:35.140808+0000","last_peered":"2024-09-16T07:58:35.140808+0000","last_clean":"2024-09-16T07:58:35.140808+0000","last_became_active":"2024-09-16T07:56:52.254637+0000","last_became_peered":"2024-09-16T07:56:52.254637+0000","last_unstale":"2024-09-16T07:59:45.089215+0000","last_undegraded":"2024-09-16T07:58:35.140808+0000","last_fullsized":"2024-09-16T07:58:35.140808+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"142'721","reported_seq":763,"reported_epoch":142,"state":"stale+active+clean","last_fresh":"2024-09-16T07:58:49.889219+0000","last_change":"2024-09-16T07:57:21.716527+0000","last_active":"2024-09-16T07:58:49.889219+0000","last_peered":"2024-09-16T07:58:49.889219+0000","last_clean":"2024-09-16T07:58:49.889219+0000","last_became_active":"2024-09-16T07:57:21.699860+0000","last_became_peered":"2024-09-16T07:57:21.699860+0000","last_unstale":"2024-09-16T07:59:45.089217+0000","last_undegraded":"2024-09-16T07:58:49.889219+0000","last_fullsized":"2024-09-16T07:58:49.889219+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47251456,"num_objects":721,"num_object_clones":0,"num_object_copies":2163,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":721,"num_write_kb":46144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":214,"reported_epoch":149,"state":"active+undersized","last_fresh":"2024-09-16T08:00:02.156142+0000","last_change":"2024-09-16T08:00:01.239455+0000","last_active":"2024-09-16T08:00:02.156142+0000","last_peered":"2024-09-16T08:00:02.156142+0000","last_clean":"2024-09-16T07:58:35.121289+0000","last_became_active":"2024-09-16T08:00:01.239455+0000","last_became_peered":"2024-09-16T08:00:01.239455+0000","last_unstale":"2024-09-16T08:00:02.156142+0000","last_undegraded":"2024-09-16T08:00:02.156142+0000","last_fullsized":"2024-09-16T08:00:01.141804+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"149'1124","reported_seq":1186,"reported_epoch":150,"state":"active+undersized+degraded","last_fresh":"2024-09-16T08:00:03.115277+0000","last_change":"2024-09-16T07:59:57.248126+0000","last_active":"2024-09-16T08:00:03.115277+0000","last_peered":"2024-09-16T08:00:03.115277+0000","last_clean":"2024-09-16T07:59:14.507957+0000","last_became_active":"2024-09-16T07:59:57.248126+0000","last_became_peered":"2024-09-16T07:59:57.248126+0000","last_unstale":"2024-09-16T08:00:03.115277+0000","last_undegraded":"2024-09-16T07:59:57.147323+0000","last_fullsized":"2024-09-16T07:59:57.146230+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34144256,"num_objects":521,"num_object_clones":0,"num_object_copies":1563,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":521,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1123,"num_write_kb":52608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[{"shards":"0,3","objects":521}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":345,"reported_epoch":142,"state":"stale+active+clean","last_fresh":"2024-09-16T07:58:35.147860+0000","last_change":"2024-09-16T07:56:53.076128+0000","last_active":"2024-09-16T07:58:35.147860+0000","last_peered":"2024-09-16T07:58:35.147860+0000","last_clean":"2024-09-16T07:58:35.147860+0000","last_became_active":"2024-09-16T07:56:52.296173+0000","last_became_peered":"2024-09-16T07:56:52.296173+0000","last_unstale":"2024-09-16T07:59:45.089219+0000","last_undegraded":"2024-09-16T07:58:35.147860+0000","last_fullsized":"2024-09-16T07:58:35.147860+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"142'717","reported_seq":773,"reported_epoch":142,"state":"stale+active+clean","last_fresh":"2024-09-16T07:58:49.741569+0000","last_change":"2024-09-16T07:58:34.475137+0000","last_active":"2024-09-16T07:58:49.741569+0000","last_peered":"2024-09-16T07:58:49.741569+0000","last_clean":"2024-09-16T07:58:49.741569+0000","last_became_active":"2024-09-16T07:58:34.211141+0000","last_became_peered":"2024-09-16T07:58:34.211141+0000","last_unstale":"2024-09-16T07:59:45.089221+0000","last_undegraded":"2024-09-16T07:58:49.741569+0000","last_fullsized":"2024-09-16T07:58:49.741569+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46989312,"num_objects":717,"num_object_clones":0,"num_object_copies":2151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":717,"num_write_kb":45888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":222,"reported_epoch":149,"state":"active+undersized+degraded","last_fresh":"2024-09-16T08:00:02.151607+0000","last_change":"2024-09-16T08:00:01.221374+0000","last_active":"2024-09-16T08:00:02.151607+0000","last_peered":"2024-09-16T08:00:02.151607+0000","last_clean":"2024-09-16T07:58:35.120264+0000","last_became_active":"2024-09-16T08:00:01.221374+0000","last_became_peered":"2024-09-16T08:00:01.221374+0000","last_unstale":"2024-09-16T08:00:02.151607+0000","last_undegraded":"2024-09-16T08:00:01.134192+0000","last_fullsized":"2024-09-16T08:00:01.132216+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"149'994","reported_seq":1071,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T08:00:02.444777+0000","last_change":"2024-09-16T08:00:01.881642+0000","last_active":"2024-09-16T08:00:02.444777+0000","last_peered":"2024-09-16T08:00:02.444777+0000","last_clean":"2024-09-16T08:00:02.444777+0000","last_became_active":"2024-09-16T08:00:01.271331+0000","last_became_peered":"2024-09-16T08:00:01.271331+0000","last_unstale":"2024-09-16T08:00:02.444777+0000","last_undegraded":"2024-09-16T08:00:02.444777+0000","last_fullsized":"2024-09-16T08:00:02.444777+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":994,"log_dups_size":0,"ondisk_log_size":994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":993,"num_write_kb":47424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":392,"reported_epoch":150,"state":"active+undersized","last_fresh":"2024-09-16T08:00:03.119103+0000","last_change":"2024-09-16T07:59:57.225911+0000","last_active":"2024-09-16T08:00:03.119103+0000","last_peered":"2024-09-16T08:00:03.119103+0000","last_clean":"2024-09-16T07:58:13.069286+0000","last_became_active":"2024-09-16T07:59:57.225911+0000","last_became_peered":"2024-09-16T07:59:57.225911+0000","last_unstale":"2024-09-16T08:00:03.119103+0000","last_undegraded":"2024-09-16T08:00:03.119103+0000","last_fullsized":"2024-09-16T07:59:57.135468+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"142'979","reported_seq":1021,"reported_epoch":142,"state":"stale+active+clean","last_fresh":"2024-09-16T07:59:14.546143+0000","last_change":"2024-09-16T07:57:21.689622+0000","last_active":"2024-09-16T07:59:14.546143+0000","last_peered":"2024-09-16T07:59:14.546143+0000","last_clean":"2024-09-16T07:59:14.546143+0000","last_became_active":"2024-09-16T07:57:21.683457+0000","last_became_peered":"2024-09-16T07:57:21.683457+0000","last_unstale":"2024-09-16T07:59:56.098448+0000","last_undegraded":"2024-09-16T07:59:14.546143+0000","last_fullsized":"2024-09-16T07:59:14.546143+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":979,"log_dups_size":0,"ondisk_log_size":979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33357824,"num_objects":509,"num_object_clones":0,"num_object_copies":1527,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":979,"num_write_kb":47616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":385,"reported_epoch":150,"state":"active+undersized","last_fresh":"2024-09-16T08:00:03.097920+0000","last_change":"2024-09-16T07:59:57.212516+0000","last_active":"2024-09-16T08:00:03.097920+0000","last_peered":"2024-09-16T08:00:03.097920+0000","last_clean":"2024-09-16T07:59:46.109499+0000","last_became_active":"2024-09-16T07:59:57.212516+0000","last_became_peered":"2024-09-16T07:59:57.212516+0000","last_unstale":"2024-09-16T08:00:03.097920+0000","last_undegraded":"2024-09-16T08:00:03.097920+0000","last_fullsized":"2024-09-16T07:59:57.135326+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"150'1003","reported_seq":1074,"reported_epoch":150,"state":"active+undersized+degraded","last_fresh":"2024-09-16T08:00:03.112418+0000","last_change":"2024-09-16T07:59:57.236066+0000","last_active":"2024-09-16T08:00:03.112418+0000","last_peered":"2024-09-16T08:00:03.112418+0000","last_clean":"2024-09-16T07:59:46.298484+0000","last_became_active":"2024-09-16T07:59:57.236066+0000","last_became_peered":"2024-09-16T07:59:57.236066+0000","last_unstale":"2024-09-16T08:00:03.112418+0000","last_undegraded":"2024-09-16T07:59:57.120745+0000","last_fullsized":"2024-09-16T07:59:57.119506+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29294592,"num_objects":447,"num_object_clones":0,"num_object_copies":1341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":447,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1003,"num_write_kb":46400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[{"shards":"0,3","objects":447}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":390,"reported_epoch":149,"state":"active+undersized","last_fresh":"2024-09-16T08:00:02.154304+0000","last_change":"2024-09-16T07:59:57.230086+0000","last_active":"2024-09-16T08:00:02.154304+0000","last_peered":"2024-09-16T08:00:02.154304+0000","last_clean":"2024-09-16T07:58:13.070302+0000","last_became_active":"2024-09-16T07:59:57.230086+0000","last_became_peered":"2024-09-16T07:59:57.230086+0000","last_unstale":"2024-09-16T08:00:02.154304+0000","last_undegraded":"2024-09-16T08:00:02.154304+0000","last_fullsized":"2024-09-16T07:59:57.126259+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"149'987","reported_seq":1066,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-16T08:00:03.112021+0000","last_change":"2024-09-16T08:00:02.106849+0000","last_active":"2024-09-16T08:00:03.112021+0000","last_peered":"2024-09-16T08:00:03.112021+0000","last_clean":"2024-09-16T08:00:03.112021+0000","last_became_active":"2024-09-16T08:00:01.306438+0000","last_became_peered":"2024-09-16T08:00:01.306438+0000","last_unstale":"2024-09-16T08:00:03.112021+0000","last_undegraded":"2024-09-16T08:00:03.112021+0000","last_fullsized":"2024-09-16T08:00:03.112021+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":987,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":359,"reported_epoch":142,"state":"stale+active+clean","last_fresh":"2024-09-16T07:58:35.143353+0000","last_change":"2024-09-16T07:58:35.147645+0000","last_active":"2024-09-16T07:58:35.143353+0000","last_peered":"2024-09-16T07:58:35.143353+0000","last_clean":"2024-09-16T07:58:35.143353+0000","last_became_active":"2024-09-16T07:58:34.254789+0000","last_became_peered":"2024-09-16T07:58:34.254789+0000","last_unstale":"2024-09-16T07:59:45.089223+0000","last_undegraded":"2024-09-16T07:58:35.143353+0000","last_fullsized":"2024-09-16T07:58:35.143353+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":562823192,"num_objects":8589,"num_object_clones":0,"num_object_copies":25767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2380,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":15103,"num_write_kb":758081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106676224,"data_stored":1706688560,"data_compressed":81041809,"data_compressed_allocated":106668032,"data_compressed_original":1706688512,"omap_allocated":0,"internal_metadata":0},"log_size":15107,"ondisk_log_size":15107,"up":43,"acting":43,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":19,"acting":19,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122407,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77488,"kb_used_data":29792,"kb_used_omap":0,"kb_used_meta":47680,"kb_avail":94294352,"statfs":{"total":96636764160,"available":96557416448,"internally_reserved":0,"allocated":30507008,"data_stored":468303307,"data_compressed":22215488,"data_compressed_allocated":29241344,"data_compressed_original":467779584,"omap_allocated":0,"internal_metadata":48824320},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":107,"seq":459561500852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66280,"kb_used_data":19096,"kb_used_omap":0,"kb_used_meta":47168,"kb_avail":94305560,"statfs":{"total":96636764160,"available":96568893440,"internally_reserved":0,"allocated":19554304,"data_stored":293887652,"data_compressed":13934456,"data_compressed_allocated":18341888,"data_compressed_original":293388288,"omap_allocated":0,"internal_metadata":48300032},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":120,"seq":515396075638,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66800,"kb_used_data":37984,"kb_used_omap":0,"kb_used_meta":28800,"kb_avail":94305040,"statfs":{"total":96636764160,"available":96568360960,"internally_reserved":0,"allocated":38895616,"data_stored":603806828,"data_compressed":28648179,"data_compressed_allocated":37707776,"data_compressed_original":603324416,"omap_allocated":0,"internal_metadata":29491200},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":140,"seq":601295421529,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64048,"kb_used_data":22368,"kb_used_omap":0,"kb_used_meta":41664,"kb_avail":94307792,"statfs":{"total":96636764160,"available":96571179008,"internally_reserved":0,"allocated":22904832,"data_stored":346668486,"data_compressed":16439617,"data_compressed_allocated":21639168,"data_compressed_original":346144768,"omap_allocated":0,"internal_metadata":42663936},"hb_peers":[1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21397504,"data_stored":342360064,"data_compressed":16257088,"data_compressed_allocated":21397504,"data_compressed_original":342360064,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38105088,"data_stored":609681408,"data_compressed":28950043,"data_compressed_allocated":38105088,"data_compressed_original":609681408,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18305024,"data_stored":292814872,"data_compressed":13904415,"data_compressed_allocated":18300928,"data_compressed_original":292814848,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28868608,"data_stored":461832216,"data_compressed":21930263,"data_compressed_allocated":28864512,"data_compressed_original":461832192,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:00:29.640 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg force-recovery 7.9 2.2 7.3 2024-09-16T08:00:29.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:29.793+0000 7f2caf991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:29.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:29.811+0000 7f2caf991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:30.109 INFO:teuthology.orchestra.run.smithi003.stderr:instructing pg(s) [2.2] on osd.0 to force-recovery; instructing pg(s) [7.9] on osd.1 to force-recovery; instructing pg(s) [7.3] on osd.3 to force-recovery; 2024-09-16T08:00:30.109 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:00:30.507 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:00:30.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:30.667+0000 7f864d86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:30.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:30.676+0000 7f864d86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:33.027 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:00:33.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:33.162+0000 7f37f0f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:33.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:33.169+0000 7f37f0f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:35.129 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 0, 1, 2] 2024-09-16T08:00:35.129 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:00:35.129 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [3, 0, 1, 2] 2024-09-16T08:00:35.129 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T08:00:35.130 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:00:35.525 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:00:35.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:35.653+0000 7f819a86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:35.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:35.661+0000 7f819a86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:38.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-16T08:00:41.230 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T08:00:44.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-16T08:00:46.231 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [3, 1, 2] 2024-09-16T08:00:46.232 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:00:46.232 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-16T08:00:46.232 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T08:00:46.232 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T08:00:46.235 INFO:tasks.ceph.osd.0:Started 2024-09-16T08:00:46.236 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T08:00:46.350 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T08:00:46.354 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:00:46.355 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T08:00:51.356 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T08:00:51.459 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T08:00:51.462 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:00:51.463 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T08:00:56.464 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T08:00:56.559 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T08:00:56.653 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T08:00:56.654 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [ 2024-09-16T08:00:56.654 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.654 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.654 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 15, 2024-09-16T08:00:56.654 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.654 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.654 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.0", 2024-09-16T08:00:56.654 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 154, 2024-09-16T08:00:56.654 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.654 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.654 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.654 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.655 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.655 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.655 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.655 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16, 2024-09-16T08:00:56.655 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.655 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.655 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.4", 2024-09-16T08:00:56.655 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 154, 2024-09-16T08:00:56.655 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.655 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.655 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.655 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.655 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.656 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.656 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.656 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 17, 2024-09-16T08:00:56.656 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.656 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.656 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.0", 2024-09-16T08:00:56.656 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 158, 2024-09-16T08:00:56.656 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.656 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.656 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.656 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.656 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.656 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.657 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.657 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 18, 2024-09-16T08:00:56.657 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.657 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.657 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.1", 2024-09-16T08:00:56.657 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 158, 2024-09-16T08:00:56.657 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.657 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.657 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.657 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.657 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.658 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.658 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.658 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 19, 2024-09-16T08:00:56.658 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.658 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.658 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.7", 2024-09-16T08:00:56.658 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 158, 2024-09-16T08:00:56.658 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.658 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.658 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.659 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.659 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.659 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.659 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.659 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 20, 2024-09-16T08:00:56.659 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.659 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.659 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.8", 2024-09-16T08:00:56.660 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 158, 2024-09-16T08:00:56.660 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.660 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.660 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.660 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.660 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.660 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.660 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.660 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 21, 2024-09-16T08:00:56.660 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.660 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.660 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.b", 2024-09-16T08:00:56.661 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 158, 2024-09-16T08:00:56.661 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.661 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.661 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.661 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.661 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.661 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.661 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.661 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777231, 2024-09-16T08:00:56.661 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.661 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.661 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "1.0", 2024-09-16T08:00:56.661 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 154, 2024-09-16T08:00:56.662 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.662 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.662 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.662 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.662 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.662 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.662 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.662 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777232, 2024-09-16T08:00:56.662 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.662 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.662 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.2", 2024-09-16T08:00:56.662 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 154, 2024-09-16T08:00:56.662 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.662 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.663 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.663 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.663 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.663 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.663 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.663 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777233, 2024-09-16T08:00:56.663 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.663 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.663 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.5", 2024-09-16T08:00:56.663 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 154, 2024-09-16T08:00:56.663 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.664 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.664 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.664 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.664 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.664 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.664 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.664 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777234, 2024-09-16T08:00:56.664 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.664 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.664 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.7", 2024-09-16T08:00:56.664 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 154, 2024-09-16T08:00:56.664 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.665 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.665 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.665 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.665 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.665 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.665 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.665 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777235, 2024-09-16T08:00:56.665 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.665 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.665 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.3", 2024-09-16T08:00:56.665 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 158, 2024-09-16T08:00:56.665 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.665 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.666 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.666 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.666 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.666 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.666 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.666 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777236, 2024-09-16T08:00:56.666 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.666 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.666 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.a", 2024-09-16T08:00:56.666 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 158, 2024-09-16T08:00:56.666 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.666 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.666 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.666 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.667 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.667 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.667 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.667 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 16777237, 2024-09-16T08:00:56.667 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.667 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.667 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.f", 2024-09-16T08:00:56.667 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 158, 2024-09-16T08:00:56.667 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.667 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.668 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.668 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.668 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.668 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.668 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T08:00:56.669 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 33554451, 2024-09-16T08:00:56.669 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.669 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T08:00:56.669 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "0", 2024-09-16T08:00:56.669 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.e", 2024-09-16T08:00:56.669 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 159, 2024-09-16T08:00:56.669 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 159, 2024-09-16T08:00:56.669 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 159 epoch_requested: 159 IntervalFlush", 2024-09-16T08:00:56.669 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T08:00:56.669 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.669 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:00:56.670 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:56.670 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.670 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.670 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T08:00:56.670 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:56.600804+0000" 2024-09-16T08:00:56.670 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.670 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.670 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:56.670 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:56.670 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.670 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.670 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:00:56.670 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:56.670 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.671 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.671 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:56.671 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:56.671 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.671 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.671 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T08:00:56.671 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:00:56.600881+0000", 2024-09-16T08:00:56.671 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T08:00:56.671 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PeeringEvent::PGPipeline::process", 2024-09-16T08:00:56.671 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.671 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T08:00:56.671 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 33554450 2024-09-16T08:00:56.672 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.672 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.672 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.672 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.672 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:00:56.672 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:56.672 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.672 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.672 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:00:56.672 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:00:56.672 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.672 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T08:00:56.673 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.673 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.673 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.673 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.673 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.673 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 33554445, 2024-09-16T08:00:56.673 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.673 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.673 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.3", 2024-09-16T08:00:56.673 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 154, 2024-09-16T08:00:56.673 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.673 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.673 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.674 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.674 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.674 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.674 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.674 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 33554446, 2024-09-16T08:00:56.674 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.674 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.674 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "2.6", 2024-09-16T08:00:56.674 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 154, 2024-09-16T08:00:56.674 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.674 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.674 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.675 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.675 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.675 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.675 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.675 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 33554447, 2024-09-16T08:00:56.675 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.675 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.675 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.2", 2024-09-16T08:00:56.675 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 158, 2024-09-16T08:00:56.675 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.675 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.675 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.675 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.675 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.676 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.676 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.676 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 33554448, 2024-09-16T08:00:56.676 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.676 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.676 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.4", 2024-09-16T08:00:56.676 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 158, 2024-09-16T08:00:56.676 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.677 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.677 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.677 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.677 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.677 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.677 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.677 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 33554449, 2024-09-16T08:00:56.677 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.677 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.677 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.6", 2024-09-16T08:00:56.677 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 158, 2024-09-16T08:00:56.677 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.677 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:00:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:00:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "pg_advance_map", 2024-09-16T08:00:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 33554450, 2024-09-16T08:00:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:00:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: "PGAdvanceMap": { 2024-09-16T08:00:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.e", 2024-09-16T08:00:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: "from": 158, 2024-09-16T08:00:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: "to": 165, 2024-09-16T08:00:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: "do_init": false 2024-09-16T08:00:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.679 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.679 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:00:56.679 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T08:00:56.679 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T08:00:56.758 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:00:56.759 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:00:58.760 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:00:58.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:58.886+0000 7f91c8eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:00:58.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:00:58.893+0000 7f91c8eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:01.108 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:01:01.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:01.247+0000 7f272a246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:01.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:01.255+0000 7f272a246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:01.680 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 1, 2, 0] 2024-09-16T08:01:01.680 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:01:01.681 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [3, 1, 2, 0] 2024-09-16T08:01:01.682 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T08:01:01.682 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:01:01.776 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T08:01:03.634 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:01:03.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:03.761+0000 7f1366191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:03.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:03.767+0000 7f1366191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:06.777 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [3, 1, 2] 2024-09-16T08:01:06.777 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:01:06.778 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:01:06.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:06.902+0000 7fc48e6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:06.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:06.911+0000 7fc48e6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:07.110 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T08:01:07.110 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T08:01:07.123 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":643,"stamp":"2024-09-16T08:01:06.501479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":238682688,"num_objects":3638,"num_object_clones":0,"num_object_copies":10914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2082,"num_objects_misplaced":256,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20372,"num_write_kb":766676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1628,"num_bytes_recovered":34865152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20363,"ondisk_log_size":20363,"up":75,"acting":69,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":254104,"kb_used_data":53776,"kb_used_omap":0,"kb_used_meta":200256,"kb_avail":377233256,"statfs":{"total":386547056640,"available":386286854144,"internally_reserved":0,"allocated":55066624,"data_stored":794199379,"data_compressed":37611504,"data_compressed_allocated":49508352,"data_compressed_original":791887872,"omap_allocated":0,"internal_metadata":205062144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-30212096,"num_objects":-461,"num_object_clones":0,"num_object_copies":-1383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-510,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":628,"num_bytes_recovered":5111808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.409547"},"pg_stats":[{"pgid":"7.f","version":"168'1285","reported_seq":1447,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.103640+0000","last_change":"2024-09-16T08:00:58.634425+0000","last_active":"2024-09-16T08:01:03.103640+0000","last_peered":"2024-09-16T08:01:03.103640+0000","last_clean":"2024-09-16T08:01:03.103640+0000","last_became_active":"2024-09-16T08:00:58.288917+0000","last_became_peered":"2024-09-16T08:00:58.288917+0000","last_unstale":"2024-09-16T08:01:03.103640+0000","last_undegraded":"2024-09-16T08:01:03.103640+0000","last_fullsized":"2024-09-16T08:01:03.103640+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1285,"log_dups_size":0,"ondisk_log_size":1285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1285,"num_write_kb":47552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"168'1295","reported_seq":1743,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T08:01:00.318173+0000","last_change":"2024-09-16T08:00:58.695709+0000","last_active":"2024-09-16T08:01:00.318173+0000","last_peered":"2024-09-16T08:01:00.318173+0000","last_clean":"2024-09-16T08:01:00.318173+0000","last_became_active":"2024-09-16T08:00:58.305762+0000","last_became_peered":"2024-09-16T08:00:58.305762+0000","last_unstale":"2024-09-16T08:01:00.318173+0000","last_undegraded":"2024-09-16T08:01:00.318173+0000","last_fullsized":"2024-09-16T08:01:00.318173+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1295,"log_dups_size":0,"ondisk_log_size":1295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1294,"num_write_kb":48960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"168'1240","reported_seq":1553,"reported_epoch":168,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T08:01:00.515185+0000","last_change":"2024-09-16T08:00:56.764180+0000","last_active":"2024-09-16T08:01:00.515185+0000","last_peered":"2024-09-16T08:01:00.515185+0000","last_clean":"2024-09-16T07:59:14.468138+0000","last_became_active":"2024-09-16T08:00:23.059567+0000","last_became_peered":"2024-09-16T08:00:23.059567+0000","last_unstale":"2024-09-16T08:01:00.515185+0000","last_undegraded":"2024-09-16T08:01:00.515185+0000","last_fullsized":"2024-09-16T08:00:22.384543+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107224,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1239,"num_write_kb":46017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":201}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"168'1243","reported_seq":1572,"reported_epoch":168,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-16T08:01:00.581258+0000","last_change":"2024-09-16T08:00:56.730270+0000","last_active":"2024-09-16T08:01:00.581258+0000","last_peered":"2024-09-16T08:01:00.581258+0000","last_clean":"2024-09-16T07:59:14.452073+0000","last_became_active":"2024-09-16T08:00:22.975512+0000","last_became_peered":"2024-09-16T08:00:22.975512+0000","last_unstale":"2024-09-16T08:01:00.581258+0000","last_undegraded":"2024-09-16T08:01:00.581258+0000","last_fullsized":"2024-09-16T08:00:22.112512+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1243,"log_dups_size":0,"ondisk_log_size":1243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14614528,"num_objects":223,"num_object_clones":0,"num_object_copies":669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1241,"num_write_kb":46848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"1,3","objects":223}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.b","version":"156'1155","reported_seq":1399,"reported_epoch":156,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T08:00:30.573136+0000","last_change":"2024-09-16T08:00:23.501437+0000","last_active":"2024-09-16T08:00:30.573136+0000","last_peered":"2024-09-16T08:00:30.573136+0000","last_clean":"2024-09-16T08:00:20.115612+0000","last_became_active":"2024-09-16T08:00:23.485319+0000","last_became_peered":"2024-09-16T08:00:23.485319+0000","last_unstale":"2024-09-16T08:00:30.573136+0000","last_undegraded":"2024-09-16T08:00:22.857483+0000","last_fullsized":"2024-09-16T08:00:22.616329+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1155,"log_dups_size":0,"ondisk_log_size":1155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16252928,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":633,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1154,"num_write_kb":44864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":4456448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[1,0],"avail_no_missing":["1","0","3"],"object_location_counts":[{"shards":"0,1","objects":1},{"shards":"0,1,3","objects":247}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"168'1282","reported_seq":1749,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.095487+0000","last_change":"2024-09-16T08:00:58.296312+0000","last_active":"2024-09-16T08:01:03.095487+0000","last_peered":"2024-09-16T08:01:03.095487+0000","last_clean":"2024-09-16T08:01:03.095487+0000","last_became_active":"2024-09-16T08:00:58.274036+0000","last_became_peered":"2024-09-16T08:00:58.274036+0000","last_unstale":"2024-09-16T08:01:03.095487+0000","last_undegraded":"2024-09-16T08:01:03.095487+0000","last_fullsized":"2024-09-16T08:01:03.095487+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1282,"log_dups_size":0,"ondisk_log_size":1282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1282,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"158'1355","reported_seq":1452,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-16T08:00:43.095839+0000","last_change":"2024-09-16T08:00:40.205258+0000","last_active":"2024-09-16T08:00:43.095839+0000","last_peered":"2024-09-16T08:00:43.095839+0000","last_clean":"2024-09-16T08:00:43.095839+0000","last_became_active":"2024-09-16T08:00:40.198464+0000","last_became_peered":"2024-09-16T08:00:40.198464+0000","last_unstale":"2024-09-16T08:00:43.095839+0000","last_undegraded":"2024-09-16T08:00:43.095839+0000","last_fullsized":"2024-09-16T08:00:43.095839+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1355,"log_dups_size":0,"ondisk_log_size":1355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16842752,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1353,"num_write_kb":51520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"168'1248","reported_seq":1614,"reported_epoch":168,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T08:01:00.471452+0000","last_change":"2024-09-16T08:00:59.623807+0000","last_active":"2024-09-16T08:01:00.471452+0000","last_peered":"2024-09-16T08:01:00.471452+0000","last_clean":"2024-09-16T08:00:20.103740+0000","last_became_active":"2024-09-16T08:00:59.553087+0000","last_became_peered":"2024-09-16T08:00:59.553087+0000","last_unstale":"2024-09-16T08:01:00.471452+0000","last_undegraded":"2024-09-16T08:00:59.417135+0000","last_fullsized":"2024-09-16T08:01:00.471452+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1248,"log_dups_size":0,"ondisk_log_size":1248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":614,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":46720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":7667712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":["1","0","3"],"object_location_counts":[{"shards":"0,1,2","objects":2},{"shards":"0,1,3","objects":212}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"168'1327","reported_seq":1474,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.105346+0000","last_change":"2024-09-16T08:00:58.685354+0000","last_active":"2024-09-16T08:01:03.105346+0000","last_peered":"2024-09-16T08:01:03.105346+0000","last_clean":"2024-09-16T08:01:03.105346+0000","last_became_active":"2024-09-16T08:00:58.332359+0000","last_became_peered":"2024-09-16T08:00:58.332359+0000","last_unstale":"2024-09-16T08:01:03.105346+0000","last_undegraded":"2024-09-16T08:01:03.105346+0000","last_fullsized":"2024-09-16T08:01:03.105346+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1327,"log_dups_size":0,"ondisk_log_size":1327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12517376,"num_objects":191,"num_object_clones":0,"num_object_copies":573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1327,"num_write_kb":48576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":511,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.098089+0000","last_change":"2024-09-16T08:00:58.280463+0000","last_active":"2024-09-16T08:01:03.098089+0000","last_peered":"2024-09-16T08:01:03.098089+0000","last_clean":"2024-09-16T08:01:03.098089+0000","last_became_active":"2024-09-16T08:00:58.262310+0000","last_became_peered":"2024-09-16T08:00:58.262310+0000","last_unstale":"2024-09-16T08:01:03.098089+0000","last_undegraded":"2024-09-16T08:01:03.098089+0000","last_fullsized":"2024-09-16T08:01:03.098089+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":370,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T08:00:59.267002+0000","last_change":"2024-09-16T08:00:23.236682+0000","last_active":"2024-09-16T08:00:59.267002+0000","last_peered":"2024-09-16T08:00:59.267002+0000","last_clean":"2024-09-16T08:00:59.267002+0000","last_became_active":"2024-09-16T08:00:23.053699+0000","last_became_peered":"2024-09-16T08:00:23.053699+0000","last_unstale":"2024-09-16T08:00:59.267002+0000","last_undegraded":"2024-09-16T08:00:59.267002+0000","last_fullsized":"2024-09-16T08:00:59.267002+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"168'1278","reported_seq":1708,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T08:01:00.208730+0000","last_change":"2024-09-16T08:00:37.192764+0000","last_active":"2024-09-16T08:01:00.208730+0000","last_peered":"2024-09-16T08:01:00.208730+0000","last_clean":"2024-09-16T08:01:00.208730+0000","last_became_active":"2024-09-16T08:00:37.187783+0000","last_became_peered":"2024-09-16T08:00:37.187783+0000","last_unstale":"2024-09-16T08:01:00.208730+0000","last_undegraded":"2024-09-16T08:01:00.208730+0000","last_fullsized":"2024-09-16T08:01:00.208730+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1278,"log_dups_size":0,"ondisk_log_size":1278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":48064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":239,"reported_epoch":157,"state":"stale+active+clean","last_fresh":"2024-09-16T08:00:32.145229+0000","last_change":"2024-09-16T08:00:22.179226+0000","last_active":"2024-09-16T08:00:32.145229+0000","last_peered":"2024-09-16T08:00:32.145229+0000","last_clean":"2024-09-16T08:00:32.145229+0000","last_became_active":"2024-09-16T08:00:21.343904+0000","last_became_peered":"2024-09-16T08:00:21.343904+0000","last_unstale":"2024-09-16T08:00:56.557417+0000","last_undegraded":"2024-09-16T08:00:32.145229+0000","last_fullsized":"2024-09-16T08:00:32.145229+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"157'1368","reported_seq":1482,"reported_epoch":157,"state":"stale+active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T08:00:32.153473+0000","last_change":"2024-09-16T08:00:23.502523+0000","last_active":"2024-09-16T08:00:32.153473+0000","last_peered":"2024-09-16T08:00:32.153473+0000","last_clean":"2024-09-16T07:59:14.507957+0000","last_became_active":"2024-09-16T08:00:22.274416+0000","last_became_peered":"2024-09-16T08:00:22.274416+0000","last_unstale":"2024-09-16T08:00:56.557429+0000","last_undegraded":"2024-09-16T08:00:23.495592+0000","last_fullsized":"2024-09-16T08:00:22.119502+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1368,"log_dups_size":0,"ondisk_log_size":1368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18219008,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":52608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[{"shards":"0,3","objects":278}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":348,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T08:00:59.259228+0000","last_change":"2024-09-16T08:00:22.620256+0000","last_active":"2024-09-16T08:00:59.259228+0000","last_peered":"2024-09-16T08:00:59.259228+0000","last_clean":"2024-09-16T08:00:59.259228+0000","last_became_active":"2024-09-16T08:00:21.255363+0000","last_became_peered":"2024-09-16T08:00:21.255363+0000","last_unstale":"2024-09-16T08:00:59.259228+0000","last_undegraded":"2024-09-16T08:00:59.259228+0000","last_fullsized":"2024-09-16T08:00:59.259228+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"168'1270","reported_seq":1400,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T08:01:00.502199+0000","last_change":"2024-09-16T08:00:58.264050+0000","last_active":"2024-09-16T08:01:00.502199+0000","last_peered":"2024-09-16T08:01:00.502199+0000","last_clean":"2024-09-16T08:01:00.502199+0000","last_became_active":"2024-09-16T08:00:58.257026+0000","last_became_peered":"2024-09-16T08:00:58.257026+0000","last_unstale":"2024-09-16T08:01:00.502199+0000","last_undegraded":"2024-09-16T08:01:00.502199+0000","last_fullsized":"2024-09-16T08:01:00.502199+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1270,"log_dups_size":0,"ondisk_log_size":1270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":224,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1268,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":247,"reported_epoch":157,"state":"stale+active+clean","last_fresh":"2024-09-16T08:00:32.138790+0000","last_change":"2024-09-16T08:00:22.118886+0000","last_active":"2024-09-16T08:00:32.138790+0000","last_peered":"2024-09-16T08:00:32.138790+0000","last_clean":"2024-09-16T08:00:32.138790+0000","last_became_active":"2024-09-16T08:00:21.325259+0000","last_became_peered":"2024-09-16T08:00:21.325259+0000","last_unstale":"2024-09-16T08:00:56.557433+0000","last_undegraded":"2024-09-16T08:00:32.138790+0000","last_fullsized":"2024-09-16T08:00:32.138790+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"157'1220","reported_seq":1495,"reported_epoch":157,"state":"stale+active+recovering+undersized+remapped","last_fresh":"2024-09-16T08:00:32.568971+0000","last_change":"2024-09-16T08:00:32.035901+0000","last_active":"2024-09-16T08:00:32.568971+0000","last_peered":"2024-09-16T08:00:32.568971+0000","last_clean":"2024-09-16T08:00:19.893490+0000","last_became_active":"2024-09-16T08:00:22.776047+0000","last_became_peered":"2024-09-16T08:00:22.776047+0000","last_unstale":"2024-09-16T08:00:56.557437+0000","last_undegraded":"2024-09-16T08:00:32.568971+0000","last_fullsized":"2024-09-16T08:00:22.122299+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1220,"log_dups_size":0,"ondisk_log_size":1220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":256,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":47424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":5505024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,3],"avail_no_missing":["0","1","3"],"object_location_counts":[{"shards":"0,1,3","objects":256},{"shards":"0,3","objects":7}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":426,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-16T08:00:43.102316+0000","last_change":"2024-09-16T08:00:22.124965+0000","last_active":"2024-09-16T08:00:43.102316+0000","last_peered":"2024-09-16T08:00:43.102316+0000","last_clean":"2024-09-16T08:00:43.102316+0000","last_became_active":"2024-09-16T08:00:21.214780+0000","last_became_peered":"2024-09-16T08:00:21.214780+0000","last_unstale":"2024-09-16T08:00:43.102316+0000","last_undegraded":"2024-09-16T08:00:43.102316+0000","last_fullsized":"2024-09-16T08:00:43.102316+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"168'1246","reported_seq":1860,"reported_epoch":168,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T08:01:00.508144+0000","last_change":"2024-09-16T08:00:59.554290+0000","last_active":"2024-09-16T08:01:00.508144+0000","last_peered":"2024-09-16T08:01:00.508144+0000","last_clean":"2024-09-16T07:59:14.546143+0000","last_became_active":"2024-09-16T08:00:59.525901+0000","last_became_peered":"2024-09-16T08:00:59.525901+0000","last_unstale":"2024-09-16T08:01:00.508144+0000","last_undegraded":"2024-09-16T08:00:59.250877+0000","last_fullsized":"2024-09-16T08:00:59.111999+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1246,"log_dups_size":0,"ondisk_log_size":1246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":667,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1245,"num_write_kb":47616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":253,"num_bytes_recovered":16449536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[1,0],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"0,1","objects":1},{"shards":"1,2,3","objects":242}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":449,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.097123+0000","last_change":"2024-09-16T08:00:59.111484+0000","last_active":"2024-09-16T08:01:03.097123+0000","last_peered":"2024-09-16T08:01:03.097123+0000","last_clean":"2024-09-16T08:01:03.097123+0000","last_became_active":"2024-09-16T08:00:58.269122+0000","last_became_peered":"2024-09-16T08:00:58.269122+0000","last_unstale":"2024-09-16T08:01:03.097123+0000","last_undegraded":"2024-09-16T08:01:03.097123+0000","last_fullsized":"2024-09-16T08:01:03.097123+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"168'1255","reported_seq":1689,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.096237+0000","last_change":"2024-09-16T08:00:58.650572+0000","last_active":"2024-09-16T08:01:03.096237+0000","last_peered":"2024-09-16T08:01:03.096237+0000","last_clean":"2024-09-16T08:01:03.096237+0000","last_became_active":"2024-09-16T08:00:58.284250+0000","last_became_peered":"2024-09-16T08:00:58.284250+0000","last_unstale":"2024-09-16T08:01:03.096237+0000","last_undegraded":"2024-09-16T08:01:03.096237+0000","last_fullsized":"2024-09-16T08:01:03.096237+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12779520,"num_objects":195,"num_object_clones":0,"num_object_copies":585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":46400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":426,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-16T08:00:43.104762+0000","last_change":"2024-09-16T08:00:22.124217+0000","last_active":"2024-09-16T08:00:43.104762+0000","last_peered":"2024-09-16T08:00:43.104762+0000","last_clean":"2024-09-16T08:00:43.104762+0000","last_became_active":"2024-09-16T08:00:21.309451+0000","last_became_peered":"2024-09-16T08:00:21.309451+0000","last_unstale":"2024-09-16T08:00:43.104762+0000","last_undegraded":"2024-09-16T08:00:43.104762+0000","last_fullsized":"2024-09-16T08:00:43.104762+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"168'1241","reported_seq":1381,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.102898+0000","last_change":"2024-09-16T08:00:58.360238+0000","last_active":"2024-09-16T08:01:03.102898+0000","last_peered":"2024-09-16T08:01:03.102898+0000","last_clean":"2024-09-16T08:01:03.102898+0000","last_became_active":"2024-09-16T08:00:58.345934+0000","last_became_peered":"2024-09-16T08:00:58.345934+0000","last_unstale":"2024-09-16T08:01:03.102898+0000","last_undegraded":"2024-09-16T08:01:03.102898+0000","last_fullsized":"2024-09-16T08:01:03.102898+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1241,"log_dups_size":0,"ondisk_log_size":1241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1241,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":424,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T08:00:59.262970+0000","last_change":"2024-09-16T08:00:59.273484+0000","last_active":"2024-09-16T08:00:59.262970+0000","last_peered":"2024-09-16T08:00:59.262970+0000","last_clean":"2024-09-16T08:00:59.262970+0000","last_became_active":"2024-09-16T08:00:58.274214+0000","last_became_peered":"2024-09-16T08:00:58.274214+0000","last_unstale":"2024-09-16T08:00:59.262970+0000","last_undegraded":"2024-09-16T08:00:59.262970+0000","last_fullsized":"2024-09-16T08:00:59.262970+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":238092312,"num_objects":3634,"num_object_clones":0,"num_object_copies":10902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2082,"num_objects_misplaced":256,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20292,"num_write_kb":765569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1627,"num_bytes_recovered":34865152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49291264,"data_stored":788463688,"data_compressed":37440469,"data_compressed_allocated":49278976,"data_compressed_original":788463616,"omap_allocated":0,"internal_metadata":0},"log_size":20308,"ondisk_log_size":20308,"up":48,"acting":42,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93808,"kb_used_data":15584,"kb_used_omap":0,"kb_used_meta":78208,"kb_avail":94278032,"statfs":{"total":96636764160,"available":96540704768,"internally_reserved":0,"allocated":15958016,"data_stored":232973200,"data_compressed":11037184,"data_compressed_allocated":14528512,"data_compressed_original":232374272,"omap_allocated":0,"internal_metadata":80084992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":153,"seq":657129996318,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54812,"kb_used_data":12556,"kb_used_omap":0,"kb_used_meta":42240,"kb_avail":94317028,"statfs":{"total":96636764160,"available":96580636672,"internally_reserved":0,"allocated":12857344,"data_stored":183933241,"data_compressed":8709408,"data_compressed_allocated":11464704,"data_compressed_original":183353344,"omap_allocated":0,"internal_metadata":43253760},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":147,"seq":631360192572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55676,"kb_used_data":13356,"kb_used_omap":0,"kb_used_meta":42304,"kb_avail":94316164,"statfs":{"total":96636764160,"available":96579751936,"internally_reserved":0,"allocated":13676544,"data_stored":196924357,"data_compressed":9323551,"data_compressed_allocated":12271616,"data_compressed_original":196345856,"omap_allocated":0,"internal_metadata":43319296},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":140,"seq":601295421559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49808,"kb_used_data":12280,"kb_used_omap":0,"kb_used_meta":37504,"kb_avail":94322032,"statfs":{"total":96636764160,"available":96585760768,"internally_reserved":0,"allocated":12574720,"data_stored":180368581,"data_compressed":8541361,"data_compressed_allocated":11243520,"data_compressed_original":179814400,"omap_allocated":0,"internal_metadata":38404096},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11120640,"data_stored":177930240,"data_compressed":8449080,"data_compressed_allocated":11120640,"data_compressed_original":177930240,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12251136,"data_stored":195952664,"data_compressed":9304879,"data_compressed_allocated":12247040,"data_compressed_original":195952640,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11427840,"data_stored":182779928,"data_compressed":8679367,"data_compressed_allocated":11423744,"data_compressed_original":182779904,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14491648,"data_stored":231800856,"data_compressed":11007143,"data_compressed_allocated":14487552,"data_compressed_original":231800832,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:01:07.125 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg force-recovery 7.d 7.b 7.8 7.4 7.0 2024-09-16T08:01:07.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:07.235+0000 7f81f4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:07.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:07.249+0000 7f81f4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:07.443 INFO:teuthology.orchestra.run.smithi003.stderr:instructing pg(s) [7.0,7.8] on osd.1 to force-recovery; instructing pg(s) [7.4,7.b,7.d] on osd.2 to force-recovery; 2024-09-16T08:01:07.443 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:01:12.458 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [3, 1, 2] 2024-09-16T08:01:12.458 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:01:12.458 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-16T08:01:12.458 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T08:01:12.458 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T08:01:12.461 INFO:tasks.ceph.osd.0:Started 2024-09-16T08:01:12.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T08:01:12.576 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T08:01:12.580 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:01:12.580 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T08:01:17.581 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T08:01:17.684 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T08:01:17.687 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:01:17.688 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T08:01:22.104 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T08:01:22.309 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:01:22.310 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:01:22.689 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T08:01:22.801 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T08:01:22.802 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [] 2024-09-16T08:01:22.802 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T08:01:24.311 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:01:24.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:24.451+0000 7facbb85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:24.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:24.459+0000 7facbb85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:26.767 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:01:26.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:26.930+0000 7f39e0afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:26.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:26.940+0000 7f39e0afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:27.812 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 1, 2, 0] 2024-09-16T08:01:27.812 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:01:27.813 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:01:27.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:27.943+0000 7f8f1eaac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:27.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:27.954+0000 7f8f1eaac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:28.218 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T08:01:28.219 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T08:01:28.236 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":657,"stamp":"2024-09-16T08:01:26.507031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":231146048,"num_objects":3523,"num_object_clones":0,"num_object_copies":10569,"num_objects_missing_on_primary":581,"num_objects_missing":581,"num_objects_degraded":1281,"num_objects_misplaced":451,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":20487,"num_write_kb":766676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1926,"num_bytes_recovered":36634624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20479,"ondisk_log_size":20479,"up":75,"acting":73,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":243368,"kb_used_data":51360,"kb_used_omap":0,"kb_used_meta":191936,"kb_avail":377243992,"statfs":{"total":386547056640,"available":386297847808,"internally_reserved":0,"allocated":52592640,"data_stored":753851729,"data_compressed":35694512,"data_compressed_allocated":46985216,"data_compressed_original":751517696,"omap_allocated":0,"internal_metadata":196542464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.404060"},"pg_stats":[{"pgid":"7.f","version":"168'1285","reported_seq":1447,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.103640+0000","last_change":"2024-09-16T08:00:58.634425+0000","last_active":"2024-09-16T08:01:03.103640+0000","last_peered":"2024-09-16T08:01:03.103640+0000","last_clean":"2024-09-16T08:01:03.103640+0000","last_became_active":"2024-09-16T08:00:58.288917+0000","last_became_peered":"2024-09-16T08:00:58.288917+0000","last_unstale":"2024-09-16T08:01:03.103640+0000","last_undegraded":"2024-09-16T08:01:03.103640+0000","last_fullsized":"2024-09-16T08:01:03.103640+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1285,"log_dups_size":0,"ondisk_log_size":1285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1285,"num_write_kb":47552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"168'1295","reported_seq":1743,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T08:01:00.318173+0000","last_change":"2024-09-16T08:00:58.695709+0000","last_active":"2024-09-16T08:01:00.318173+0000","last_peered":"2024-09-16T08:01:00.318173+0000","last_clean":"2024-09-16T08:01:00.318173+0000","last_became_active":"2024-09-16T08:00:58.305762+0000","last_became_peered":"2024-09-16T08:00:58.305762+0000","last_unstale":"2024-09-16T08:01:00.318173+0000","last_undegraded":"2024-09-16T08:01:00.318173+0000","last_fullsized":"2024-09-16T08:01:00.318173+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1295,"log_dups_size":0,"ondisk_log_size":1295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15466496,"num_objects":236,"num_object_clones":0,"num_object_copies":708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1294,"num_write_kb":48960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"168'1248","reported_seq":1581,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.147048+0000","last_change":"2024-09-16T08:01:03.148246+0000","last_active":"2024-09-16T08:01:03.147048+0000","last_peered":"2024-09-16T08:01:03.147048+0000","last_clean":"2024-09-16T07:59:14.468138+0000","last_became_active":"2024-09-16T08:01:03.141382+0000","last_became_peered":"2024-09-16T08:01:03.141382+0000","last_unstale":"2024-09-16T08:01:03.147048+0000","last_undegraded":"2024-09-16T08:01:03.147048+0000","last_fullsized":"2024-09-16T08:01:03.147048+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1248,"log_dups_size":0,"ondisk_log_size":1248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582936,"num_objects":193,"num_object_clones":0,"num_object_copies":579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1247,"num_write_kb":46017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"168'1247","reported_seq":1592,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.144075+0000","last_change":"2024-09-16T08:01:03.145283+0000","last_active":"2024-09-16T08:01:03.144075+0000","last_peered":"2024-09-16T08:01:03.144075+0000","last_clean":"2024-09-16T07:59:14.452073+0000","last_became_active":"2024-09-16T08:01:03.136568+0000","last_became_peered":"2024-09-16T08:01:03.136568+0000","last_unstale":"2024-09-16T08:01:03.144075+0000","last_undegraded":"2024-09-16T08:01:03.144075+0000","last_fullsized":"2024-09-16T08:01:03.144075+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1247,"log_dups_size":0,"ondisk_log_size":1247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14352384,"num_objects":219,"num_object_clones":0,"num_object_copies":657,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1245,"num_write_kb":46848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":152,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"168'1196","reported_seq":1569,"reported_epoch":170,"state":"active+recovering","last_fresh":"2024-09-16T08:01:03.101944+0000","last_change":"2024-09-16T08:00:59.865097+0000","last_active":"2024-09-16T08:01:03.101944+0000","last_peered":"2024-09-16T08:01:03.101944+0000","last_clean":"2024-09-16T08:00:20.115612+0000","last_became_active":"2024-09-16T08:00:59.520058+0000","last_became_peered":"2024-09-16T08:00:59.520058+0000","last_unstale":"2024-09-16T08:01:03.101944+0000","last_undegraded":"2024-09-16T08:01:03.101944+0000","last_fullsized":"2024-09-16T08:01:03.101944+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1196,"log_dups_size":0,"ondisk_log_size":1196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13565952,"num_objects":207,"num_object_clones":0,"num_object_copies":621,"num_objects_missing_on_primary":581,"num_objects_missing":581,"num_objects_degraded":0,"num_objects_misplaced":195,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":44864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":6225920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":["0","1","3"],"object_location_counts":[{"shards":"0,1,2","objects":12},{"shards":"0,1,3","objects":195}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.a","version":"168'1282","reported_seq":1749,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.095487+0000","last_change":"2024-09-16T08:00:58.296312+0000","last_active":"2024-09-16T08:01:03.095487+0000","last_peered":"2024-09-16T08:01:03.095487+0000","last_clean":"2024-09-16T08:01:03.095487+0000","last_became_active":"2024-09-16T08:00:58.274036+0000","last_became_peered":"2024-09-16T08:00:58.274036+0000","last_unstale":"2024-09-16T08:01:03.095487+0000","last_undegraded":"2024-09-16T08:01:03.095487+0000","last_fullsized":"2024-09-16T08:01:03.095487+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1282,"log_dups_size":0,"ondisk_log_size":1282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1282,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"168'1379","reported_seq":1494,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.097005+0000","last_change":"2024-09-16T08:00:40.205258+0000","last_active":"2024-09-16T08:01:03.097005+0000","last_peered":"2024-09-16T08:01:03.097005+0000","last_clean":"2024-09-16T08:01:03.097005+0000","last_became_active":"2024-09-16T08:00:40.198464+0000","last_became_peered":"2024-09-16T08:00:40.198464+0000","last_unstale":"2024-09-16T08:01:03.097005+0000","last_undegraded":"2024-09-16T08:01:03.097005+0000","last_fullsized":"2024-09-16T08:01:03.097005+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1379,"log_dups_size":0,"ondisk_log_size":1379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15269888,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1377,"num_write_kb":51520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"168'1248","reported_seq":1614,"reported_epoch":168,"state":"active+recovery_wait+degraded","last_fresh":"2024-09-16T08:01:00.471452+0000","last_change":"2024-09-16T08:00:59.623807+0000","last_active":"2024-09-16T08:01:00.471452+0000","last_peered":"2024-09-16T08:01:00.471452+0000","last_clean":"2024-09-16T08:00:20.103740+0000","last_became_active":"2024-09-16T08:00:59.553087+0000","last_became_peered":"2024-09-16T08:00:59.553087+0000","last_unstale":"2024-09-16T08:01:00.471452+0000","last_undegraded":"2024-09-16T08:00:59.417135+0000","last_fullsized":"2024-09-16T08:01:00.471452+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1248,"log_dups_size":0,"ondisk_log_size":1248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":614,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":46720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":7667712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":["1","0","3"],"object_location_counts":[{"shards":"0,1,2","objects":2},{"shards":"0,1,3","objects":212}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"168'1327","reported_seq":1474,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.105346+0000","last_change":"2024-09-16T08:00:58.685354+0000","last_active":"2024-09-16T08:01:03.105346+0000","last_peered":"2024-09-16T08:01:03.105346+0000","last_clean":"2024-09-16T08:01:03.105346+0000","last_became_active":"2024-09-16T08:00:58.332359+0000","last_became_peered":"2024-09-16T08:00:58.332359+0000","last_unstale":"2024-09-16T08:01:03.105346+0000","last_undegraded":"2024-09-16T08:01:03.105346+0000","last_fullsized":"2024-09-16T08:01:03.105346+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1327,"log_dups_size":0,"ondisk_log_size":1327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12517376,"num_objects":191,"num_object_clones":0,"num_object_copies":573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1327,"num_write_kb":48576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":511,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.098089+0000","last_change":"2024-09-16T08:00:58.280463+0000","last_active":"2024-09-16T08:01:03.098089+0000","last_peered":"2024-09-16T08:01:03.098089+0000","last_clean":"2024-09-16T08:01:03.098089+0000","last_became_active":"2024-09-16T08:00:58.262310+0000","last_became_peered":"2024-09-16T08:00:58.262310+0000","last_unstale":"2024-09-16T08:01:03.098089+0000","last_undegraded":"2024-09-16T08:01:03.098089+0000","last_fullsized":"2024-09-16T08:01:03.098089+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":370,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T08:00:59.267002+0000","last_change":"2024-09-16T08:00:23.236682+0000","last_active":"2024-09-16T08:00:59.267002+0000","last_peered":"2024-09-16T08:00:59.267002+0000","last_clean":"2024-09-16T08:00:59.267002+0000","last_became_active":"2024-09-16T08:00:23.053699+0000","last_became_peered":"2024-09-16T08:00:23.053699+0000","last_unstale":"2024-09-16T08:00:59.267002+0000","last_undegraded":"2024-09-16T08:00:59.267002+0000","last_fullsized":"2024-09-16T08:00:59.267002+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"168'1278","reported_seq":1708,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T08:01:00.208730+0000","last_change":"2024-09-16T08:00:37.192764+0000","last_active":"2024-09-16T08:01:00.208730+0000","last_peered":"2024-09-16T08:01:00.208730+0000","last_clean":"2024-09-16T08:01:00.208730+0000","last_became_active":"2024-09-16T08:00:37.187783+0000","last_became_peered":"2024-09-16T08:00:37.187783+0000","last_unstale":"2024-09-16T08:01:00.208730+0000","last_undegraded":"2024-09-16T08:01:00.208730+0000","last_fullsized":"2024-09-16T08:01:00.208730+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1278,"log_dups_size":0,"ondisk_log_size":1278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1277,"num_write_kb":48064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":239,"reported_epoch":157,"state":"stale+active+clean","last_fresh":"2024-09-16T08:00:32.145229+0000","last_change":"2024-09-16T08:00:22.179226+0000","last_active":"2024-09-16T08:00:32.145229+0000","last_peered":"2024-09-16T08:00:32.145229+0000","last_clean":"2024-09-16T08:00:32.145229+0000","last_became_active":"2024-09-16T08:00:21.343904+0000","last_became_peered":"2024-09-16T08:00:21.343904+0000","last_unstale":"2024-09-16T08:00:56.557417+0000","last_undegraded":"2024-09-16T08:00:32.145229+0000","last_fullsized":"2024-09-16T08:00:32.145229+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"168'1407","reported_seq":1878,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.098186+0000","last_change":"2024-09-16T08:01:02.217700+0000","last_active":"2024-09-16T08:01:03.098186+0000","last_peered":"2024-09-16T08:01:03.098186+0000","last_clean":"2024-09-16T08:01:03.098186+0000","last_became_active":"2024-09-16T08:00:58.312348+0000","last_became_peered":"2024-09-16T08:00:58.312348+0000","last_unstale":"2024-09-16T08:01:03.098186+0000","last_undegraded":"2024-09-16T08:01:03.098186+0000","last_fullsized":"2024-09-16T08:01:03.098186+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1407,"log_dups_size":0,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15728640,"num_objects":240,"num_object_clones":0,"num_object_copies":720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1404,"num_write_kb":52608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":348,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T08:00:59.259228+0000","last_change":"2024-09-16T08:00:22.620256+0000","last_active":"2024-09-16T08:00:59.259228+0000","last_peered":"2024-09-16T08:00:59.259228+0000","last_clean":"2024-09-16T08:00:59.259228+0000","last_became_active":"2024-09-16T08:00:21.255363+0000","last_became_peered":"2024-09-16T08:00:21.255363+0000","last_unstale":"2024-09-16T08:00:59.259228+0000","last_undegraded":"2024-09-16T08:00:59.259228+0000","last_fullsized":"2024-09-16T08:00:59.259228+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"168'1270","reported_seq":1400,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T08:01:00.502199+0000","last_change":"2024-09-16T08:00:58.264050+0000","last_active":"2024-09-16T08:01:00.502199+0000","last_peered":"2024-09-16T08:01:00.502199+0000","last_clean":"2024-09-16T08:01:00.502199+0000","last_became_active":"2024-09-16T08:00:58.257026+0000","last_became_peered":"2024-09-16T08:00:58.257026+0000","last_unstale":"2024-09-16T08:01:00.502199+0000","last_undegraded":"2024-09-16T08:01:00.502199+0000","last_fullsized":"2024-09-16T08:01:00.502199+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1270,"log_dups_size":0,"ondisk_log_size":1270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":224,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1268,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":327680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":247,"reported_epoch":157,"state":"stale+active+clean","last_fresh":"2024-09-16T08:00:32.138790+0000","last_change":"2024-09-16T08:00:22.118886+0000","last_active":"2024-09-16T08:00:32.138790+0000","last_peered":"2024-09-16T08:00:32.138790+0000","last_clean":"2024-09-16T08:00:32.138790+0000","last_became_active":"2024-09-16T08:00:21.325259+0000","last_became_peered":"2024-09-16T08:00:21.325259+0000","last_unstale":"2024-09-16T08:00:56.557433+0000","last_undegraded":"2024-09-16T08:00:32.138790+0000","last_fullsized":"2024-09-16T08:00:32.138790+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"157'1220","reported_seq":1495,"reported_epoch":157,"state":"stale+active+recovering+undersized+remapped","last_fresh":"2024-09-16T08:00:32.568971+0000","last_change":"2024-09-16T08:00:32.035901+0000","last_active":"2024-09-16T08:00:32.568971+0000","last_peered":"2024-09-16T08:00:32.568971+0000","last_clean":"2024-09-16T08:00:19.893490+0000","last_became_active":"2024-09-16T08:00:22.776047+0000","last_became_peered":"2024-09-16T08:00:22.776047+0000","last_unstale":"2024-09-16T08:00:56.557437+0000","last_undegraded":"2024-09-16T08:00:32.568971+0000","last_fullsized":"2024-09-16T08:00:22.122299+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1220,"log_dups_size":0,"ondisk_log_size":1220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17235968,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":256,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":47424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":5505024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,3],"avail_no_missing":["0","1","3"],"object_location_counts":[{"shards":"0,1,3","objects":256},{"shards":"0,3","objects":7}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":446,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.105400+0000","last_change":"2024-09-16T08:00:59.285387+0000","last_active":"2024-09-16T08:01:03.105400+0000","last_peered":"2024-09-16T08:01:03.105400+0000","last_clean":"2024-09-16T08:01:03.105400+0000","last_became_active":"2024-09-16T08:00:58.326048+0000","last_became_peered":"2024-09-16T08:00:58.326048+0000","last_unstale":"2024-09-16T08:01:03.105400+0000","last_undegraded":"2024-09-16T08:01:03.105400+0000","last_fullsized":"2024-09-16T08:01:03.105400+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"168'1246","reported_seq":1860,"reported_epoch":168,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-16T08:01:00.508144+0000","last_change":"2024-09-16T08:00:59.554290+0000","last_active":"2024-09-16T08:01:00.508144+0000","last_peered":"2024-09-16T08:01:00.508144+0000","last_clean":"2024-09-16T07:59:14.546143+0000","last_became_active":"2024-09-16T08:00:59.525901+0000","last_became_peered":"2024-09-16T08:00:59.525901+0000","last_unstale":"2024-09-16T08:01:00.508144+0000","last_undegraded":"2024-09-16T08:00:59.250877+0000","last_fullsized":"2024-09-16T08:00:59.111999+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1246,"log_dups_size":0,"ondisk_log_size":1246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15925248,"num_objects":243,"num_object_clones":0,"num_object_copies":729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":667,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1245,"num_write_kb":47616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":253,"num_bytes_recovered":16449536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[1,0],"avail_no_missing":["1","3"],"object_location_counts":[{"shards":"0,1","objects":1},{"shards":"1,2,3","objects":242}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":449,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.097123+0000","last_change":"2024-09-16T08:00:59.111484+0000","last_active":"2024-09-16T08:01:03.097123+0000","last_peered":"2024-09-16T08:01:03.097123+0000","last_clean":"2024-09-16T08:01:03.097123+0000","last_became_active":"2024-09-16T08:00:58.269122+0000","last_became_peered":"2024-09-16T08:00:58.269122+0000","last_unstale":"2024-09-16T08:01:03.097123+0000","last_undegraded":"2024-09-16T08:01:03.097123+0000","last_fullsized":"2024-09-16T08:01:03.097123+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"168'1255","reported_seq":1689,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.096237+0000","last_change":"2024-09-16T08:00:58.650572+0000","last_active":"2024-09-16T08:01:03.096237+0000","last_peered":"2024-09-16T08:01:03.096237+0000","last_clean":"2024-09-16T08:01:03.096237+0000","last_became_active":"2024-09-16T08:00:58.284250+0000","last_became_peered":"2024-09-16T08:00:58.284250+0000","last_unstale":"2024-09-16T08:01:03.096237+0000","last_undegraded":"2024-09-16T08:01:03.096237+0000","last_fullsized":"2024-09-16T08:01:03.096237+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12779520,"num_objects":195,"num_object_clones":0,"num_object_copies":585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":46400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":151,"num_bytes_recovered":131072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":446,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.115772+0000","last_change":"2024-09-16T08:00:59.285227+0000","last_active":"2024-09-16T08:01:03.115772+0000","last_peered":"2024-09-16T08:01:03.115772+0000","last_clean":"2024-09-16T08:01:03.115772+0000","last_became_active":"2024-09-16T08:00:58.320593+0000","last_became_peered":"2024-09-16T08:00:58.320593+0000","last_unstale":"2024-09-16T08:01:03.115772+0000","last_undegraded":"2024-09-16T08:01:03.115772+0000","last_fullsized":"2024-09-16T08:01:03.115772+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"168'1241","reported_seq":1381,"reported_epoch":170,"state":"active+clean","last_fresh":"2024-09-16T08:01:03.102898+0000","last_change":"2024-09-16T08:00:58.360238+0000","last_active":"2024-09-16T08:01:03.102898+0000","last_peered":"2024-09-16T08:01:03.102898+0000","last_clean":"2024-09-16T08:01:03.102898+0000","last_became_active":"2024-09-16T08:00:58.345934+0000","last_became_peered":"2024-09-16T08:00:58.345934+0000","last_unstale":"2024-09-16T08:01:03.102898+0000","last_undegraded":"2024-09-16T08:01:03.102898+0000","last_fullsized":"2024-09-16T08:01:03.102898+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":130,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:57:20.520061+0000","last_clean_scrub_stamp":"2024-09-16T07:57:20.520061+0000","objects_scrubbed":0,"log_size":1241,"log_dups_size":0,"ondisk_log_size":1241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1241,"num_write_kb":46912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":424,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-16T08:00:59.262970+0000","last_change":"2024-09-16T08:00:59.273484+0000","last_active":"2024-09-16T08:00:59.262970+0000","last_peered":"2024-09-16T08:00:59.262970+0000","last_clean":"2024-09-16T08:00:59.262970+0000","last_became_active":"2024-09-16T08:00:58.274214+0000","last_became_peered":"2024-09-16T08:00:58.274214+0000","last_unstale":"2024-09-16T08:00:59.262970+0000","last_undegraded":"2024-09-16T08:00:59.262970+0000","last_fullsized":"2024-09-16T08:00:59.262970+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":230555672,"num_objects":3519,"num_object_clones":0,"num_object_copies":10557,"num_objects_missing_on_primary":581,"num_objects_missing":581,"num_objects_degraded":1281,"num_objects_misplaced":451,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20407,"num_write_kb":765569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1925,"num_bytes_recovered":36634624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":46768128,"data_stored":748093512,"data_compressed":35523477,"data_compressed_allocated":46755840,"data_compressed_original":748093440,"omap_allocated":0,"internal_metadata":0},"log_size":20424,"ondisk_log_size":20424,"up":48,"acting":46,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93808,"kb_used_data":15584,"kb_used_omap":0,"kb_used_meta":78208,"kb_avail":94278032,"statfs":{"total":96636764160,"available":96540704768,"internally_reserved":0,"allocated":15958016,"data_stored":232973200,"data_compressed":11037184,"data_compressed_allocated":14528512,"data_compressed_original":232374272,"omap_allocated":0,"internal_metadata":80084992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":153,"seq":657129996348,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44076,"kb_used_data":10140,"kb_used_omap":0,"kb_used_meta":33920,"kb_avail":94327764,"statfs":{"total":96636764160,"available":96591630336,"internally_reserved":0,"allocated":10383360,"data_stored":143585591,"data_compressed":6792416,"data_compressed_allocated":8941568,"data_compressed_original":142983168,"omap_allocated":0,"internal_metadata":34734080},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":147,"seq":631360192572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55676,"kb_used_data":13356,"kb_used_omap":0,"kb_used_meta":42304,"kb_avail":94316164,"statfs":{"total":96636764160,"available":96579751936,"internally_reserved":0,"allocated":13676544,"data_stored":196924357,"data_compressed":9323551,"data_compressed_allocated":12271616,"data_compressed_original":196345856,"omap_allocated":0,"internal_metadata":43319296},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":140,"seq":601295421559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49808,"kb_used_data":12280,"kb_used_omap":0,"kb_used_meta":37504,"kb_avail":94322032,"statfs":{"total":96636764160,"available":96585760768,"internally_reserved":0,"allocated":12574720,"data_stored":180368581,"data_compressed":8541361,"data_compressed_allocated":11243520,"data_compressed_original":179814400,"omap_allocated":0,"internal_metadata":38404096},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11120640,"data_stored":177930240,"data_compressed":8449080,"data_compressed_allocated":11120640,"data_compressed_original":177930240,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12251136,"data_stored":195952664,"data_compressed":9304879,"data_compressed_allocated":12247040,"data_compressed_original":195952640,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8904704,"data_stored":142409752,"data_compressed":6762375,"data_compressed_allocated":8900608,"data_compressed_original":142409728,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14491648,"data_stored":231800856,"data_compressed":11007143,"data_compressed_allocated":14487552,"data_compressed_original":231800832,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:01:29.425 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:01:29.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:29.563+0000 7f02b7093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:29.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:29.572+0000 7f02b7093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:32.124 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:01:32.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:32.265+0000 7f309f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:32.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:32.275+0000 7f309f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:33.239 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 1, 2, 0] 2024-09-16T08:01:33.239 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:01:33.239 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T08:01:33.240 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T08:01:33.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:33.377+0000 7f65c7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:33.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:33.393+0000 7f65c7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:33.561 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T08:01:33.561 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T08:01:33.561 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T08:01:33.561 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T08:01:33.561 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T08:01:33.561 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T08:01:33.561 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T08:01:33.561 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T08:01:33.561 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T08:01:33.561 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T08:01:33.561 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T08:01:33.562 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T08:01:33.565 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:01:33.565 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T08:01:33.565 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T08:01:33.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:33.705+0000 7f3e6a911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:33.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:33.720+0000 7f3e6a911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:33.778 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T08:01:33.778 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T08:01:33.779 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T08:01:33.779 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T08:01:33.779 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T08:01:33.779 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T08:01:33.779 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T08:01:33.779 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T08:01:33.779 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T08:01:33.779 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T08:01:33.779 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T08:01:33.779 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T08:01:33.784 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:01:33.784 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T08:01:33.784 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T08:01:33.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:33.923+0000 7f9449d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:33.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:33.935+0000 7f9449d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:34.119 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T08:01:34.119 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T08:01:34.119 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T08:01:34.119 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T08:01:34.119 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T08:01:34.119 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T08:01:34.120 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T08:01:34.120 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T08:01:34.120 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T08:01:34.120 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T08:01:34.120 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T08:01:34.120 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T08:01:34.122 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:01:34.123 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T08:01:34.123 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T08:01:34.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:34.273+0000 7f262d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:34.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:34.286+0000 7f262d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:34.331 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T08:01:34.331 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T08:01:34.331 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T08:01:34.331 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T08:01:34.331 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T08:01:34.332 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T08:01:34.332 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T08:01:34.332 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T08:01:34.332 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T08:01:34.332 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T08:01:34.332 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T08:01:34.332 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T08:01:34.336 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:01:34.337 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T08:01:34.799 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:01:34.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:34.961+0000 7f07bfeec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:34.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:34.972+0000 7f07bfeec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:37.505 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:01:37.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:37.657+0000 7f0525151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:37.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:37.665+0000 7f0525151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:39.338 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 1, 2, 0] 2024-09-16T08:01:39.338 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:01:39.339 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T08:01:39.339 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T08:01:39.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:39.497+0000 7f0582d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:39.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:39.511+0000 7f0582d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:39.684 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T08:01:39.684 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T08:01:39.685 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T08:01:39.685 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T08:01:39.685 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T08:01:39.685 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T08:01:39.685 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T08:01:39.685 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T08:01:39.685 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T08:01:39.685 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T08:01:39.685 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T08:01:39.685 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T08:01:39.688 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:01:39.688 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T08:01:39.688 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T08:01:39.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:39.833+0000 7ff03b8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:39.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:39.845+0000 7ff03b8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:39.889 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T08:01:39.889 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T08:01:39.889 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T08:01:39.889 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T08:01:39.890 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T08:01:39.890 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T08:01:39.890 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T08:01:39.890 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T08:01:39.890 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T08:01:39.890 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T08:01:39.890 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T08:01:39.890 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T08:01:39.892 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:01:39.893 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T08:01:39.893 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T08:01:40.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:40.040+0000 7f04efb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:40.052 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:01:40.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:40.053+0000 7f04efb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:40.182 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T08:01:40.182 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T08:01:40.182 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T08:01:40.182 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T08:01:40.182 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T08:01:40.182 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T08:01:40.182 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T08:01:40.183 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T08:01:40.183 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T08:01:40.183 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T08:01:40.183 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T08:01:40.183 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T08:01:40.185 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:01:40.186 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T08:01:40.186 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T08:01:40.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:40.198+0000 7f98b3911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:40.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:40.206+0000 7f98b3911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:40.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:40.311+0000 7fafbca7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:40.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:40.323+0000 7fafbca7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:40.344 INFO:teuthology.orchestra.run.smithi003.stderr:no valid command found; 10 closest matches: 2024-09-16T08:01:40.344 INFO:teuthology.orchestra.run.smithi003.stderr:bench [] [] [] [] 2024-09-16T08:01:40.344 INFO:teuthology.orchestra.run.smithi003.stderr:config get 2024-09-16T08:01:40.344 INFO:teuthology.orchestra.run.smithi003.stderr:config help 2024-09-16T08:01:40.345 INFO:teuthology.orchestra.run.smithi003.stderr:config set ... 2024-09-16T08:01:40.345 INFO:teuthology.orchestra.run.smithi003.stderr:config show 2024-09-16T08:01:40.345 INFO:teuthology.orchestra.run.smithi003.stderr:deep_scrub 2024-09-16T08:01:40.345 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_ops 2024-09-16T08:01:40.345 INFO:teuthology.orchestra.run.smithi003.stderr:dump_historic_slow_ops 2024-09-16T08:01:40.345 INFO:teuthology.orchestra.run.smithi003.stderr:dump_metrics [] 2024-09-16T08:01:40.345 INFO:teuthology.orchestra.run.smithi003.stderr:dump_ops_in_flight 2024-09-16T08:01:40.345 INFO:teuthology.orchestra.run.smithi003.stderr:Error EINVAL: invalid command 2024-09-16T08:01:40.348 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:01:40.348 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T08:01:42.569 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:01:42.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:42.723+0000 7f98df591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:42.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:42.732+0000 7f98df591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:45.192 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:01:45.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:45.326+0000 7faa92b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:45.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:01:45.337+0000 7faa92b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:01:45.349 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 1, 2, 0] 2024-09-16T08:01:45.349 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:01:45.349 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [3, 1, 2, 0] 2024-09-16T08:01:45.350 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T08:01:45.350 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:01:45.447 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T08:01:50.448 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [1] live_osds: [3, 2, 0] 2024-09-16T08:01:50.448 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:01:50.449 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [3, 2, 0] 2024-09-16T08:01:50.449 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T08:01:50.449 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:01:50.537 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T08:01:50.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-16T08:01:55.538 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [1, 0] live_osds: [3, 2] 2024-09-16T08:01:55.538 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:01:55.538 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-16T08:01:55.538 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T08:01:55.538 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T08:01:55.542 INFO:tasks.ceph.osd.0:Started 2024-09-16T08:01:55.542 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T08:01:55.655 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T08:01:55.659 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:01:55.659 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T08:01:56.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-16T08:02:00.661 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T08:02:00.764 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T08:02:00.767 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:02:00.768 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T08:02:05.769 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T08:02:05.876 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T08:02:05.876 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [] 2024-09-16T08:02:05.876 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T08:02:10.886 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [1] live_osds: [3, 2, 0] 2024-09-16T08:02:10.886 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:02:10.886 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [3, 2, 0] 2024-09-16T08:02:10.887 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T08:02:10.887 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:02:10.967 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T08:02:15.347 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-16T08:02:15.394 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:02:15.394 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:02:15.968 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [1, 0] live_osds: [3, 2] 2024-09-16T08:02:15.968 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:02:15.968 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-16T08:02:15.968 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T08:02:15.969 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T08:02:15.971 INFO:tasks.ceph.osd.0:Started 2024-09-16T08:02:15.972 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T08:02:16.086 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T08:02:16.090 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:02:16.090 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T08:02:17.395 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:02:17.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:17.506+0000 7f3cd1991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:17.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:17.512+0000 7f3cd1991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:21.092 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T08:02:21.195 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T08:02:21.198 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:02:21.198 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-16T08:02:23.127 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T08:02:23.127 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-16T08:02:23.315 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:02:23.315 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:02:25.317 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:02:25.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:25.435+0000 7f5697911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:25.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:25.442+0000 7f5697911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:25.525 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-16T08:02:25.608 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:02:25.608 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:02:26.200 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-16T08:02:26.475 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T08:02:26.475 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [ 2024-09-16T08:02:26.475 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.475 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:02:26.475 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 153, 2024-09-16T08:02:26.475 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.475 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.475 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:02:26.475 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.451656+0000" 2024-09-16T08:02:26.475 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.475 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.476 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:02:26.476 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.451683+0000" 2024-09-16T08:02:26.476 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.476 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.476 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.476 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.476 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.476 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.476 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:02:26.476 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.452067+0000" 2024-09-16T08:02:26.476 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.476 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.476 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.477 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.477 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.477 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.477 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:02:26.477 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.477 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.477 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.477 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.477 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.477 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.477 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.477 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:02:26.477 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.452637+0000" 2024-09-16T08:02:26.478 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.478 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.478 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.478 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.478 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.478 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.478 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:02:26.478 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.453140+0000" 2024-09-16T08:02:26.478 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.478 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.478 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.478 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.478 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.478 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.479 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:02:26.479 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.479 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.479 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.479 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.479 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.479 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.479 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.479 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.479 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.479 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.479 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.479 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:02:26.480 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.453604+0000" 2024-09-16T08:02:26.480 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.480 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.480 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.480 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.480 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.480 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.480 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:02:26.480 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.480 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.480 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.480 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.480 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.481 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.481 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.481 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:02:26.481 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.453855+0000" 2024-09-16T08:02:26.481 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.481 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.481 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.481 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.481 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.481 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.481 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:02:26.481 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.461379+0000", 2024-09-16T08:02:26.481 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T08:02:26.481 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PGActivationBlocker", 2024-09-16T08:02:26.482 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.482 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.b" 2024-09-16T08:02:26.482 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.482 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.482 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.482 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.482 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.482 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.482 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.482 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.482 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:02:26.482 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.483 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.483 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.483 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.483 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.483 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.483 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.483 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:02:26.483 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.483 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.483 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.483 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.483 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.483 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.484 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.484 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:02:26.484 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.484 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.484 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.484 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.484 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.484 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.484 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.484 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:02:26.484 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.484 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.484 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.485 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.485 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.485 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.485 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.485 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:02:26.485 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.485 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.485 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.485 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.485 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.485 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.485 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.485 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:02:26.485 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 155, 2024-09-16T08:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.461544+0000" 2024-09-16T08:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.461555+0000" 2024-09-16T08:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.462277+0000" 2024-09-16T08:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.462655+0000" 2024-09-16T08:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.463025+0000" 2024-09-16T08:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.492 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.492 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.492 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.492 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.492 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.492 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.492 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.492 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.492 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:02:26.492 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.463633+0000" 2024-09-16T08:02:26.492 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.492 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.492 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.493 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.493 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.493 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.493 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:02:26.493 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.493 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.493 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.493 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.493 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.493 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.493 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.493 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:02:26.493 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.464083+0000", 2024-09-16T08:02:26.493 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T08:02:26.494 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "CommonPGPipeline:::wait_for_active", 2024-09-16T08:02:26.494 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.494 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T08:02:26.494 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 153 2024-09-16T08:02:26.494 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.494 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.494 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.494 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.494 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.494 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.494 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.494 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.495 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:02:26.495 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.495 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.495 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.495 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.495 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.495 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.495 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.495 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:02:26.495 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.495 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.495 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.496 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.496 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.496 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.496 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.496 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:02:26.496 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.496 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.496 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.496 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.496 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.496 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.496 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.496 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:02:26.497 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.497 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.497 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.497 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.497 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.497 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.497 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.497 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:02:26.497 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.497 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.497 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.497 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.497 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.498 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.498 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.498 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:02:26.498 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.498 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.498 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.498 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.498 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.498 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.498 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.498 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:02:26.498 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.498 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.498 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.499 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.499 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.499 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.499 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.499 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:02:26.499 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.499 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.499 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.499 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.499 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.499 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.499 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.499 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:02:26.499 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.500 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.500 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.500 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.500 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.500 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.500 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.500 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.500 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.500 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.500 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.500 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.500 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.500 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:02:26.501 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 158, 2024-09-16T08:02:26.501 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.501 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.501 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:02:26.501 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.474208+0000" 2024-09-16T08:02:26.501 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.501 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.501 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:02:26.501 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.474223+0000" 2024-09-16T08:02:26.501 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.501 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.501 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.501 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.501 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.502 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.502 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:02:26.502 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.475609+0000" 2024-09-16T08:02:26.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.502 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.502 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.502 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.502 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.502 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:02:26.502 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.502 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.502 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.503 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.503 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.503 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.503 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:02:26.503 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.477421+0000" 2024-09-16T08:02:26.503 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.503 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.503 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.503 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.503 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.503 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.503 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:02:26.503 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.477599+0000" 2024-09-16T08:02:26.503 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.504 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.504 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.504 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.504 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.504 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.504 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:02:26.504 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.504 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.504 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.504 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.504 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.504 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.504 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.504 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.505 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.505 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.505 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:02:26.505 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.478968+0000" 2024-09-16T08:02:26.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.505 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.505 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.505 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.505 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.505 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:02:26.505 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:02:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.479200+0000" 2024-09-16T08:02:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.506 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:02:26.507 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.479507+0000", 2024-09-16T08:02:26.507 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T08:02:26.507 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PGActivationBlocker", 2024-09-16T08:02:26.507 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.507 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.8" 2024-09-16T08:02:26.508 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.508 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.508 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.508 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.508 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.508 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.508 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.508 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.508 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:02:26.508 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.508 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.508 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.508 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.509 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.509 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.509 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.509 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:02:26.509 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.509 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.509 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.509 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.509 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.509 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.509 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.509 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:02:26.509 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.509 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.510 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.510 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.510 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.510 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.510 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.510 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:02:26.510 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.510 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.510 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.510 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.510 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.510 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.510 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.510 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:02:26.511 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.511 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.511 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.511 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.511 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.511 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.511 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.511 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:02:26.511 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.511 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.511 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.511 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.511 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.511 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.512 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.512 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:02:26.512 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.512 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.512 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.512 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.512 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.512 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.512 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.512 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:02:26.512 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.512 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.512 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.513 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.513 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.513 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.513 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.513 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.513 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.513 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:02:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 160, 2024-09-16T08:02:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:02:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.479644+0000" 2024-09-16T08:02:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:02:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.479655+0000" 2024-09-16T08:02:26.515 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.515 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.515 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.515 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.515 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.515 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.515 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:02:26.515 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.480316+0000" 2024-09-16T08:02:26.515 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.515 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.515 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.515 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.515 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.515 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:02:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:02:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.480589+0000" 2024-09-16T08:02:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:02:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.482013+0000" 2024-09-16T08:02:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:02:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.482654+0000", 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "ClientRequest::PGPipeline::await_map", 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.518 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T08:02:26.519 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 155 2024-09-16T08:02:26.519 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.519 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.519 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.519 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.519 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.519 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.519 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.519 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.519 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:02:26.519 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.519 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.519 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.519 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.520 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.520 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.520 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:02:26.520 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.520 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.520 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.520 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.520 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.520 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:02:26.520 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.521 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.521 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.521 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.521 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.521 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.521 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.521 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:02:26.521 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.521 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.521 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.521 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.521 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.521 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.521 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.522 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:02:26.522 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.522 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.522 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.522 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.522 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.522 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.522 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.522 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:02:26.522 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.522 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.522 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.522 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.522 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.523 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.523 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.523 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:02:26.523 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.523 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.523 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.523 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.523 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.523 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.524 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.524 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:02:26.524 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.524 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.524 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.524 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.524 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.524 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.524 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.524 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:02:26.524 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.524 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.525 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.525 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.525 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.525 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.525 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.525 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:02:26.525 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.525 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.525 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.525 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.525 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.525 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.525 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.526 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:02:26.526 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.526 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.526 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.526 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.526 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.526 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.526 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.526 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.526 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.526 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.526 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.526 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.526 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 163, 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.485161+0000" 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.485173+0000" 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.527 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.528 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.528 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:02:26.528 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.485437+0000" 2024-09-16T08:02:26.528 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.528 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.528 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.528 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.528 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.528 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.528 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:02:26.528 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.528 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.528 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.529 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.529 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.529 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.529 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.529 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:02:26.529 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.485610+0000" 2024-09-16T08:02:26.529 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.529 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.529 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.529 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.529 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.529 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.529 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:02:26.529 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.485806+0000", 2024-09-16T08:02:26.530 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T08:02:26.530 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "PerShardPipeline::create_or_wait_pg", 2024-09-16T08:02:26.530 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.530 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T08:02:26.530 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 160 2024-09-16T08:02:26.530 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.530 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.530 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.530 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.530 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.530 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.530 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.530 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.530 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:02:26.531 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.531 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.531 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.531 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.531 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.531 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.531 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.531 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.531 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.531 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.531 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.531 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:02:26.531 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.531 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.532 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.532 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.532 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.532 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.532 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.532 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:02:26.532 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.532 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.532 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.532 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.532 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.532 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.532 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.532 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:02:26.533 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.533 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.533 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.533 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.533 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.533 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.533 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.533 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:02:26.533 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.533 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.533 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.533 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.533 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.533 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.534 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.534 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:02:26.534 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.534 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.534 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.534 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.534 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.534 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.534 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.534 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:02:26.534 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.534 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.534 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.534 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.535 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.535 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.535 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.535 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:02:26.535 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.535 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.535 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.535 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.535 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.535 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.535 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.535 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:02:26.535 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.535 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.536 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.536 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.536 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.536 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.536 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.536 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:02:26.536 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.536 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.536 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.536 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.536 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.536 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.537 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.537 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:02:26.537 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.537 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.537 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.537 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.537 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.537 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.537 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.537 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:02:26.537 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.537 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.537 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.538 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.538 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.538 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.538 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.538 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:02:26.538 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.538 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.538 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.538 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.538 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.538 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.538 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.538 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.538 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.539 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.539 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.539 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.539 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.539 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:02:26.539 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 164, 2024-09-16T08:02:26.539 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.539 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.539 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:02:26.539 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.486096+0000" 2024-09-16T08:02:26.539 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.539 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.539 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:02:26.539 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.486105+0000" 2024-09-16T08:02:26.540 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.540 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.540 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.540 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.540 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.540 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.540 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:02:26.540 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.486280+0000" 2024-09-16T08:02:26.540 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.540 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.540 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.540 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.540 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.540 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.541 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:02:26.541 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.541 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.541 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.541 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.541 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.541 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.541 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.541 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:02:26.541 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.486711+0000", 2024-09-16T08:02:26.541 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T08:02:26.541 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "ConnectionPipeline::get_pg_mapping", 2024-09-16T08:02:26.541 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.541 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T08:02:26.542 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 163 2024-09-16T08:02:26.542 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.542 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.542 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.542 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.542 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.542 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.542 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.542 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.542 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:02:26.542 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.542 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.542 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.542 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.543 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.543 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.543 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.543 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:02:26.543 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.543 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.543 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.543 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.543 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.543 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.543 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.543 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.543 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.544 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.544 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.544 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:02:26.544 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.544 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.544 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.544 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.544 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.544 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.544 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.544 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:02:26.544 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.544 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.545 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.545 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.545 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.545 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.545 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.545 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:02:26.545 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.545 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.545 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.545 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.545 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.545 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.545 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.545 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:02:26.546 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.546 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.546 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.546 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.546 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.546 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.546 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.546 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:02:26.546 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.546 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.546 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.546 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.546 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.546 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.547 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.547 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:02:26.547 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.547 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.547 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.547 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.547 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.547 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.547 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.547 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:02:26.547 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.547 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.547 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.548 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.548 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.548 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.548 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.548 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:02:26.548 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.548 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.548 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.548 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.548 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.548 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.548 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.548 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:02:26.548 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.549 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.549 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.549 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.549 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.549 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.549 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.549 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:02:26.549 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.549 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.549 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.549 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.549 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.549 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.550 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.550 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:02:26.550 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.550 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.550 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.550 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.550 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.550 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.550 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.550 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:02:26.550 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.550 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.550 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.551 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.551 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.551 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.551 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.551 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.551 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.551 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.551 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.551 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.551 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.551 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:02:26.551 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 167, 2024-09-16T08:02:26.551 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.551 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.552 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:02:26.552 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.487883+0000" 2024-09-16T08:02:26.552 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.552 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.552 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:02:26.552 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.487892+0000" 2024-09-16T08:02:26.552 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.552 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.552 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.552 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.552 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.552 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.552 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:02:26.552 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.488515+0000", 2024-09-16T08:02:26.553 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T08:02:26.553 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "ConnectionPipeline::await_map", 2024-09-16T08:02:26.553 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.553 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 1, 2024-09-16T08:02:26.553 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 164 2024-09-16T08:02:26.553 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.553 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.553 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.553 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.553 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.553 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.553 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.554 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.554 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:02:26.554 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.554 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.554 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.554 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.554 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.554 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.554 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.554 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:02:26.555 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.555 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.555 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.555 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.555 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.555 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.555 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.555 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:02:26.556 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.556 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.556 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.556 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.556 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.556 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.556 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.556 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:02:26.556 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.556 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.556 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:02:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.557 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:02:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:02:26.558 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.559 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.559 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.559 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.559 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.559 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.559 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.559 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:02:26.559 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:02:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.560 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:02:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:02:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.561 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.562 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.562 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.562 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:02:26.562 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.562 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.562 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.562 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.562 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.562 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.563 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.563 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:02:26.563 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.563 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.563 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.563 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.563 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.563 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.563 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:02:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:02:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.564 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:02:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.565 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:02:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 169, 2024-09-16T08:02:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:02:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.490054+0000" 2024-09-16T08:02:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:02:26.566 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.490069+0000", 2024-09-16T08:02:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T08:02:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "ConnectionPipeline::await_active", 2024-09-16T08:02:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 4, 2024-09-16T08:02:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 167 2024-09-16T08:02:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.567 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:02:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:02:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.568 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:02:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:02:26.569 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:02:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.570 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:02:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.571 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:02:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:02:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.572 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:02:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:02:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.573 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:02:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.574 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:02:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:02:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.575 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:02:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:02:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.576 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:02:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.577 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:02:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.578 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:02:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 172, 2024-09-16T08:02:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:02:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.491839+0000" 2024-09-16T08:02:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:02:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.491851+0000", 2024-09-16T08:02:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T08:02:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "ConnectionPipeline::await_active", 2024-09-16T08:02:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 4, 2024-09-16T08:02:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 167 2024-09-16T08:02:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:02:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.580 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:02:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.581 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:02:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:02:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.582 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:02:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.583 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:02:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:02:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.584 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:02:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:02:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.585 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:02:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.586 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:02:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:02:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.587 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:02:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:02:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.588 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:02:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.589 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:02:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:02:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.590 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:02:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 179, 2024-09-16T08:02:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:02:26.591 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.538872+0000" 2024-09-16T08:02:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:02:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.538890+0000", 2024-09-16T08:02:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T08:02:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "ConnectionPipeline::await_active", 2024-09-16T08:02:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 4, 2024-09-16T08:02:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 167 2024-09-16T08:02:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.592 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:02:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:02:26.593 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:02:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.594 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:02:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:02:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.595 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:02:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.596 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:02:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:02:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.597 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:02:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.598 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:02:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:02:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.599 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:02:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:02:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.600 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:02:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:02:26.601 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:02:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.602 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:02:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.603 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client_request", 2024-09-16T08:02:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 180, 2024-09-16T08:02:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:02:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.542599+0000" 2024-09-16T08:02:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:02:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:25.542616+0000", 2024-09-16T08:02:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T08:02:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "ConnectionPipeline::await_active", 2024-09-16T08:02:26.604 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 4, 2024-09-16T08:02:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 167 2024-09-16T08:02:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:02:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.605 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:02:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.606 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:02:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:02:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:02:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.609 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::AwaitMap", 2024-09-16T08:02:26.609 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.609 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.609 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.609 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.609 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.609 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.609 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.609 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:02:26.609 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.609 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.609 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.609 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.610 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.610 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.610 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.610 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitForActive", 2024-09-16T08:02:26.610 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.610 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.610 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.610 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.610 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.610 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.610 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.610 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGActivationBlocker", 2024-09-16T08:02:26.610 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.610 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.611 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.611 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.611 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.611 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.611 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.611 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::RecoverMissing", 2024-09-16T08:02:26.611 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.611 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.611 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.611 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.611 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.611 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.611 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.612 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::scrub::PGScrubber", 2024-09-16T08:02:26.612 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.612 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.612 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.612 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.612 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.612 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.612 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.612 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::CheckAlreadyCompleteGetObc", 2024-09-16T08:02:26.612 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.612 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.612 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.612 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.613 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.613 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.613 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.613 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::GetOBC", 2024-09-16T08:02:26.613 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.613 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.613 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.613 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.613 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.613 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.613 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.613 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::LockOBC", 2024-09-16T08:02:26.613 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.614 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.614 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.614 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.614 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.614 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.614 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.614 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::Process", 2024-09-16T08:02:26.614 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.614 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.614 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.615 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.615 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.615 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.615 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.615 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::CommonPGPipeline::WaitRepop", 2024-09-16T08:02:26.615 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.615 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.615 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.615 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.615 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.615 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.615 INFO:teuthology.orchestra.run.smithi003.stdout: "blocking_event": { 2024-09-16T08:02:26.615 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ClientRequest::PGPipeline::SendReply", 2024-09-16T08:02:26.616 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.616 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.616 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.616 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.616 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.616 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.616 INFO:teuthology.orchestra.run.smithi003.stdout: "time_event": { 2024-09-16T08:02:26.616 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.616 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.616 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.616 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.616 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.616 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.617 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T08:02:26.617 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 195, 2024-09-16T08:02:26.617 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.617 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T08:02:26.617 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "2", 2024-09-16T08:02:26.617 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.1", 2024-09-16T08:02:26.617 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 184, 2024-09-16T08:02:26.617 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 184, 2024-09-16T08:02:26.617 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 184 epoch_requested: 184 MNotifyRec 7.1 from 2 notify: (query:184 sent:184 7.1( v 174'1451 lc 149'993 (0'0,174'1451] local-lis/les=173/174 n=35 ec=130/130 lis/c=173/151 les/c/f=174/152/0 sis=183) ([151,182] all_participants={0, 1, 2, 3} intervals=[([167,170] acting={0, 3}), ([176,180] acting={0, 2, 3})])) features: 0x3f03dffffffdffff +create_info", 2024-09-16T08:02:26.617 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T08:02:26.617 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.617 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:02:26.617 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:26.457668+0000" 2024-09-16T08:02:26.618 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.618 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.618 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:02:26.618 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:26.457678+0000" 2024-09-16T08:02:26.618 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.618 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.618 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.618 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.618 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.618 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.618 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:02:26.618 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:26.458708+0000" 2024-09-16T08:02:26.618 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.618 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.619 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.619 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.619 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.619 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.619 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:02:26.619 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:26.459713+0000" 2024-09-16T08:02:26.619 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.619 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.619 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.619 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.619 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.619 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.619 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:02:26.619 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:26.460837+0000" 2024-09-16T08:02:26.620 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.620 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.620 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.620 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.620 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.620 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.620 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:02:26.620 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:26.461252+0000" 2024-09-16T08:02:26.620 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.620 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.620 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.620 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.620 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.621 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.621 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:02:26.621 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.621 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.621 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.621 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.621 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.621 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.621 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.621 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T08:02:26.621 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:26.462517+0000" 2024-09-16T08:02:26.621 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.621 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.621 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.622 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.622 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.622 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.622 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:02:26.622 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.622 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.622 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.622 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.622 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.622 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.622 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.622 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T08:02:26.622 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:26.463360+0000" 2024-09-16T08:02:26.623 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.623 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.623 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.623 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.623 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.623 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.623 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.623 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.623 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.623 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T08:02:26.623 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.623 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.623 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.624 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.624 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "peering_event", 2024-09-16T08:02:26.624 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 197, 2024-09-16T08:02:26.624 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.624 INFO:teuthology.orchestra.run.smithi003.stdout: "PeeringEvent": { 2024-09-16T08:02:26.624 INFO:teuthology.orchestra.run.smithi003.stdout: "from": "2", 2024-09-16T08:02:26.624 INFO:teuthology.orchestra.run.smithi003.stdout: "pgid": "7.8", 2024-09-16T08:02:26.624 INFO:teuthology.orchestra.run.smithi003.stdout: "sent": 184, 2024-09-16T08:02:26.624 INFO:teuthology.orchestra.run.smithi003.stdout: "requested": 184, 2024-09-16T08:02:26.624 INFO:teuthology.orchestra.run.smithi003.stdout: "evt": "epoch_sent: 184 epoch_requested: 184 MNotifyRec 7.8 from 2 notify: (query:184 sent:184 7.8( v 174'1410 lc 142'825 (0'0,174'1410] local-lis/les=173/174 n=53 ec=130/130 lis/c=173/151 les/c/f=174/152/0 sis=183) ([151,182] all_participants={0, 1, 2, 3} intervals=[([154,164] acting={0, 1}), ([179,180] acting={0, 2})])) features: 0x3f03dffffffdffff +create_info", 2024-09-16T08:02:26.624 INFO:teuthology.orchestra.run.smithi003.stdout: "events": [ 2024-09-16T08:02:26.624 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.624 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2024-09-16T08:02:26.625 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:26.462915+0000" 2024-09-16T08:02:26.625 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.625 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.625 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2024-09-16T08:02:26.625 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:26.462921+0000" 2024-09-16T08:02:26.625 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.625 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.625 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.625 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.625 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.625 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.625 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2024-09-16T08:02:26.625 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "2024-09-16T08:02:26.463490+0000", 2024-09-16T08:02:26.626 INFO:teuthology.orchestra.run.smithi003.stdout: "blocker": { 2024-09-16T08:02:26.626 INFO:teuthology.orchestra.run.smithi003.stdout: "op_type": "ConnectionPipeline::await_map", 2024-09-16T08:02:26.626 INFO:teuthology.orchestra.run.smithi003.stdout: "detail": { 2024-09-16T08:02:26.626 INFO:teuthology.orchestra.run.smithi003.stdout: "waiting": 0, 2024-09-16T08:02:26.626 INFO:teuthology.orchestra.run.smithi003.stdout: "held_by_operation_id": 197 2024-09-16T08:02:26.626 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.626 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.626 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.626 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.626 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.626 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.626 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.626 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.627 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2024-09-16T08:02:26.627 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.627 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.627 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.627 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.627 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.627 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.627 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.627 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2024-09-16T08:02:26.627 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.627 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.627 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.627 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2024-09-16T08:02:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2024-09-16T08:02:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.628 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2024-09-16T08:02:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.629 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2024-09-16T08:02:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2024-09-16T08:02:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2024-09-16T08:02:26.630 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-16T08:02:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-16T08:02:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2024-09-16T08:02:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: "initiated_at": "0.000000" 2024-09-16T08:02:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T08:02:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-16T08:02:26.631 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-16T08:02:26.631 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T08:02:27.609 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:02:27.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:27.725+0000 7f503c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:27.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:27.732+0000 7f503c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:27.789 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-16T08:02:28.195 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:02:28.195 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:02:30.196 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T08:02:30.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:30.322+0000 7f0472591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:30.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:30.330+0000 7f0472591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:30.366 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-16T08:02:30.915 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:02:30.915 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:02:31.633 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [1] live_osds: [3, 2, 0] 2024-09-16T08:02:31.633 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-16T08:02:31.633 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-09-16T08:02:31.633 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T08:02:31.633 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T08:02:31.636 INFO:tasks.ceph.osd.1:Started 2024-09-16T08:02:31.636 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T08:02:31.769 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T08:02:31.772 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:02:31.772 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-16T08:02:31.924 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Removed 11963 objects 2024-09-16T08:02:31.924 INFO:tasks.radosbench.radosbench.0.smithi003.stdout:Clean up completed and total clean up time :218.262 2024-09-16T08:02:32.916 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T08:02:33.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:33.027+0000 7f8ab6311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:33.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:33.034+0000 7f8ab6311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:33.086 INFO:teuthology.orchestra.run.smithi003.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-16T08:02:33.180 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-16T08:02:33.180 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-16T08:02:33.731 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_4 2024-09-16T08:02:33.731 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2024-09-16T08:02:33.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:33.864+0000 7fc5c3d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:33.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:33.878+0000 7fc5c3d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:34.580 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'unique_pool_4' removed 2024-09-16T08:02:34.597 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-16T08:02:34.610 INFO:tasks.thrashosds:joining thrashosds 2024-09-16T08:02:36.773 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T08:02:36.874 INFO:teuthology.orchestra.run.smithi003.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-16T08:02:36.877 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T08:02:36.878 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-16T08:02:41.879 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-16T08:02:41.987 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T08:02:41.987 INFO:teuthology.orchestra.run.smithi003.stdout: "ops_in_flight": [] 2024-09-16T08:02:41.987 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T08:02:46.998 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-16T08:02:47.125 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:47.124+0000 7fdde2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:47.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:47.131+0000 7fdde2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:47.146 INFO:teuthology.orchestra.run.smithi003.stdout:{} 2024-09-16T08:02:47.146 INFO:teuthology.orchestra.run.smithi003.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-16T08:02:47.161 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T08:02:47.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:47.271+0000 7f68f7791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:47.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:47.282+0000 7f68f7791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:48.103 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T08:02:48.127 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-16T08:02:48.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:48.241+0000 7f05716fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:48.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:48.252+0000 7f05716fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:49.134 INFO:teuthology.orchestra.run.smithi003.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-16T08:02:49.159 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T08:02:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:49.275+0000 7f1700e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:49.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:49.288+0000 7f1700e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:50.135 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T08:02:50.161 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-16T08:02:50.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:50.276+0000 7f10ff591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:50.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:50.287+0000 7f10ff591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:51.144 INFO:teuthology.orchestra.run.smithi003.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-16T08:02:51.167 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T08:02:51.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:51.287+0000 7fb206911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:51.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:51.297+0000 7fb206911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:52.145 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T08:02:52.170 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-16T08:02:52.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:52.283+0000 7fdc2f951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:52.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:52.294+0000 7fdc2f951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:53.154 INFO:teuthology.orchestra.run.smithi003.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-16T08:02:53.178 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T08:02:53.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:53.291+0000 7f5d84b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:53.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:53.302+0000 7f5d84b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:54.155 INFO:teuthology.orchestra.run.smithi003.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T08:02:54.181 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-16T08:02:54.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:54.297+0000 7f5423151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:54.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:54.308+0000 7f5423151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:55.161 INFO:teuthology.orchestra.run.smithi003.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-16T08:02:55.189 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-16T08:02:55.189 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T08:02:55.189 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T08:02:55.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:55.301+0000 7f0269d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:55.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:55.310+0000 7f0269d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:55.505 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T08:02:55.505 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":197,"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","created":"2024-09-16T07:44:57.934858+0000","modified":"2024-09-16T08:02:55.162098+0000","last_up_change":"2024-09-16T08:02:42.106079+0000","last_in_change":"2024-09-16T07:45:00.057112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:45:06.304380+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:45:08.254361+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92b524c0-1e32-4c56-a983-7be51186e765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":176,"last_clean_end":178,"up_from":182,"up_thru":187,"down_at":181,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":2767087644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2767087644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6801","nonce":2767087644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2767087644}]},"public_addr":"172.21.15.3:6805/2767087644","cluster_addr":"172.21.15.3:6806/2767087644","heartbeat_back_addr":"172.21.15.3:6801/2767087644","heartbeat_front_addr":"172.21.15.3:6802/2767087644","state":["exists","up"]},{"osd":1,"uuid":"51e5f821-e631-4cc1-8a37-d7b188901edf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":147,"last_clean_end":174,"up_from":187,"up_thru":188,"down_at":179,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":924983034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":924983034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":924983034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6803","nonce":924983034}]},"public_addr":"172.21.15.3:6822/924983034","cluster_addr":"172.21.15.3:6821/924983034","heartbeat_back_addr":"172.21.15.3:6804/924983034","heartbeat_front_addr":"172.21.15.3:6803/924983034","state":["exists","up"]},{"osd":2,"uuid":"0a8a850b-ad4a-4499-945d-1c2672d0a2cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":107,"last_clean_end":142,"up_from":153,"up_thru":183,"down_at":145,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3431415356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3431415356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3431415356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3431415356}]},"public_addr":"172.21.15.134:6803/3431415356","cluster_addr":"172.21.15.134:6802/3431415356","heartbeat_back_addr":"172.21.15.134:6808/3431415356","heartbeat_front_addr":"172.21.15.134:6809/3431415356","state":["exists","up"]},{"osd":3,"uuid":"d8f5c79f-4068-4ef9-a125-508f70e18ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":55,"last_clean_end":86,"up_from":88,"up_thru":187,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2558216642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":2558216642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2558216642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2558216642}]},"public_addr":"172.21.15.134:6804/2558216642","cluster_addr":"172.21.15.134:6805/2558216642","heartbeat_back_addr":"172.21.15.134:6807/2558216642","heartbeat_front_addr":"172.21.15.134:6806/2558216642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2024-09-16T08:02:23.121604+0000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"2024-09-16T08:02:14.106088+0000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2024-09-16T07:59:56.096963+0000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2024-09-16T07:54:02.037877+0000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.3","mappings":[{"from":0,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T08:02:55.519 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T08:02:55.519 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T08:02:55.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:55.629+0000 7fc5898c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:55.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:55.638+0000 7fc5898c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:55.836 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T08:02:55.836 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":197,"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","created":"2024-09-16T07:44:57.934858+0000","modified":"2024-09-16T08:02:55.162098+0000","last_up_change":"2024-09-16T08:02:42.106079+0000","last_in_change":"2024-09-16T07:45:00.057112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:45:06.304380+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:45:08.254361+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92b524c0-1e32-4c56-a983-7be51186e765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":176,"last_clean_end":178,"up_from":182,"up_thru":187,"down_at":181,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":2767087644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2767087644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6801","nonce":2767087644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2767087644}]},"public_addr":"172.21.15.3:6805/2767087644","cluster_addr":"172.21.15.3:6806/2767087644","heartbeat_back_addr":"172.21.15.3:6801/2767087644","heartbeat_front_addr":"172.21.15.3:6802/2767087644","state":["exists","up"]},{"osd":1,"uuid":"51e5f821-e631-4cc1-8a37-d7b188901edf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":147,"last_clean_end":174,"up_from":187,"up_thru":188,"down_at":179,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":924983034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":924983034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":924983034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6803","nonce":924983034}]},"public_addr":"172.21.15.3:6822/924983034","cluster_addr":"172.21.15.3:6821/924983034","heartbeat_back_addr":"172.21.15.3:6804/924983034","heartbeat_front_addr":"172.21.15.3:6803/924983034","state":["exists","up"]},{"osd":2,"uuid":"0a8a850b-ad4a-4499-945d-1c2672d0a2cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":107,"last_clean_end":142,"up_from":153,"up_thru":183,"down_at":145,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3431415356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3431415356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3431415356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3431415356}]},"public_addr":"172.21.15.134:6803/3431415356","cluster_addr":"172.21.15.134:6802/3431415356","heartbeat_back_addr":"172.21.15.134:6808/3431415356","heartbeat_front_addr":"172.21.15.134:6809/3431415356","state":["exists","up"]},{"osd":3,"uuid":"d8f5c79f-4068-4ef9-a125-508f70e18ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":55,"last_clean_end":86,"up_from":88,"up_thru":187,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2558216642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":2558216642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2558216642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2558216642}]},"public_addr":"172.21.15.134:6804/2558216642","cluster_addr":"172.21.15.134:6805/2558216642","heartbeat_back_addr":"172.21.15.134:6807/2558216642","heartbeat_front_addr":"172.21.15.134:6806/2558216642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2024-09-16T08:02:23.121604+0000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"2024-09-16T08:02:14.106088+0000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2024-09-16T07:59:56.096963+0000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2024-09-16T07:54:02.037877+0000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.3","mappings":[{"from":0,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T08:02:55.851 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T08:02:55.852 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T08:02:55.852 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T08:02:55.853 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T08:02:55.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:55.974+0000 7f2f71ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:55.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:55.974+0000 7f7305a93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:55.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:55.974+0000 7f210b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:55.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:55.974+0000 7fcf5e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:55.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:55.985+0000 7f2f71ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:55.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:55.986+0000 7f210b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:55.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:55.986+0000 7f7305a93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:55.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:55.986+0000 7fcf5e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:56.023 INFO:teuthology.orchestra.run.smithi003.stdout:803158884365 2024-09-16T08:02:56.024 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T08:02:56.024 INFO:teuthology.orchestra.run.smithi003.stdout:377957122580 2024-09-16T08:02:56.025 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T08:02:56.025 INFO:teuthology.orchestra.run.smithi003.stdout:657129996443 2024-09-16T08:02:56.026 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T08:02:56.027 INFO:teuthology.orchestra.run.smithi003.stdout:781684047903 2024-09-16T08:02:56.027 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T08:02:56.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:56.186+0000 7f3182311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:56.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:56.186+0000 7f3d8ecbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:56.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:56.186+0000 7f43dcb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:56.192 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:56.187+0000 7fa509697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:56.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:56.197+0000 7f3182311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:56.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:56.197+0000 7f3d8ecbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:56.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:56.198+0000 7f43dcb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:56.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:56.198+0000 7fa509697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:56.399 INFO:teuthology.orchestra.run.smithi003.stdout:631360192602 2024-09-16T08:02:56.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 803158884365 got 631360192602 for osd.1 2024-09-16T08:02:56.413 INFO:teuthology.orchestra.run.smithi003.stdout:657129996438 2024-09-16T08:02:56.426 INFO:teuthology.orchestra.run.smithi003.stdout:377957122557 2024-09-16T08:02:56.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 657129996443 got 657129996438 for osd.2 2024-09-16T08:02:56.433 INFO:teuthology.orchestra.run.smithi003.stdout:781684047901 2024-09-16T08:02:56.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 377957122580 got 377957122557 for osd.3 2024-09-16T08:02:56.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 781684047903 got 781684047901 for osd.0 2024-09-16T08:02:57.414 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T08:02:57.428 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T08:02:57.443 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T08:02:57.451 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T08:02:57.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:57.547+0000 7f8816991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:57.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:57.561+0000 7f8816991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:57.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:57.590+0000 7f8e70511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:57.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:57.587+0000 7fa94b246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:57.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:57.587+0000 7fc685991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:57.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:57.602+0000 7f8e70511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:57.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:57.603+0000 7fa94b246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:57.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:57.604+0000 7fc685991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:57.774 INFO:teuthology.orchestra.run.smithi003.stdout:803158884365 2024-09-16T08:02:57.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 803158884365 got 803158884365 for osd.1 2024-09-16T08:02:57.789 DEBUG:teuthology.parallel:result is None 2024-09-16T08:02:57.814 INFO:teuthology.orchestra.run.smithi003.stdout:781684047903 2024-09-16T08:02:57.818 INFO:teuthology.orchestra.run.smithi003.stdout:377957122580 2024-09-16T08:02:57.825 INFO:teuthology.orchestra.run.smithi003.stdout:657129996443 2024-09-16T08:02:57.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 781684047903 got 781684047903 for osd.0 2024-09-16T08:02:57.829 DEBUG:teuthology.parallel:result is None 2024-09-16T08:02:57.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 377957122580 got 377957122580 for osd.3 2024-09-16T08:02:57.833 DEBUG:teuthology.parallel:result is None 2024-09-16T08:02:57.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 657129996443 got 657129996443 for osd.2 2024-09-16T08:02:57.839 DEBUG:teuthology.parallel:result is None 2024-09-16T08:02:57.839 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T08:02:57.840 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:02:57.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:57.990+0000 7faa57b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:57.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:57.998+0000 7faa57b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:58.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T08:02:58.200 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T08:02:58.212 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":726,"stamp":"2024-09-16T08:02:58.107244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":192248,"kb_used_data":6584,"kb_used_omap":0,"kb_used_meta":185600,"kb_avail":377295112,"statfs":{"total":386547056640,"available":386350194688,"internally_reserved":0,"allocated":6742016,"data_stored":4476624,"data_compressed":90123,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":190054400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.578481"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":595,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.176532+0000","last_change":"2024-09-16T08:02:25.254110+0000","last_active":"2024-09-16T08:02:55.176532+0000","last_peered":"2024-09-16T08:02:55.176532+0000","last_clean":"2024-09-16T08:02:55.176532+0000","last_became_active":"2024-09-16T08:02:25.237787+0000","last_became_peered":"2024-09-16T08:02:25.237787+0000","last_unstale":"2024-09-16T08:02:55.176532+0000","last_undegraded":"2024-09-16T08:02:55.176532+0000","last_fullsized":"2024-09-16T08:02:55.176532+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":365,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.184254+0000","last_change":"2024-09-16T08:02:48.132432+0000","last_active":"2024-09-16T08:02:55.184254+0000","last_peered":"2024-09-16T08:02:55.184254+0000","last_clean":"2024-09-16T08:02:55.184254+0000","last_became_active":"2024-09-16T08:02:44.162399+0000","last_became_peered":"2024-09-16T08:02:44.162399+0000","last_unstale":"2024-09-16T08:02:55.184254+0000","last_undegraded":"2024-09-16T08:02:55.184254+0000","last_fullsized":"2024-09-16T08:02:55.184254+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":298,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.181679+0000","last_change":"2024-09-16T08:02:44.133612+0000","last_active":"2024-09-16T08:02:55.181679+0000","last_peered":"2024-09-16T08:02:55.181679+0000","last_clean":"2024-09-16T08:02:55.181679+0000","last_became_active":"2024-09-16T08:02:43.166912+0000","last_became_peered":"2024-09-16T08:02:43.166912+0000","last_unstale":"2024-09-16T08:02:55.181679+0000","last_undegraded":"2024-09-16T08:02:55.181679+0000","last_fullsized":"2024-09-16T08:02:55.181679+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":344,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.185147+0000","last_change":"2024-09-16T08:02:44.147862+0000","last_active":"2024-09-16T08:02:55.185147+0000","last_peered":"2024-09-16T08:02:55.185147+0000","last_clean":"2024-09-16T08:02:55.185147+0000","last_became_active":"2024-09-16T08:02:43.181556+0000","last_became_peered":"2024-09-16T08:02:43.181556+0000","last_unstale":"2024-09-16T08:02:55.185147+0000","last_undegraded":"2024-09-16T08:02:55.185147+0000","last_fullsized":"2024-09-16T08:02:55.185147+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":306,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.186317+0000","last_change":"2024-09-16T08:02:44.139535+0000","last_active":"2024-09-16T08:02:55.186317+0000","last_peered":"2024-09-16T08:02:55.186317+0000","last_clean":"2024-09-16T08:02:55.186317+0000","last_became_active":"2024-09-16T08:02:43.173555+0000","last_became_peered":"2024-09-16T08:02:43.173555+0000","last_unstale":"2024-09-16T08:02:55.186317+0000","last_undegraded":"2024-09-16T08:02:55.186317+0000","last_fullsized":"2024-09-16T08:02:55.186317+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.177133+0000","last_change":"2024-09-16T08:02:26.265190+0000","last_active":"2024-09-16T08:02:55.177133+0000","last_peered":"2024-09-16T08:02:55.177133+0000","last_clean":"2024-09-16T08:02:55.177133+0000","last_became_active":"2024-09-16T08:02:25.283079+0000","last_became_peered":"2024-09-16T08:02:25.283079+0000","last_unstale":"2024-09-16T08:02:55.177133+0000","last_undegraded":"2024-09-16T08:02:55.177133+0000","last_fullsized":"2024-09-16T08:02:55.177133+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.175253+0000","last_change":"2024-09-16T08:02:26.167686+0000","last_active":"2024-09-16T08:02:55.175253+0000","last_peered":"2024-09-16T08:02:55.175253+0000","last_clean":"2024-09-16T08:02:55.175253+0000","last_became_active":"2024-09-16T08:02:25.263809+0000","last_became_peered":"2024-09-16T08:02:25.263809+0000","last_unstale":"2024-09-16T08:02:55.175253+0000","last_undegraded":"2024-09-16T08:02:55.175253+0000","last_fullsized":"2024-09-16T08:02:55.175253+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.175894+0000","last_change":"2024-09-16T08:02:26.264867+0000","last_active":"2024-09-16T08:02:55.175894+0000","last_peered":"2024-09-16T08:02:55.175894+0000","last_clean":"2024-09-16T08:02:55.175894+0000","last_became_active":"2024-09-16T08:02:25.362667+0000","last_became_peered":"2024-09-16T08:02:25.362667+0000","last_unstale":"2024-09-16T08:02:55.175894+0000","last_undegraded":"2024-09-16T08:02:55.175894+0000","last_fullsized":"2024-09-16T08:02:55.175894+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":479,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.186751+0000","last_change":"2024-09-16T08:02:44.148290+0000","last_active":"2024-09-16T08:02:55.186751+0000","last_peered":"2024-09-16T08:02:55.186751+0000","last_clean":"2024-09-16T08:02:55.186751+0000","last_became_active":"2024-09-16T08:02:43.189244+0000","last_became_peered":"2024-09-16T08:02:43.189244+0000","last_unstale":"2024-09-16T08:02:55.186751+0000","last_undegraded":"2024-09-16T08:02:55.186751+0000","last_fullsized":"2024-09-16T08:02:55.186751+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79884,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":78208,"kb_avail":94291956,"statfs":{"total":96636764160,"available":96554962944,"internally_reserved":0,"allocated":1699840,"data_stored":1267472,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":80084992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":153,"seq":657129996443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35600,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":33920,"kb_avail":94336240,"statfs":{"total":96636764160,"available":96600309760,"internally_reserved":0,"allocated":1703936,"data_stored":1267491,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":34734080},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":187,"seq":803158884365,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36116,"kb_used_data":1604,"kb_used_omap":0,"kb_used_meta":34496,"kb_avail":94335724,"statfs":{"total":96636764160,"available":96599781376,"internally_reserved":0,"allocated":1642496,"data_stored":677123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35323904},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":182,"seq":781684047903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40648,"kb_used_data":1656,"kb_used_omap":0,"kb_used_meta":38976,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1695744,"data_stored":1264538,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":39911424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:02:58.214 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:02:58.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:58.325+0000 7f161fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:58.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:58.334+0000 7f161fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:58.531 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T08:02:58.531 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T08:02:58.544 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":727,"stamp":"2024-09-16T08:02:58.530355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":192248,"kb_used_data":6584,"kb_used_omap":0,"kb_used_meta":185600,"kb_avail":377295112,"statfs":{"total":386547056640,"available":386350194688,"internally_reserved":0,"allocated":6742016,"data_stored":4476624,"data_compressed":90123,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":190054400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.373799"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":595,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.176532+0000","last_change":"2024-09-16T08:02:25.254110+0000","last_active":"2024-09-16T08:02:55.176532+0000","last_peered":"2024-09-16T08:02:55.176532+0000","last_clean":"2024-09-16T08:02:55.176532+0000","last_became_active":"2024-09-16T08:02:25.237787+0000","last_became_peered":"2024-09-16T08:02:25.237787+0000","last_unstale":"2024-09-16T08:02:55.176532+0000","last_undegraded":"2024-09-16T08:02:55.176532+0000","last_fullsized":"2024-09-16T08:02:55.176532+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":365,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.184254+0000","last_change":"2024-09-16T08:02:48.132432+0000","last_active":"2024-09-16T08:02:55.184254+0000","last_peered":"2024-09-16T08:02:55.184254+0000","last_clean":"2024-09-16T08:02:55.184254+0000","last_became_active":"2024-09-16T08:02:44.162399+0000","last_became_peered":"2024-09-16T08:02:44.162399+0000","last_unstale":"2024-09-16T08:02:55.184254+0000","last_undegraded":"2024-09-16T08:02:55.184254+0000","last_fullsized":"2024-09-16T08:02:55.184254+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":298,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.181679+0000","last_change":"2024-09-16T08:02:44.133612+0000","last_active":"2024-09-16T08:02:55.181679+0000","last_peered":"2024-09-16T08:02:55.181679+0000","last_clean":"2024-09-16T08:02:55.181679+0000","last_became_active":"2024-09-16T08:02:43.166912+0000","last_became_peered":"2024-09-16T08:02:43.166912+0000","last_unstale":"2024-09-16T08:02:55.181679+0000","last_undegraded":"2024-09-16T08:02:55.181679+0000","last_fullsized":"2024-09-16T08:02:55.181679+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":344,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.185147+0000","last_change":"2024-09-16T08:02:44.147862+0000","last_active":"2024-09-16T08:02:55.185147+0000","last_peered":"2024-09-16T08:02:55.185147+0000","last_clean":"2024-09-16T08:02:55.185147+0000","last_became_active":"2024-09-16T08:02:43.181556+0000","last_became_peered":"2024-09-16T08:02:43.181556+0000","last_unstale":"2024-09-16T08:02:55.185147+0000","last_undegraded":"2024-09-16T08:02:55.185147+0000","last_fullsized":"2024-09-16T08:02:55.185147+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":306,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.186317+0000","last_change":"2024-09-16T08:02:44.139535+0000","last_active":"2024-09-16T08:02:55.186317+0000","last_peered":"2024-09-16T08:02:55.186317+0000","last_clean":"2024-09-16T08:02:55.186317+0000","last_became_active":"2024-09-16T08:02:43.173555+0000","last_became_peered":"2024-09-16T08:02:43.173555+0000","last_unstale":"2024-09-16T08:02:55.186317+0000","last_undegraded":"2024-09-16T08:02:55.186317+0000","last_fullsized":"2024-09-16T08:02:55.186317+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.177133+0000","last_change":"2024-09-16T08:02:26.265190+0000","last_active":"2024-09-16T08:02:55.177133+0000","last_peered":"2024-09-16T08:02:55.177133+0000","last_clean":"2024-09-16T08:02:55.177133+0000","last_became_active":"2024-09-16T08:02:25.283079+0000","last_became_peered":"2024-09-16T08:02:25.283079+0000","last_unstale":"2024-09-16T08:02:55.177133+0000","last_undegraded":"2024-09-16T08:02:55.177133+0000","last_fullsized":"2024-09-16T08:02:55.177133+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.175253+0000","last_change":"2024-09-16T08:02:26.167686+0000","last_active":"2024-09-16T08:02:55.175253+0000","last_peered":"2024-09-16T08:02:55.175253+0000","last_clean":"2024-09-16T08:02:55.175253+0000","last_became_active":"2024-09-16T08:02:25.263809+0000","last_became_peered":"2024-09-16T08:02:25.263809+0000","last_unstale":"2024-09-16T08:02:55.175253+0000","last_undegraded":"2024-09-16T08:02:55.175253+0000","last_fullsized":"2024-09-16T08:02:55.175253+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.175894+0000","last_change":"2024-09-16T08:02:26.264867+0000","last_active":"2024-09-16T08:02:55.175894+0000","last_peered":"2024-09-16T08:02:55.175894+0000","last_clean":"2024-09-16T08:02:55.175894+0000","last_became_active":"2024-09-16T08:02:25.362667+0000","last_became_peered":"2024-09-16T08:02:25.362667+0000","last_unstale":"2024-09-16T08:02:55.175894+0000","last_undegraded":"2024-09-16T08:02:55.175894+0000","last_fullsized":"2024-09-16T08:02:55.175894+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":479,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.186751+0000","last_change":"2024-09-16T08:02:44.148290+0000","last_active":"2024-09-16T08:02:55.186751+0000","last_peered":"2024-09-16T08:02:55.186751+0000","last_clean":"2024-09-16T08:02:55.186751+0000","last_became_active":"2024-09-16T08:02:43.189244+0000","last_became_peered":"2024-09-16T08:02:43.189244+0000","last_unstale":"2024-09-16T08:02:55.186751+0000","last_undegraded":"2024-09-16T08:02:55.186751+0000","last_fullsized":"2024-09-16T08:02:55.186751+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79884,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":78208,"kb_avail":94291956,"statfs":{"total":96636764160,"available":96554962944,"internally_reserved":0,"allocated":1699840,"data_stored":1267472,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":80084992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":153,"seq":657129996443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35600,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":33920,"kb_avail":94336240,"statfs":{"total":96636764160,"available":96600309760,"internally_reserved":0,"allocated":1703936,"data_stored":1267491,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":34734080},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":187,"seq":803158884365,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36116,"kb_used_data":1604,"kb_used_omap":0,"kb_used_meta":34496,"kb_avail":94335724,"statfs":{"total":96636764160,"available":96599781376,"internally_reserved":0,"allocated":1642496,"data_stored":677123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35323904},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":182,"seq":781684047903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40648,"kb_used_data":1656,"kb_used_omap":0,"kb_used_meta":38976,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1695744,"data_stored":1264538,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":39911424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:02:58.545 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T08:02:58.545 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-16T08:02:58.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:58.655+0000 7f7c5caa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:58.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:58.667+0000 7f7c5caa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:58.881 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T08:02:58.891 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T08:02:58.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:02:59.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:59.000+0000 7f1580711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:59.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:59.009+0000 7f1580711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:59.208 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T08:02:59.209 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T08:02:59.221 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":727,"stamp":"2024-09-16T08:02:58.530355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":192248,"kb_used_data":6584,"kb_used_omap":0,"kb_used_meta":185600,"kb_avail":377295112,"statfs":{"total":386547056640,"available":386350194688,"internally_reserved":0,"allocated":6742016,"data_stored":4476624,"data_compressed":90123,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":190054400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.373799"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":595,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.176532+0000","last_change":"2024-09-16T08:02:25.254110+0000","last_active":"2024-09-16T08:02:55.176532+0000","last_peered":"2024-09-16T08:02:55.176532+0000","last_clean":"2024-09-16T08:02:55.176532+0000","last_became_active":"2024-09-16T08:02:25.237787+0000","last_became_peered":"2024-09-16T08:02:25.237787+0000","last_unstale":"2024-09-16T08:02:55.176532+0000","last_undegraded":"2024-09-16T08:02:55.176532+0000","last_fullsized":"2024-09-16T08:02:55.176532+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":365,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.184254+0000","last_change":"2024-09-16T08:02:48.132432+0000","last_active":"2024-09-16T08:02:55.184254+0000","last_peered":"2024-09-16T08:02:55.184254+0000","last_clean":"2024-09-16T08:02:55.184254+0000","last_became_active":"2024-09-16T08:02:44.162399+0000","last_became_peered":"2024-09-16T08:02:44.162399+0000","last_unstale":"2024-09-16T08:02:55.184254+0000","last_undegraded":"2024-09-16T08:02:55.184254+0000","last_fullsized":"2024-09-16T08:02:55.184254+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":298,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.181679+0000","last_change":"2024-09-16T08:02:44.133612+0000","last_active":"2024-09-16T08:02:55.181679+0000","last_peered":"2024-09-16T08:02:55.181679+0000","last_clean":"2024-09-16T08:02:55.181679+0000","last_became_active":"2024-09-16T08:02:43.166912+0000","last_became_peered":"2024-09-16T08:02:43.166912+0000","last_unstale":"2024-09-16T08:02:55.181679+0000","last_undegraded":"2024-09-16T08:02:55.181679+0000","last_fullsized":"2024-09-16T08:02:55.181679+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":344,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.185147+0000","last_change":"2024-09-16T08:02:44.147862+0000","last_active":"2024-09-16T08:02:55.185147+0000","last_peered":"2024-09-16T08:02:55.185147+0000","last_clean":"2024-09-16T08:02:55.185147+0000","last_became_active":"2024-09-16T08:02:43.181556+0000","last_became_peered":"2024-09-16T08:02:43.181556+0000","last_unstale":"2024-09-16T08:02:55.185147+0000","last_undegraded":"2024-09-16T08:02:55.185147+0000","last_fullsized":"2024-09-16T08:02:55.185147+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":306,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.186317+0000","last_change":"2024-09-16T08:02:44.139535+0000","last_active":"2024-09-16T08:02:55.186317+0000","last_peered":"2024-09-16T08:02:55.186317+0000","last_clean":"2024-09-16T08:02:55.186317+0000","last_became_active":"2024-09-16T08:02:43.173555+0000","last_became_peered":"2024-09-16T08:02:43.173555+0000","last_unstale":"2024-09-16T08:02:55.186317+0000","last_undegraded":"2024-09-16T08:02:55.186317+0000","last_fullsized":"2024-09-16T08:02:55.186317+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.177133+0000","last_change":"2024-09-16T08:02:26.265190+0000","last_active":"2024-09-16T08:02:55.177133+0000","last_peered":"2024-09-16T08:02:55.177133+0000","last_clean":"2024-09-16T08:02:55.177133+0000","last_became_active":"2024-09-16T08:02:25.283079+0000","last_became_peered":"2024-09-16T08:02:25.283079+0000","last_unstale":"2024-09-16T08:02:55.177133+0000","last_undegraded":"2024-09-16T08:02:55.177133+0000","last_fullsized":"2024-09-16T08:02:55.177133+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.175253+0000","last_change":"2024-09-16T08:02:26.167686+0000","last_active":"2024-09-16T08:02:55.175253+0000","last_peered":"2024-09-16T08:02:55.175253+0000","last_clean":"2024-09-16T08:02:55.175253+0000","last_became_active":"2024-09-16T08:02:25.263809+0000","last_became_peered":"2024-09-16T08:02:25.263809+0000","last_unstale":"2024-09-16T08:02:55.175253+0000","last_undegraded":"2024-09-16T08:02:55.175253+0000","last_fullsized":"2024-09-16T08:02:55.175253+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.175894+0000","last_change":"2024-09-16T08:02:26.264867+0000","last_active":"2024-09-16T08:02:55.175894+0000","last_peered":"2024-09-16T08:02:55.175894+0000","last_clean":"2024-09-16T08:02:55.175894+0000","last_became_active":"2024-09-16T08:02:25.362667+0000","last_became_peered":"2024-09-16T08:02:25.362667+0000","last_unstale":"2024-09-16T08:02:55.175894+0000","last_undegraded":"2024-09-16T08:02:55.175894+0000","last_fullsized":"2024-09-16T08:02:55.175894+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":479,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.186751+0000","last_change":"2024-09-16T08:02:44.148290+0000","last_active":"2024-09-16T08:02:55.186751+0000","last_peered":"2024-09-16T08:02:55.186751+0000","last_clean":"2024-09-16T08:02:55.186751+0000","last_became_active":"2024-09-16T08:02:43.189244+0000","last_became_peered":"2024-09-16T08:02:43.189244+0000","last_unstale":"2024-09-16T08:02:55.186751+0000","last_undegraded":"2024-09-16T08:02:55.186751+0000","last_fullsized":"2024-09-16T08:02:55.186751+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79884,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":78208,"kb_avail":94291956,"statfs":{"total":96636764160,"available":96554962944,"internally_reserved":0,"allocated":1699840,"data_stored":1267472,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":80084992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":153,"seq":657129996443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35600,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":33920,"kb_avail":94336240,"statfs":{"total":96636764160,"available":96600309760,"internally_reserved":0,"allocated":1703936,"data_stored":1267491,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":34734080},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":187,"seq":803158884365,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36116,"kb_used_data":1604,"kb_used_omap":0,"kb_used_meta":34496,"kb_avail":94335724,"statfs":{"total":96636764160,"available":96599781376,"internally_reserved":0,"allocated":1642496,"data_stored":677123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35323904},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":182,"seq":781684047903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40648,"kb_used_data":1656,"kb_used_omap":0,"kb_used_meta":38976,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1695744,"data_stored":1264538,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":39911424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:02:59.222 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:02:59.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:59.332+0000 7fd2546c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:59.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:59.341+0000 7fd2546c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:59.534 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T08:02:59.535 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T08:02:59.547 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":727,"stamp":"2024-09-16T08:02:58.530355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":192248,"kb_used_data":6584,"kb_used_omap":0,"kb_used_meta":185600,"kb_avail":377295112,"statfs":{"total":386547056640,"available":386350194688,"internally_reserved":0,"allocated":6742016,"data_stored":4476624,"data_compressed":90123,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":190054400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.373799"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":595,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.176532+0000","last_change":"2024-09-16T08:02:25.254110+0000","last_active":"2024-09-16T08:02:55.176532+0000","last_peered":"2024-09-16T08:02:55.176532+0000","last_clean":"2024-09-16T08:02:55.176532+0000","last_became_active":"2024-09-16T08:02:25.237787+0000","last_became_peered":"2024-09-16T08:02:25.237787+0000","last_unstale":"2024-09-16T08:02:55.176532+0000","last_undegraded":"2024-09-16T08:02:55.176532+0000","last_fullsized":"2024-09-16T08:02:55.176532+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":365,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.184254+0000","last_change":"2024-09-16T08:02:48.132432+0000","last_active":"2024-09-16T08:02:55.184254+0000","last_peered":"2024-09-16T08:02:55.184254+0000","last_clean":"2024-09-16T08:02:55.184254+0000","last_became_active":"2024-09-16T08:02:44.162399+0000","last_became_peered":"2024-09-16T08:02:44.162399+0000","last_unstale":"2024-09-16T08:02:55.184254+0000","last_undegraded":"2024-09-16T08:02:55.184254+0000","last_fullsized":"2024-09-16T08:02:55.184254+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":298,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.181679+0000","last_change":"2024-09-16T08:02:44.133612+0000","last_active":"2024-09-16T08:02:55.181679+0000","last_peered":"2024-09-16T08:02:55.181679+0000","last_clean":"2024-09-16T08:02:55.181679+0000","last_became_active":"2024-09-16T08:02:43.166912+0000","last_became_peered":"2024-09-16T08:02:43.166912+0000","last_unstale":"2024-09-16T08:02:55.181679+0000","last_undegraded":"2024-09-16T08:02:55.181679+0000","last_fullsized":"2024-09-16T08:02:55.181679+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":344,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.185147+0000","last_change":"2024-09-16T08:02:44.147862+0000","last_active":"2024-09-16T08:02:55.185147+0000","last_peered":"2024-09-16T08:02:55.185147+0000","last_clean":"2024-09-16T08:02:55.185147+0000","last_became_active":"2024-09-16T08:02:43.181556+0000","last_became_peered":"2024-09-16T08:02:43.181556+0000","last_unstale":"2024-09-16T08:02:55.185147+0000","last_undegraded":"2024-09-16T08:02:55.185147+0000","last_fullsized":"2024-09-16T08:02:55.185147+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":306,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.186317+0000","last_change":"2024-09-16T08:02:44.139535+0000","last_active":"2024-09-16T08:02:55.186317+0000","last_peered":"2024-09-16T08:02:55.186317+0000","last_clean":"2024-09-16T08:02:55.186317+0000","last_became_active":"2024-09-16T08:02:43.173555+0000","last_became_peered":"2024-09-16T08:02:43.173555+0000","last_unstale":"2024-09-16T08:02:55.186317+0000","last_undegraded":"2024-09-16T08:02:55.186317+0000","last_fullsized":"2024-09-16T08:02:55.186317+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.177133+0000","last_change":"2024-09-16T08:02:26.265190+0000","last_active":"2024-09-16T08:02:55.177133+0000","last_peered":"2024-09-16T08:02:55.177133+0000","last_clean":"2024-09-16T08:02:55.177133+0000","last_became_active":"2024-09-16T08:02:25.283079+0000","last_became_peered":"2024-09-16T08:02:25.283079+0000","last_unstale":"2024-09-16T08:02:55.177133+0000","last_undegraded":"2024-09-16T08:02:55.177133+0000","last_fullsized":"2024-09-16T08:02:55.177133+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.175253+0000","last_change":"2024-09-16T08:02:26.167686+0000","last_active":"2024-09-16T08:02:55.175253+0000","last_peered":"2024-09-16T08:02:55.175253+0000","last_clean":"2024-09-16T08:02:55.175253+0000","last_became_active":"2024-09-16T08:02:25.263809+0000","last_became_peered":"2024-09-16T08:02:25.263809+0000","last_unstale":"2024-09-16T08:02:55.175253+0000","last_undegraded":"2024-09-16T08:02:55.175253+0000","last_fullsized":"2024-09-16T08:02:55.175253+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.175894+0000","last_change":"2024-09-16T08:02:26.264867+0000","last_active":"2024-09-16T08:02:55.175894+0000","last_peered":"2024-09-16T08:02:55.175894+0000","last_clean":"2024-09-16T08:02:55.175894+0000","last_became_active":"2024-09-16T08:02:25.362667+0000","last_became_peered":"2024-09-16T08:02:25.362667+0000","last_unstale":"2024-09-16T08:02:55.175894+0000","last_undegraded":"2024-09-16T08:02:55.175894+0000","last_fullsized":"2024-09-16T08:02:55.175894+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":479,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.186751+0000","last_change":"2024-09-16T08:02:44.148290+0000","last_active":"2024-09-16T08:02:55.186751+0000","last_peered":"2024-09-16T08:02:55.186751+0000","last_clean":"2024-09-16T08:02:55.186751+0000","last_became_active":"2024-09-16T08:02:43.189244+0000","last_became_peered":"2024-09-16T08:02:43.189244+0000","last_unstale":"2024-09-16T08:02:55.186751+0000","last_undegraded":"2024-09-16T08:02:55.186751+0000","last_fullsized":"2024-09-16T08:02:55.186751+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79884,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":78208,"kb_avail":94291956,"statfs":{"total":96636764160,"available":96554962944,"internally_reserved":0,"allocated":1699840,"data_stored":1267472,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":80084992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":153,"seq":657129996443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35600,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":33920,"kb_avail":94336240,"statfs":{"total":96636764160,"available":96600309760,"internally_reserved":0,"allocated":1703936,"data_stored":1267491,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":34734080},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":187,"seq":803158884365,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36116,"kb_used_data":1604,"kb_used_omap":0,"kb_used_meta":34496,"kb_avail":94335724,"statfs":{"total":96636764160,"available":96599781376,"internally_reserved":0,"allocated":1642496,"data_stored":677123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35323904},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":182,"seq":781684047903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40648,"kb_used_data":1656,"kb_used_omap":0,"kb_used_meta":38976,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1695744,"data_stored":1264538,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":39911424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:02:59.548 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T08:02:59.548 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:02:59.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:59.658+0000 7f7c95791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:59.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:59.667+0000 7f7c95791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:59.865 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T08:02:59.866 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T08:02:59.878 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":727,"stamp":"2024-09-16T08:02:58.530355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":192248,"kb_used_data":6584,"kb_used_omap":0,"kb_used_meta":185600,"kb_avail":377295112,"statfs":{"total":386547056640,"available":386350194688,"internally_reserved":0,"allocated":6742016,"data_stored":4476624,"data_compressed":90123,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":190054400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.373799"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":595,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.176532+0000","last_change":"2024-09-16T08:02:25.254110+0000","last_active":"2024-09-16T08:02:55.176532+0000","last_peered":"2024-09-16T08:02:55.176532+0000","last_clean":"2024-09-16T08:02:55.176532+0000","last_became_active":"2024-09-16T08:02:25.237787+0000","last_became_peered":"2024-09-16T08:02:25.237787+0000","last_unstale":"2024-09-16T08:02:55.176532+0000","last_undegraded":"2024-09-16T08:02:55.176532+0000","last_fullsized":"2024-09-16T08:02:55.176532+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":365,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.184254+0000","last_change":"2024-09-16T08:02:48.132432+0000","last_active":"2024-09-16T08:02:55.184254+0000","last_peered":"2024-09-16T08:02:55.184254+0000","last_clean":"2024-09-16T08:02:55.184254+0000","last_became_active":"2024-09-16T08:02:44.162399+0000","last_became_peered":"2024-09-16T08:02:44.162399+0000","last_unstale":"2024-09-16T08:02:55.184254+0000","last_undegraded":"2024-09-16T08:02:55.184254+0000","last_fullsized":"2024-09-16T08:02:55.184254+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":298,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.181679+0000","last_change":"2024-09-16T08:02:44.133612+0000","last_active":"2024-09-16T08:02:55.181679+0000","last_peered":"2024-09-16T08:02:55.181679+0000","last_clean":"2024-09-16T08:02:55.181679+0000","last_became_active":"2024-09-16T08:02:43.166912+0000","last_became_peered":"2024-09-16T08:02:43.166912+0000","last_unstale":"2024-09-16T08:02:55.181679+0000","last_undegraded":"2024-09-16T08:02:55.181679+0000","last_fullsized":"2024-09-16T08:02:55.181679+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":344,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.185147+0000","last_change":"2024-09-16T08:02:44.147862+0000","last_active":"2024-09-16T08:02:55.185147+0000","last_peered":"2024-09-16T08:02:55.185147+0000","last_clean":"2024-09-16T08:02:55.185147+0000","last_became_active":"2024-09-16T08:02:43.181556+0000","last_became_peered":"2024-09-16T08:02:43.181556+0000","last_unstale":"2024-09-16T08:02:55.185147+0000","last_undegraded":"2024-09-16T08:02:55.185147+0000","last_fullsized":"2024-09-16T08:02:55.185147+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":306,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.186317+0000","last_change":"2024-09-16T08:02:44.139535+0000","last_active":"2024-09-16T08:02:55.186317+0000","last_peered":"2024-09-16T08:02:55.186317+0000","last_clean":"2024-09-16T08:02:55.186317+0000","last_became_active":"2024-09-16T08:02:43.173555+0000","last_became_peered":"2024-09-16T08:02:43.173555+0000","last_unstale":"2024-09-16T08:02:55.186317+0000","last_undegraded":"2024-09-16T08:02:55.186317+0000","last_fullsized":"2024-09-16T08:02:55.186317+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.177133+0000","last_change":"2024-09-16T08:02:26.265190+0000","last_active":"2024-09-16T08:02:55.177133+0000","last_peered":"2024-09-16T08:02:55.177133+0000","last_clean":"2024-09-16T08:02:55.177133+0000","last_became_active":"2024-09-16T08:02:25.283079+0000","last_became_peered":"2024-09-16T08:02:25.283079+0000","last_unstale":"2024-09-16T08:02:55.177133+0000","last_undegraded":"2024-09-16T08:02:55.177133+0000","last_fullsized":"2024-09-16T08:02:55.177133+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.175253+0000","last_change":"2024-09-16T08:02:26.167686+0000","last_active":"2024-09-16T08:02:55.175253+0000","last_peered":"2024-09-16T08:02:55.175253+0000","last_clean":"2024-09-16T08:02:55.175253+0000","last_became_active":"2024-09-16T08:02:25.263809+0000","last_became_peered":"2024-09-16T08:02:25.263809+0000","last_unstale":"2024-09-16T08:02:55.175253+0000","last_undegraded":"2024-09-16T08:02:55.175253+0000","last_fullsized":"2024-09-16T08:02:55.175253+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.175894+0000","last_change":"2024-09-16T08:02:26.264867+0000","last_active":"2024-09-16T08:02:55.175894+0000","last_peered":"2024-09-16T08:02:55.175894+0000","last_clean":"2024-09-16T08:02:55.175894+0000","last_became_active":"2024-09-16T08:02:25.362667+0000","last_became_peered":"2024-09-16T08:02:25.362667+0000","last_unstale":"2024-09-16T08:02:55.175894+0000","last_undegraded":"2024-09-16T08:02:55.175894+0000","last_fullsized":"2024-09-16T08:02:55.175894+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":479,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.186751+0000","last_change":"2024-09-16T08:02:44.148290+0000","last_active":"2024-09-16T08:02:55.186751+0000","last_peered":"2024-09-16T08:02:55.186751+0000","last_clean":"2024-09-16T08:02:55.186751+0000","last_became_active":"2024-09-16T08:02:43.189244+0000","last_became_peered":"2024-09-16T08:02:43.189244+0000","last_unstale":"2024-09-16T08:02:55.186751+0000","last_undegraded":"2024-09-16T08:02:55.186751+0000","last_fullsized":"2024-09-16T08:02:55.186751+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79884,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":78208,"kb_avail":94291956,"statfs":{"total":96636764160,"available":96554962944,"internally_reserved":0,"allocated":1699840,"data_stored":1267472,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":80084992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":153,"seq":657129996443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35600,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":33920,"kb_avail":94336240,"statfs":{"total":96636764160,"available":96600309760,"internally_reserved":0,"allocated":1703936,"data_stored":1267491,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":34734080},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":187,"seq":803158884365,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36116,"kb_used_data":1604,"kb_used_omap":0,"kb_used_meta":34496,"kb_avail":94335724,"statfs":{"total":96636764160,"available":96599781376,"internally_reserved":0,"allocated":1642496,"data_stored":677123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35323904},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":182,"seq":781684047903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40648,"kb_used_data":1656,"kb_used_omap":0,"kb_used_meta":38976,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1695744,"data_stored":1264538,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":39911424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:02:59.879 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T08:02:59.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:59.990+0000 7ffb82791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:02:59.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:02:59.998+0000 7ffb82791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:00.197 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T08:03:00.198 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":198,"fsid":"a7173a3e-ffed-4f8e-a112-99abc87b4a6b","created":"2024-09-16T07:44:57.934858+0000","modified":"2024-09-16T08:02:58.105480+0000","last_up_change":"2024-09-16T08:02:42.106079+0000","last_in_change":"2024-09-16T07:45:00.057112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:45:06.304380+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:45:08.254361+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92b524c0-1e32-4c56-a983-7be51186e765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":176,"last_clean_end":178,"up_from":182,"up_thru":187,"down_at":181,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6805","nonce":2767087644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2767087644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6801","nonce":2767087644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2767087644}]},"public_addr":"172.21.15.3:6805/2767087644","cluster_addr":"172.21.15.3:6806/2767087644","heartbeat_back_addr":"172.21.15.3:6801/2767087644","heartbeat_front_addr":"172.21.15.3:6802/2767087644","state":["exists","up"]},{"osd":1,"uuid":"51e5f821-e631-4cc1-8a37-d7b188901edf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":147,"last_clean_end":174,"up_from":187,"up_thru":188,"down_at":179,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":924983034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6821","nonce":924983034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":924983034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6803","nonce":924983034}]},"public_addr":"172.21.15.3:6822/924983034","cluster_addr":"172.21.15.3:6821/924983034","heartbeat_back_addr":"172.21.15.3:6804/924983034","heartbeat_front_addr":"172.21.15.3:6803/924983034","state":["exists","up"]},{"osd":2,"uuid":"0a8a850b-ad4a-4499-945d-1c2672d0a2cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":107,"last_clean_end":142,"up_from":153,"up_thru":183,"down_at":145,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6803","nonce":3431415356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3431415356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3431415356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6809","nonce":3431415356}]},"public_addr":"172.21.15.134:6803/3431415356","cluster_addr":"172.21.15.134:6802/3431415356","heartbeat_back_addr":"172.21.15.134:6808/3431415356","heartbeat_front_addr":"172.21.15.134:6809/3431415356","state":["exists","up"]},{"osd":3,"uuid":"d8f5c79f-4068-4ef9-a125-508f70e18ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":55,"last_clean_end":86,"up_from":88,"up_thru":187,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2558216642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6805","nonce":2558216642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6807","nonce":2558216642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2558216642}]},"public_addr":"172.21.15.134:6804/2558216642","cluster_addr":"172.21.15.134:6805/2558216642","heartbeat_back_addr":"172.21.15.134:6807/2558216642","heartbeat_front_addr":"172.21.15.134:6806/2558216642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2024-09-16T08:02:23.121604+0000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"2024-09-16T08:02:14.106088+0000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2024-09-16T07:59:56.096963+0000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2024-09-16T07:54:02.037877+0000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.3","mappings":[{"from":0,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T08:03:01.213 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T08:03:01.213 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T08:03:01.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:01.336+0000 7f3624391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:01.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:01.350+0000 7f3624391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:01.366 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T08:03:01.366 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "" 2024-09-16T08:03:01.366 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T08:03:01.378 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T08:03:01.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:01.487+0000 7fc4ffed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:01.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:01.498+0000 7fc4ffed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:01.693 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T08:03:01.713 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T08:03:01.713 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T08:03:01.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:01.823+0000 7f99a2311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:01.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:01.836+0000 7f99a2311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:01.850 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T08:03:01.851 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "" 2024-09-16T08:03:01.851 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T08:03:01.862 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T08:03:01.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:01.972+0000 7fce03591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:01.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:01.982+0000 7fce03591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:02.181 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T08:03:02.198 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T08:03:02.198 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T08:03:02.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:02.311+0000 7fe119857640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:02.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:02.325+0000 7fe119857640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:02.342 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T08:03:02.342 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "" 2024-09-16T08:03:02.342 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T08:03:02.354 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T08:03:02.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:02.463+0000 7f07ce063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:02.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:02.473+0000 7f07ce063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:02.673 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T08:03:02.689 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T08:03:02.689 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T08:03:02.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:02.798+0000 7ff07ba46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:02.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:02.811+0000 7ff07ba46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:02.830 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-16T08:03:02.830 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "" 2024-09-16T08:03:02.830 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-16T08:03:02.840 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T08:03:02.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:02.950+0000 7fbcd5e5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:02.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:02.960+0000 7fbcd5e5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:03.158 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T08:03:03.176 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:03:03.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:03.285+0000 7fe3a607d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:03.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:03.294+0000 7fe3a607d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:03.489 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T08:03:03.489 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T08:03:03.503 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":729,"stamp":"2024-09-16T08:03:02.531462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":192248,"kb_used_data":6584,"kb_used_omap":0,"kb_used_meta":185600,"kb_avail":377295112,"statfs":{"total":386547056640,"available":386350194688,"internally_reserved":0,"allocated":6742016,"data_stored":4476624,"data_compressed":90123,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":190054400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-1,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002240"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":595,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.176532+0000","last_change":"2024-09-16T08:02:25.254110+0000","last_active":"2024-09-16T08:02:55.176532+0000","last_peered":"2024-09-16T08:02:55.176532+0000","last_clean":"2024-09-16T08:02:55.176532+0000","last_became_active":"2024-09-16T08:02:25.237787+0000","last_became_peered":"2024-09-16T08:02:25.237787+0000","last_unstale":"2024-09-16T08:02:55.176532+0000","last_undegraded":"2024-09-16T08:02:55.176532+0000","last_fullsized":"2024-09-16T08:02:55.176532+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":365,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.184254+0000","last_change":"2024-09-16T08:02:48.132432+0000","last_active":"2024-09-16T08:02:55.184254+0000","last_peered":"2024-09-16T08:02:55.184254+0000","last_clean":"2024-09-16T08:02:55.184254+0000","last_became_active":"2024-09-16T08:02:44.162399+0000","last_became_peered":"2024-09-16T08:02:44.162399+0000","last_unstale":"2024-09-16T08:02:55.184254+0000","last_undegraded":"2024-09-16T08:02:55.184254+0000","last_fullsized":"2024-09-16T08:02:55.184254+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":298,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.181679+0000","last_change":"2024-09-16T08:02:44.133612+0000","last_active":"2024-09-16T08:02:55.181679+0000","last_peered":"2024-09-16T08:02:55.181679+0000","last_clean":"2024-09-16T08:02:55.181679+0000","last_became_active":"2024-09-16T08:02:43.166912+0000","last_became_peered":"2024-09-16T08:02:43.166912+0000","last_unstale":"2024-09-16T08:02:55.181679+0000","last_undegraded":"2024-09-16T08:02:55.181679+0000","last_fullsized":"2024-09-16T08:02:55.181679+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":344,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.185147+0000","last_change":"2024-09-16T08:02:44.147862+0000","last_active":"2024-09-16T08:02:55.185147+0000","last_peered":"2024-09-16T08:02:55.185147+0000","last_clean":"2024-09-16T08:02:55.185147+0000","last_became_active":"2024-09-16T08:02:43.181556+0000","last_became_peered":"2024-09-16T08:02:43.181556+0000","last_unstale":"2024-09-16T08:02:55.185147+0000","last_undegraded":"2024-09-16T08:02:55.185147+0000","last_fullsized":"2024-09-16T08:02:55.185147+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":306,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.186317+0000","last_change":"2024-09-16T08:02:44.139535+0000","last_active":"2024-09-16T08:02:55.186317+0000","last_peered":"2024-09-16T08:02:55.186317+0000","last_clean":"2024-09-16T08:02:55.186317+0000","last_became_active":"2024-09-16T08:02:43.173555+0000","last_became_peered":"2024-09-16T08:02:43.173555+0000","last_unstale":"2024-09-16T08:02:55.186317+0000","last_undegraded":"2024-09-16T08:02:55.186317+0000","last_fullsized":"2024-09-16T08:02:55.186317+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.177133+0000","last_change":"2024-09-16T08:02:26.265190+0000","last_active":"2024-09-16T08:02:55.177133+0000","last_peered":"2024-09-16T08:02:55.177133+0000","last_clean":"2024-09-16T08:02:55.177133+0000","last_became_active":"2024-09-16T08:02:25.283079+0000","last_became_peered":"2024-09-16T08:02:25.283079+0000","last_unstale":"2024-09-16T08:02:55.177133+0000","last_undegraded":"2024-09-16T08:02:55.177133+0000","last_fullsized":"2024-09-16T08:02:55.177133+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.175253+0000","last_change":"2024-09-16T08:02:26.167686+0000","last_active":"2024-09-16T08:02:55.175253+0000","last_peered":"2024-09-16T08:02:55.175253+0000","last_clean":"2024-09-16T08:02:55.175253+0000","last_became_active":"2024-09-16T08:02:25.263809+0000","last_became_peered":"2024-09-16T08:02:25.263809+0000","last_unstale":"2024-09-16T08:02:55.175253+0000","last_undegraded":"2024-09-16T08:02:55.175253+0000","last_fullsized":"2024-09-16T08:02:55.175253+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.175894+0000","last_change":"2024-09-16T08:02:26.264867+0000","last_active":"2024-09-16T08:02:55.175894+0000","last_peered":"2024-09-16T08:02:55.175894+0000","last_clean":"2024-09-16T08:02:55.175894+0000","last_became_active":"2024-09-16T08:02:25.362667+0000","last_became_peered":"2024-09-16T08:02:25.362667+0000","last_unstale":"2024-09-16T08:02:55.175894+0000","last_undegraded":"2024-09-16T08:02:55.175894+0000","last_fullsized":"2024-09-16T08:02:55.175894+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":479,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.186751+0000","last_change":"2024-09-16T08:02:44.148290+0000","last_active":"2024-09-16T08:02:55.186751+0000","last_peered":"2024-09-16T08:02:55.186751+0000","last_clean":"2024-09-16T08:02:55.186751+0000","last_became_active":"2024-09-16T08:02:43.189244+0000","last_became_peered":"2024-09-16T08:02:43.189244+0000","last_unstale":"2024-09-16T08:02:55.186751+0000","last_undegraded":"2024-09-16T08:02:55.186751+0000","last_fullsized":"2024-09-16T08:02:55.186751+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79884,"kb_used_data":1660,"kb_used_omap":0,"kb_used_meta":78208,"kb_avail":94291956,"statfs":{"total":96636764160,"available":96554962944,"internally_reserved":0,"allocated":1699840,"data_stored":1267472,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":80084992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":153,"seq":657129996443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35600,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":33920,"kb_avail":94336240,"statfs":{"total":96636764160,"available":96600309760,"internally_reserved":0,"allocated":1703936,"data_stored":1267491,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":34734080},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":187,"seq":803158884365,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36116,"kb_used_data":1604,"kb_used_omap":0,"kb_used_meta":34496,"kb_avail":94335724,"statfs":{"total":96636764160,"available":96599781376,"internally_reserved":0,"allocated":1642496,"data_stored":677123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35323904},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":182,"seq":781684047903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40648,"kb_used_data":1656,"kb_used_omap":0,"kb_used_meta":38976,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1695744,"data_stored":1264538,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":39911424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:03:03.510 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T07:45:06.354656+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=45, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=3, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:03:03.511 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T07:45:08.356929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=45, tm_sec=8, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=3, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:03:03.511 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T07:45:08.356929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=45, tm_sec=8, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=3, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:03:03.511 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T07:45:08.356929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=45, tm_sec=8, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=3, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:03:03.512 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T07:45:08.356929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=45, tm_sec=8, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=3, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:03:03.512 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T07:45:08.356929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=45, tm_sec=8, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=3, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:03:03.512 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T07:45:08.356929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=45, tm_sec=8, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=3, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:03:03.512 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T07:45:08.356929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=45, tm_sec=8, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=3, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:03:03.513 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T07:45:08.356929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=45, tm_sec=8, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=3, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:03:03.513 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T08:03:23.514 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:03:23.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:23.641+0000 7f0e7c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:23.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:23.650+0000 7f0e7c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:23.847 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T08:03:23.847 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T08:03:23.860 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":739,"stamp":"2024-09-16T08:03:22.536412+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":1,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":192272,"kb_used_data":6608,"kb_used_omap":0,"kb_used_meta":185600,"kb_avail":377295088,"statfs":{"total":386547056640,"available":386350170112,"internally_reserved":0,"allocated":6766592,"data_stored":4485459,"data_compressed":90123,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":190054400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":1,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003132"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":599,"reported_epoch":198,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T08:02:58.119272+0000","last_change":"2024-09-16T08:03:03.162426+0000","last_active":"2024-09-16T08:02:58.119272+0000","last_peered":"2024-09-16T08:02:58.119272+0000","last_clean":"2024-09-16T08:02:58.119272+0000","last_became_active":"2024-09-16T08:02:25.237787+0000","last_became_peered":"2024-09-16T08:02:25.237787+0000","last_unstale":"2024-09-16T08:02:58.119272+0000","last_undegraded":"2024-09-16T08:02:58.119272+0000","last_fullsized":"2024-09-16T08:02:58.119272+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:06.354656+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":370,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:02.186245+0000","last_change":"2024-09-16T08:03:02.232109+0000","last_active":"2024-09-16T08:03:02.186245+0000","last_peered":"2024-09-16T08:03:02.186245+0000","last_clean":"2024-09-16T08:03:02.186245+0000","last_became_active":"2024-09-16T08:02:44.162399+0000","last_became_peered":"2024-09-16T08:02:44.162399+0000","last_unstale":"2024-09-16T08:03:02.186245+0000","last_undegraded":"2024-09-16T08:03:02.186245+0000","last_fullsized":"2024-09-16T08:03:02.186245+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-16T08:03:02.231904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:02.231904+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":1,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":298,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.181679+0000","last_change":"2024-09-16T08:02:44.133612+0000","last_active":"2024-09-16T08:02:55.181679+0000","last_peered":"2024-09-16T08:02:55.181679+0000","last_clean":"2024-09-16T08:02:55.181679+0000","last_became_active":"2024-09-16T08:02:43.166912+0000","last_became_peered":"2024-09-16T08:02:43.166912+0000","last_unstale":"2024-09-16T08:02:55.181679+0000","last_undegraded":"2024-09-16T08:02:55.181679+0000","last_fullsized":"2024-09-16T08:02:55.181679+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":349,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:02.184856+0000","last_change":"2024-09-16T08:03:02.198611+0000","last_active":"2024-09-16T08:03:02.184856+0000","last_peered":"2024-09-16T08:03:02.184856+0000","last_clean":"2024-09-16T08:03:02.184856+0000","last_became_active":"2024-09-16T08:02:43.181556+0000","last_became_peered":"2024-09-16T08:02:43.181556+0000","last_unstale":"2024-09-16T08:03:02.184856+0000","last_undegraded":"2024-09-16T08:03:02.184856+0000","last_fullsized":"2024-09-16T08:03:02.184856+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:03:02.198390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:02.198390+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":306,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-16T08:02:55.186317+0000","last_change":"2024-09-16T08:02:44.139535+0000","last_active":"2024-09-16T08:02:55.186317+0000","last_peered":"2024-09-16T08:02:55.186317+0000","last_clean":"2024-09-16T08:02:55.186317+0000","last_became_active":"2024-09-16T08:02:43.173555+0000","last_became_peered":"2024-09-16T08:02:43.173555+0000","last_unstale":"2024-09-16T08:02:55.186317+0000","last_undegraded":"2024-09-16T08:02:55.186317+0000","last_fullsized":"2024-09-16T08:02:55.186317+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:08.356929+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":538,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:02.677179+0000","last_change":"2024-09-16T08:03:02.692963+0000","last_active":"2024-09-16T08:03:02.677179+0000","last_peered":"2024-09-16T08:03:02.677179+0000","last_clean":"2024-09-16T08:03:02.677179+0000","last_became_active":"2024-09-16T08:02:25.283079+0000","last_became_peered":"2024-09-16T08:02:25.283079+0000","last_unstale":"2024-09-16T08:03:02.677179+0000","last_undegraded":"2024-09-16T08:03:02.677179+0000","last_fullsized":"2024-09-16T08:03:02.677179+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:03:02.692769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:02.692769+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":541,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:03.163502+0000","last_change":"2024-09-16T08:03:03.175837+0000","last_active":"2024-09-16T08:03:03.163502+0000","last_peered":"2024-09-16T08:03:03.163502+0000","last_clean":"2024-09-16T08:03:03.163502+0000","last_became_active":"2024-09-16T08:02:25.263809+0000","last_became_peered":"2024-09-16T08:02:25.263809+0000","last_unstale":"2024-09-16T08:03:03.163502+0000","last_undegraded":"2024-09-16T08:03:03.163502+0000","last_fullsized":"2024-09-16T08:03:03.163502+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:03:03.175618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:03.175618+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:02.678434+0000","last_change":"2024-09-16T08:03:02.691747+0000","last_active":"2024-09-16T08:03:02.678434+0000","last_peered":"2024-09-16T08:03:02.678434+0000","last_clean":"2024-09-16T08:03:02.678434+0000","last_became_active":"2024-09-16T08:02:25.362667+0000","last_became_peered":"2024-09-16T08:02:25.362667+0000","last_unstale":"2024-09-16T08:03:02.678434+0000","last_undegraded":"2024-09-16T08:03:02.678434+0000","last_fullsized":"2024-09-16T08:03:02.678434+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:03:02.691528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:02.691528+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":484,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:02.187572+0000","last_change":"2024-09-16T08:03:02.218651+0000","last_active":"2024-09-16T08:03:02.187572+0000","last_peered":"2024-09-16T08:03:02.187572+0000","last_clean":"2024-09-16T08:03:02.187572+0000","last_became_active":"2024-09-16T08:02:43.189244+0000","last_became_peered":"2024-09-16T08:02:43.189244+0000","last_unstale":"2024-09-16T08:03:02.187572+0000","last_undegraded":"2024-09-16T08:03:02.187572+0000","last_fullsized":"2024-09-16T08:03:02.187572+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:03:02.218469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:02.218469+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":1,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122587,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79892,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":78208,"kb_avail":94291948,"statfs":{"total":96636764160,"available":96554954752,"internally_reserved":0,"allocated":1708032,"data_stored":1270417,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":80084992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":153,"seq":657129996468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35608,"kb_used_data":1672,"kb_used_omap":0,"kb_used_meta":33920,"kb_avail":94336232,"statfs":{"total":96636764160,"available":96600301568,"internally_reserved":0,"allocated":1712128,"data_stored":1270436,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":34734080},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":187,"seq":803158884382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36124,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":34496,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":1650688,"data_stored":680068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35323904},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":182,"seq":781684047903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40648,"kb_used_data":1656,"kb_used_omap":0,"kb_used_meta":38976,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1695744,"data_stored":1264538,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":39911424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:03:23.861 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T07:45:06.354656+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=45, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=3, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:03:23.861 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T07:45:08.356929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=45, tm_sec=8, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=3, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:03:23.862 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T07:45:08.356929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=45, tm_sec=8, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=8, tm_min=3, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T08:03:23.862 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T08:03:43.863 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T08:03:43.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:43.990+0000 7fd955111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:43.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:43.998+0000 7fd955111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:44.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-16T08:03:44.195 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-16T08:03:44.208 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":749,"stamp":"2024-09-16T08:03:42.541185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590376,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":80,"num_write_kb":1107,"num_scrub_errors":0,"num_shallow_scrub_errors":2,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":192288,"kb_used_data":6624,"kb_used_omap":0,"kb_used_meta":185600,"kb_avail":377295072,"statfs":{"total":386547056640,"available":386350153728,"internally_reserved":0,"allocated":6782976,"data_stored":4491357,"data_compressed":90123,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":190054400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002874"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":600,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:03.162426+0000","last_change":"2024-09-16T08:03:03.187209+0000","last_active":"2024-09-16T08:03:03.162426+0000","last_peered":"2024-09-16T08:03:03.162426+0000","last_clean":"2024-09-16T08:03:03.162426+0000","last_became_active":"2024-09-16T08:02:25.237787+0000","last_became_peered":"2024-09-16T08:02:25.237787+0000","last_unstale":"2024-09-16T08:03:03.162426+0000","last_undegraded":"2024-09-16T08:03:03.162426+0000","last_fullsized":"2024-09-16T08:03:03.162426+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"11'52","last_scrub_stamp":"2024-09-16T08:03:03.186924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:03.186924+0000","last_clean_scrub_stamp":"2024-09-16T07:45:06.354656+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":370,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:02.186245+0000","last_change":"2024-09-16T08:03:02.232109+0000","last_active":"2024-09-16T08:03:02.186245+0000","last_peered":"2024-09-16T08:03:02.186245+0000","last_clean":"2024-09-16T08:03:02.186245+0000","last_became_active":"2024-09-16T08:02:44.162399+0000","last_became_peered":"2024-09-16T08:02:44.162399+0000","last_unstale":"2024-09-16T08:03:02.186245+0000","last_undegraded":"2024-09-16T08:03:02.186245+0000","last_fullsized":"2024-09-16T08:03:02.186245+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-16T08:03:02.231904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:02.231904+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":1,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":303,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:01.696541+0000","last_change":"2024-09-16T08:03:01.706532+0000","last_active":"2024-09-16T08:03:01.696541+0000","last_peered":"2024-09-16T08:03:01.696541+0000","last_clean":"2024-09-16T08:03:01.696541+0000","last_became_active":"2024-09-16T08:02:43.166912+0000","last_became_peered":"2024-09-16T08:02:43.166912+0000","last_unstale":"2024-09-16T08:03:01.696541+0000","last_undegraded":"2024-09-16T08:03:01.696541+0000","last_fullsized":"2024-09-16T08:03:01.696541+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:03:01.706352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:01.706352+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":349,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:02.184856+0000","last_change":"2024-09-16T08:03:02.198611+0000","last_active":"2024-09-16T08:03:02.184856+0000","last_peered":"2024-09-16T08:03:02.184856+0000","last_clean":"2024-09-16T08:03:02.184856+0000","last_became_active":"2024-09-16T08:02:43.181556+0000","last_became_peered":"2024-09-16T08:02:43.181556+0000","last_unstale":"2024-09-16T08:03:02.184856+0000","last_undegraded":"2024-09-16T08:03:02.184856+0000","last_fullsized":"2024-09-16T08:03:02.184856+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:03:02.198390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:02.198390+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":311,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:01.697676+0000","last_change":"2024-09-16T08:03:01.709942+0000","last_active":"2024-09-16T08:03:01.697676+0000","last_peered":"2024-09-16T08:03:01.697676+0000","last_clean":"2024-09-16T08:03:01.697676+0000","last_became_active":"2024-09-16T08:02:43.173555+0000","last_became_peered":"2024-09-16T08:02:43.173555+0000","last_unstale":"2024-09-16T08:03:01.697676+0000","last_undegraded":"2024-09-16T08:03:01.697676+0000","last_fullsized":"2024-09-16T08:03:01.697676+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-16T08:03:01.709731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:01.709731+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":1,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":538,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:02.677179+0000","last_change":"2024-09-16T08:03:02.692963+0000","last_active":"2024-09-16T08:03:02.677179+0000","last_peered":"2024-09-16T08:03:02.677179+0000","last_clean":"2024-09-16T08:03:02.677179+0000","last_became_active":"2024-09-16T08:02:25.283079+0000","last_became_peered":"2024-09-16T08:02:25.283079+0000","last_unstale":"2024-09-16T08:03:02.677179+0000","last_undegraded":"2024-09-16T08:03:02.677179+0000","last_fullsized":"2024-09-16T08:03:02.677179+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:03:02.692769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:02.692769+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":541,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:03.163502+0000","last_change":"2024-09-16T08:03:03.175837+0000","last_active":"2024-09-16T08:03:03.163502+0000","last_peered":"2024-09-16T08:03:03.163502+0000","last_clean":"2024-09-16T08:03:03.163502+0000","last_became_active":"2024-09-16T08:02:25.263809+0000","last_became_peered":"2024-09-16T08:02:25.263809+0000","last_unstale":"2024-09-16T08:03:03.163502+0000","last_undegraded":"2024-09-16T08:03:03.163502+0000","last_fullsized":"2024-09-16T08:03:03.163502+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:03:03.175618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:03.175618+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":538,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:02.678434+0000","last_change":"2024-09-16T08:03:02.691747+0000","last_active":"2024-09-16T08:03:02.678434+0000","last_peered":"2024-09-16T08:03:02.678434+0000","last_clean":"2024-09-16T08:03:02.678434+0000","last_became_active":"2024-09-16T08:02:25.362667+0000","last_became_peered":"2024-09-16T08:02:25.362667+0000","last_unstale":"2024-09-16T08:03:02.678434+0000","last_undegraded":"2024-09-16T08:03:02.678434+0000","last_fullsized":"2024-09-16T08:03:02.678434+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:03:02.691528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:02.691528+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":484,"reported_epoch":198,"state":"active+clean","last_fresh":"2024-09-16T08:03:02.187572+0000","last_change":"2024-09-16T08:03:02.218651+0000","last_active":"2024-09-16T08:03:02.187572+0000","last_peered":"2024-09-16T08:03:02.187572+0000","last_clean":"2024-09-16T08:03:02.187572+0000","last_became_active":"2024-09-16T08:02:43.189244+0000","last_became_peered":"2024-09-16T08:02:43.189244+0000","last_unstale":"2024-09-16T08:03:02.187572+0000","last_undegraded":"2024-09-16T08:03:02.187572+0000","last_fullsized":"2024-09-16T08:03:02.187572+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T08:03:02.218469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T08:03:02.218469+0000","last_clean_scrub_stamp":"2024-09-16T07:45:08.356929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":2,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":88,"seq":377957122617,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79892,"kb_used_data":1668,"kb_used_omap":0,"kb_used_meta":78208,"kb_avail":94291948,"statfs":{"total":96636764160,"available":96554954752,"internally_reserved":0,"allocated":1708032,"data_stored":1270417,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":80084992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":153,"seq":657129996468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35608,"kb_used_data":1672,"kb_used_omap":0,"kb_used_meta":33920,"kb_avail":94336232,"statfs":{"total":96636764160,"available":96600301568,"internally_reserved":0,"allocated":1712128,"data_stored":1270436,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":34734080},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":187,"seq":803158884382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36124,"kb_used_data":1612,"kb_used_omap":0,"kb_used_meta":34496,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":1650688,"data_stored":680068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35323904},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":182,"seq":781684047931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40664,"kb_used_data":1672,"kb_used_omap":0,"kb_used_meta":38976,"kb_avail":94331176,"statfs":{"total":96636764160,"available":96595124224,"internally_reserved":0,"allocated":1712128,"data_stored":1270436,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":39911424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30041,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T08:03:44.210 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T08:03:44.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:44.317+0000 7f78fbb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-16T08:03:44.329+0000 7f78fbb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T08:03:44.548 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T08:03:44.548 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T08:03:44.548 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T08:03:44.548 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:03:44.630 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T08:03:44.631 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T08:03:44.631 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:03:44.715 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T08:03:44.715 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T08:03:44.716 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:03:47.548 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-16T08:03:50.817 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T08:03:50.818 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T08:03:50.818 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:03:50.919 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T08:03:50.919 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T08:03:50.919 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T08:03:50.919 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:03:50.949 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T08:03:50.950 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T08:03:50.950 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T08:03:50.950 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T08:03:50.966 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T08:03:50.967 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T08:03:50.967 DEBUG:teuthology.orchestra.run.smithi003:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-09-16T08:03:51.049 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi003.front.sepia.ceph.com 2024-09-16T08:03:51.049 DEBUG:teuthology.orchestra.run.smithi003:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T08:03:51.231 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi003.front.sepia.ceph.com 2024-09-16T08:03:51.231 DEBUG:teuthology.orchestra.run.smithi003:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T08:03:51.306 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T08:03:51.306 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T08:03:51.419 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T08:03:51.420 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T08:03:51.508 INFO:tasks.ceph:Archiving mon data... 2024-09-16T08:03:51.509 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906875/data/mon.a.tgz 2024-09-16T08:03:51.509 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2024-09-16T08:03:51.527 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.bCXs2F1A84 2024-09-16T08:03:51.528 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.bCXs2F1A84 2024-09-16T08:03:51.704 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.bCXs2F1A84 2024-09-16T08:03:51.791 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.bCXs2F1A84 is 302KB 2024-09-16T08:03:51.887 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.bCXs2F1A84 2024-09-16T08:03:51.903 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T08:03:51.903 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T08:03:51.945 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T08:03:52.024 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T08:03:52.042 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T08:03:52.043 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T08:03:52.045 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906875/remote/smithi003/crash 2024-09-16T08:03:52.046 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T08:03:52.092 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906875/remote/smithi134/crash 2024-09-16T08:03:52.093 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T08:03:52.134 INFO:tasks.ceph:Compressing logs... 2024-09-16T08:03:52.134 DEBUG:teuthology.orchestra.run.smithi003:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T08:03:52.137 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T08:03:52.161 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T08:03:52.161 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31300.log 2024-09-16T08:03:52.161 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51660.log 2024-09-16T08:03:52.161 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49472.log 2024-09-16T08:03:52.161 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31300.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31300.log.gz 2024-09-16T08:03:52.161 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51660.log: gzip 49.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.51660.log.gz --verbose 2024-09-16T08:03:52.161 INFO:teuthology.orchestra.run.smithi003.stderr: -- /var/log/ceph/ceph-client.admin.56295.log 2024-09-16T08:03:52.161 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44175.log 2024-09-16T08:03:52.217 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28357.log 2024-09-16T08:03:52.217 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28397.log 2024-09-16T08:03:52.217 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T08:03:52.217 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28357.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.28357.log.gz 2024-09-16T08:03:52.217 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28397.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T08:03:52.217 INFO:teuthology.orchestra.run.smithi134.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28397.log.gz 2024-09-16T08:03:52.218 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28317.log 2024-09-16T08:03:52.218 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28268.log 2024-09-16T08:03:52.218 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28317.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-16T08:03:52.218 INFO:teuthology.orchestra.run.smithi134.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28317.log.gz 2024-09-16T08:03:52.218 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.28268.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28268.log.gz 2024-09-16T08:03:52.316 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.3.log: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T08:03:52.441 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49472.log: /var/log/ceph/ceph-client.admin.56295.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.49472.log.gz 2024-09-16T08:03:52.441 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56376.log 2024-09-16T08:03:52.441 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56295.log.gz 2024-09-16T08:03:52.442 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58717.log 2024-09-16T08:03:52.442 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44175.log.gz 2024-09-16T08:03:52.442 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.56376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36678.log 2024-09-16T08:03:52.442 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56376.log.gz 2024-09-16T08:03:52.442 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54411.log 2024-09-16T08:03:52.442 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58717.log.gz 2024-09-16T08:03:52.442 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29596.log 2024-09-16T08:03:52.442 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36678.log.gz 2024-09-16T08:03:52.442 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40946.log 2024-09-16T08:03:52.442 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54411.log.gz 2024-09-16T08:03:52.442 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46660.log 2024-09-16T08:03:52.443 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29596.log.gz 2024-09-16T08:03:52.443 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34908.log 2024-09-16T08:03:52.443 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40946.log.gz 2024-09-16T08:03:52.443 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55493.log 2024-09-16T08:03:52.443 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46660.log.gz 2024-09-16T08:03:52.443 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45127.log 2024-09-16T08:03:52.443 INFO:teuthology.orchestra.run.smithi003.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34908.log.gz 2024-09-16T08:03:52.443 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43650.log 2024-09-16T08:03:52.443 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.55493.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55493.log.gz 2024-09-16T08:03:52.443 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57853.log 2024-09-16T08:03:52.443 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45127.log.gz 2024-09-16T08:03:52.443 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50355.log 2024-09-16T08:03:52.443 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43650.log.gz 2024-09-16T08:03:52.443 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56255.log 2024-09-16T08:03:52.444 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57853.log.gz 2024-09-16T08:03:52.444 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42245.log 2024-09-16T08:03:52.444 INFO:teuthology.orchestra.run.smithi003.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.50355.log.gz 2024-09-16T08:03:52.444 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.56255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40758.log 2024-09-16T08:03:52.444 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56255.log.gz 2024-09-16T08:03:52.444 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48762.log 2024-09-16T08:03:52.444 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42245.log.gz 2024-09-16T08:03:52.444 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29512.log 2024-09-16T08:03:52.444 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40758.log.gz 2024-09-16T08:03:52.444 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32898.log 2024-09-16T08:03:52.444 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48762.log.gz 2024-09-16T08:03:52.444 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28596.log 2024-09-16T08:03:52.445 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29512.log.gz 2024-09-16T08:03:52.445 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32036.log 2024-09-16T08:03:52.445 INFO:teuthology.orchestra.run.smithi003.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.32898.log.gz 2024-09-16T08:03:52.445 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.28596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35398.log 2024-09-16T08:03:52.445 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28596.log.gz 2024-09-16T08:03:52.445 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39777.log 2024-09-16T08:03:52.445 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32036.log.gz 2024-09-16T08:03:52.445 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36188.log 2024-09-16T08:03:52.445 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35398.log.gz 2024-09-16T08:03:52.445 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31231.log 2024-09-16T08:03:52.445 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39777.log.gz 2024-09-16T08:03:52.445 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54889.log 2024-09-16T08:03:52.445 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36188.log.gz 2024-09-16T08:03:52.446 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55719.log 2024-09-16T08:03:52.446 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31231.log.gz 2024-09-16T08:03:52.446 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40036.log 2024-09-16T08:03:52.446 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54889.log.gz 2024-09-16T08:03:52.446 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.55719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36040.log 2024-09-16T08:03:52.446 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55719.log.gz 2024-09-16T08:03:52.446 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33849.log 2024-09-16T08:03:52.446 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40036.log.gz 2024-09-16T08:03:52.446 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.36040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34816.log 2024-09-16T08:03:52.446 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57852.log 2024-09-16T08:03:52.446 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33849.log.gz 2024-09-16T08:03:52.446 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53073.log 2024-09-16T08:03:52.446 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34816.log.gz 2024-09-16T08:03:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43781.log 2024-09-16T08:03:52.447 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57852.log.gz 2024-09-16T08:03:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53073.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53073.log.gz 2024-09-16T08:03:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35132.log 2024-09-16T08:03:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44775.log 2024-09-16T08:03:52.447 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43781.log.gz 2024-09-16T08:03:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36720.log 2024-09-16T08:03:52.447 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35132.log.gz 2024-09-16T08:03:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.44775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37442.log 2024-09-16T08:03:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36720.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36720.log.gz 2024-09-16T08:03:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32078.log 2024-09-16T08:03:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52991.log 2024-09-16T08:03:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37442.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37442.log.gz 2024-09-16T08:03:52.448 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53914.log 2024-09-16T08:03:52.448 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32078.log.gz 2024-09-16T08:03:52.448 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37859.log 2024-09-16T08:03:52.448 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52991.log.gz 2024-09-16T08:03:52.448 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29361.log 2024-09-16T08:03:52.448 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53914.log.gz 2024-09-16T08:03:52.448 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53614.log 2024-09-16T08:03:52.448 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37859.log.gz 2024-09-16T08:03:52.448 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35256.log 2024-09-16T08:03:52.448 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29361.log.gz 2024-09-16T08:03:52.448 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39728.log 2024-09-16T08:03:52.448 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53614.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53614.log.gz 2024-09-16T08:03:52.448 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35256.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35256.log.gz 2024-09-16T08:03:52.449 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48629.log 2024-09-16T08:03:52.449 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47007.log 2024-09-16T08:03:52.449 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39728.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39728.log.gz 2024-09-16T08:03:52.449 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43274.log 2024-09-16T08:03:52.449 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48629.log.gz 2024-09-16T08:03:52.449 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57625.log 2024-09-16T08:03:52.449 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47007.log.gz 2024-09-16T08:03:52.449 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37351.log 2024-09-16T08:03:52.449 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43274.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43274.log.gz 2024-09-16T08:03:52.449 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58885.log 2024-09-16T08:03:52.449 INFO:teuthology.orchestra.run.smithi003.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.57625.log.gz 2024-09-16T08:03:52.449 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36146.log 2024-09-16T08:03:52.449 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37351.log.gz 2024-09-16T08:03:52.450 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49164.log 2024-09-16T08:03:52.450 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58885.log.gz 2024-09-16T08:03:52.450 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31413.log 2024-09-16T08:03:52.450 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36146.log.gz 2024-09-16T08:03:52.450 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53124.log 2024-09-16T08:03:52.450 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49164.log.gz 2024-09-16T08:03:52.450 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56758.log 2024-09-16T08:03:52.450 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31413.log.gz 2024-09-16T08:03:52.450 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41657.log 2024-09-16T08:03:52.450 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53124.log.gz 2024-09-16T08:03:52.450 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.56758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38910.log 2024-09-16T08:03:52.450 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56758.log.gz 2024-09-16T08:03:52.450 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50490.log 2024-09-16T08:03:52.451 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41657.log.gz 2024-09-16T08:03:52.451 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45681.log 2024-09-16T08:03:52.451 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38910.log.gz 2024-09-16T08:03:52.451 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45777.log 2024-09-16T08:03:52.451 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50490.log.gz 2024-09-16T08:03:52.451 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53825.log 2024-09-16T08:03:52.451 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45681.log.gz 2024-09-16T08:03:52.451 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41370.log 2024-09-16T08:03:52.451 INFO:teuthology.orchestra.run.smithi003.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.45777.log.gz 2024-09-16T08:03:52.451 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44752.log 2024-09-16T08:03:52.451 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53825.log.gz 2024-09-16T08:03:52.451 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42418.log 2024-09-16T08:03:52.451 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41370.log.gz 2024-09-16T08:03:52.452 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54791.log 2024-09-16T08:03:52.452 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44752.log.gz 2024-09-16T08:03:52.452 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58423.log 2024-09-16T08:03:52.452 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42418.log.gz 2024-09-16T08:03:52.452 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47880.log 2024-09-16T08:03:52.452 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54791.log.gz 2024-09-16T08:03:52.452 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52494.log 2024-09-16T08:03:52.452 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58423.log.gz 2024-09-16T08:03:52.452 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57499.log 2024-09-16T08:03:52.452 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47880.log.gz 2024-09-16T08:03:52.452 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54006.log 2024-09-16T08:03:52.452 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52494.log.gz 2024-09-16T08:03:52.452 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49512.log 2024-09-16T08:03:52.453 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57499.log.gz 2024-09-16T08:03:52.453 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55022.log 2024-09-16T08:03:52.453 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54006.log.gz 2024-09-16T08:03:52.453 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37531.log 2024-09-16T08:03:52.453 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49512.log.gz 2024-09-16T08:03:52.453 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.55022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52452.log 2024-09-16T08:03:52.453 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55022.log.gz 2024-09-16T08:03:52.453 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30881.log 2024-09-16T08:03:52.453 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37531.log.gz 2024-09-16T08:03:52.453 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51576.log 2024-09-16T08:03:52.453 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52452.log.gz 2024-09-16T08:03:52.453 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48271.log 2024-09-16T08:03:52.453 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30881.log.gz 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42378.log 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51576.log.gz 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58591.log 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48271.log.gz 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36902.log 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42378.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42378.log.gz 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58591.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58591.log.gz 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44000.log 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41044.log 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36902.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36902.log.gz 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48538.log 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44000.log.gz 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49867.log 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41044.log.gz 2024-09-16T08:03:52.454 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48538.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48538.log.gz 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44576.log 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49867.log.gz 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37629.log 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44576.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44576.log.gz 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr: -- /var/log/ceph/ceph-client.admin.58381.log 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37629.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37629.log.gz 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48678.log 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54505.log 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58381.log.gz 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58020.log 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48678.log.gz 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53963.log 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54505.log.gz 2024-09-16T08:03:52.455 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40301.log 2024-09-16T08:03:52.456 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58020.log.gz 2024-09-16T08:03:52.456 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43825.log 2024-09-16T08:03:52.456 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53963.log.gz 2024-09-16T08:03:52.456 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47519.log 2024-09-16T08:03:52.456 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40301.log.gz 2024-09-16T08:03:52.456 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37168.log 2024-09-16T08:03:52.456 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43825.log.gz 2024-09-16T08:03:52.456 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36790.log 2024-09-16T08:03:52.456 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47519.log.gz 2024-09-16T08:03:52.456 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50266.log 2024-09-16T08:03:52.456 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37168.log.gz 2024-09-16T08:03:52.456 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45462.log 2024-09-16T08:03:52.456 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36790.log.gz 2024-09-16T08:03:52.457 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48944.log 2024-09-16T08:03:52.457 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50266.log.gz 2024-09-16T08:03:52.457 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43183.log 2024-09-16T08:03:52.457 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45462.log.gz 2024-09-16T08:03:52.457 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48944.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48944.log.gz 2024-09-16T08:03:52.457 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.45952.log 2024-09-16T08:03:52.457 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43183.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43183.log.gz 2024-09-16T08:03:52.457 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58633.log 2024-09-16T08:03:52.457 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45952.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45952.log.gz 2024-09-16T08:03:52.457 INFO:teuthology.orchestra.run.smithi003.stderr: -- /var/log/ceph/ceph-client.admin.36545.log 2024-09-16T08:03:52.457 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58633.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58633.log.gz 2024-09-16T08:03:52.457 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53320.log 2024-09-16T08:03:52.457 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29193.log 2024-09-16T08:03:52.458 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36545.log.gz 2024-09-16T08:03:52.458 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42826.log 2024-09-16T08:03:52.458 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53320.log.gz 2024-09-16T08:03:52.458 INFO:teuthology.orchestra.run.smithi003.stderr:gzip/var/log/ceph/ceph-client.admin.29193.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48048.log 2024-09-16T08:03:52.458 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29193.log.gz 2024-09-16T08:03:52.458 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44972.log 2024-09-16T08:03:52.458 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42826.log.gz 2024-09-16T08:03:52.458 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29302.log 2024-09-16T08:03:52.458 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48048.log.gz 2024-09-16T08:03:52.458 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52718.log 2024-09-16T08:03:52.458 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44972.log.gz 2024-09-16T08:03:52.458 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40806.log 2024-09-16T08:03:52.458 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29302.log.gz 2024-09-16T08:03:52.458 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.52718.log: /var/log/ceph/ceph-client.admin.47143.log 2024-09-16T08:03:52.459 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52718.log.gz 2024-09-16T08:03:52.459 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51261.log 2024-09-16T08:03:52.459 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40806.log.gz 2024-09-16T08:03:52.459 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43510.log 2024-09-16T08:03:52.459 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47143.log.gz 2024-09-16T08:03:52.459 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49210.log 2024-09-16T08:03:52.459 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51261.log.gz 2024-09-16T08:03:52.459 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49796.log 2024-09-16T08:03:52.459 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43510.log.gz 2024-09-16T08:03:52.459 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44461.log 2024-09-16T08:03:52.459 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49210.log.gz 2024-09-16T08:03:52.459 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55817.log 2024-09-16T08:03:52.459 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49796.log.gz 2024-09-16T08:03:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31586.log 2024-09-16T08:03:52.460 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44461.log.gz 2024-09-16T08:03:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.55817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31903.log 2024-09-16T08:03:52.460 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55817.log.gz 2024-09-16T08:03:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39491.log 2024-09-16T08:03:52.460 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31586.log.gz 2024-09-16T08:03:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31903.log: gzip -5 --verbose 49.6% -- /var/log/ceph/ceph-client.admin.42174.log 2024-09-16T08:03:52.460 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31903.log.gz 2024-09-16T08:03:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39491.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39491.log.gz 2024-09-16T08:03:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34509.log 2024-09-16T08:03:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40904.log 2024-09-16T08:03:52.460 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42174.log.gz 2024-09-16T08:03:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58021.log 2024-09-16T08:03:52.461 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34509.log.gz 2024-09-16T08:03:52.461 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44357.log 2024-09-16T08:03:52.461 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40904.log.gz 2024-09-16T08:03:52.461 INFO:teuthology.orchestra.run.smithi003.stderr:gzip/var/log/ceph/ceph-client.admin.58021.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44315.log 2024-09-16T08:03:52.461 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58021.log.gz 2024-09-16T08:03:52.461 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44357.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.44357.log.gz 2024-09-16T08:03:52.461 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50763.log 2024-09-16T08:03:52.461 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50539.log 2024-09-16T08:03:52.461 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44315.log.gz 2024-09-16T08:03:52.461 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31679.log 2024-09-16T08:03:52.461 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50763.log.gz 2024-09-16T08:03:52.461 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58019.log 2024-09-16T08:03:52.461 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50539.log.gz 2024-09-16T08:03:52.461 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39006.log 2024-09-16T08:03:52.462 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31679.log.gz 2024-09-16T08:03:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49916.log 2024-09-16T08:03:52.462 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58019.log.gz 2024-09-16T08:03:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46043.log 2024-09-16T08:03:52.462 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39006.log.gz 2024-09-16T08:03:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36097.log 2024-09-16T08:03:52.462 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49916.log.gz 2024-09-16T08:03:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34859.log 2024-09-16T08:03:52.462 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46043.log.gz 2024-09-16T08:03:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46001.log 2024-09-16T08:03:52.462 INFO:teuthology.orchestra.run.smithi003.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36097.log.gz 2024-09-16T08:03:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53661.log 2024-09-16T08:03:52.462 INFO:teuthology.orchestra.run.smithi003.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34859.log.gz 2024-09-16T08:03:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52767.log 2024-09-16T08:03:52.463 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46001.log.gz 2024-09-16T08:03:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45280.log 2024-09-16T08:03:52.463 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53661.log.gz 2024-09-16T08:03:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38332.log 2024-09-16T08:03:52.463 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52767.log.gz 2024-09-16T08:03:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45280.log: gzip -5 --verbose -- 49.2% -- replaced with /var/log/ceph/ceph-client.admin.45280.log.gz 2024-09-16T08:03:52.463 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.31832.log 2024-09-16T08:03:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38332.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38332.log.gz 2024-09-16T08:03:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43461.log 2024-09-16T08:03:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38701.log 2024-09-16T08:03:52.463 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31832.log.gz 2024-09-16T08:03:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35664.log 2024-09-16T08:03:52.463 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43461.log.gz 2024-09-16T08:03:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35944.log 2024-09-16T08:03:52.464 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38701.log.gz 2024-09-16T08:03:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54742.log 2024-09-16T08:03:52.464 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35664.log.gz 2024-09-16T08:03:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33248.log 2024-09-16T08:03:52.464 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35944.log.gz 2024-09-16T08:03:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32632.log 2024-09-16T08:03:52.464 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54742.log.gz 2024-09-16T08:03:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33248.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33248.log.gz 2024-09-16T08:03:52.464 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.34151.log 2024-09-16T08:03:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32632.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32632.log.gz 2024-09-16T08:03:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50847.log 2024-09-16T08:03:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34151.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.34151.log.gz 2024-09-16T08:03:52.465 INFO:teuthology.orchestra.run.smithi003.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41321.log 2024-09-16T08:03:52.465 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31147.log 2024-09-16T08:03:52.465 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50847.log.gz 2024-09-16T08:03:52.465 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34684.log 2024-09-16T08:03:52.465 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41321.log.gz 2024-09-16T08:03:52.465 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33430.log 2024-09-16T08:03:52.465 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31147.log.gz 2024-09-16T08:03:52.465 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51310.log 2024-09-16T08:03:52.465 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34684.log.gz 2024-09-16T08:03:52.465 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30748.log 2024-09-16T08:03:52.465 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33430.log.gz 2024-09-16T08:03:52.465 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35797.log 2024-09-16T08:03:52.465 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51310.log.gz 2024-09-16T08:03:52.465 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43092.log 2024-09-16T08:03:52.466 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30748.log.gz 2024-09-16T08:03:52.466 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57457.log 2024-09-16T08:03:52.466 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35797.log.gz 2024-09-16T08:03:52.466 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43092.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43092.log.gz 2024-09-16T08:03:52.466 INFO:teuthology.orchestra.run.smithi003.stderr: -- /var/log/ceph/ceph-client.admin.54973.log 2024-09-16T08:03:52.466 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57457.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57457.log.gz 2024-09-16T08:03:52.466 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52368.log 2024-09-16T08:03:52.466 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54973.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54973.log.gz 2024-09-16T08:03:52.466 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39276.log 2024-09-16T08:03:52.466 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5/var/log/ceph/ceph-client.admin.52368.log: --verbose -- /var/log/ceph/ceph-client.admin.35356.log 2024-09-16T08:03:52.466 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52368.log.gz 2024-09-16T08:03:52.466 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30366.log 2024-09-16T08:03:52.466 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39276.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39276.log.gz 2024-09-16T08:03:52.466 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31633.log 2024-09-16T08:03:52.467 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35356.log.gz 2024-09-16T08:03:52.467 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30366.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30366.log.gz 2024-09-16T08:03:52.467 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.56335.log 2024-09-16T08:03:52.467 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31633.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31633.log.gz 2024-09-16T08:03:52.467 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29360.log 2024-09-16T08:03:52.467 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.56335.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56335.log.gz 2024-09-16T08:03:52.467 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.34416.log 2024-09-16T08:03:52.467 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29360.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29360.log.gz 2024-09-16T08:03:52.467 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53257.log 2024-09-16T08:03:52.467 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34416.log: gzip -5 49.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.34416.log.gz /var/log/ceph/ceph-client.admin.28915.log 2024-09-16T08:03:52.467 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.467 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53257.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53257.log.gz 2024-09-16T08:03:52.467 INFO:teuthology.orchestra.run.smithi003.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41272.log 2024-09-16T08:03:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.28915.log: 66.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35083.log 2024-09-16T08:03:52.468 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28915.log.gz 2024-09-16T08:03:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28412.log 2024-09-16T08:03:52.468 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41272.log.gz 2024-09-16T08:03:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47101.log 2024-09-16T08:03:52.468 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35083.log.gz 2024-09-16T08:03:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.28412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35706.log 2024-09-16T08:03:52.468 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28412.log.gz 2024-09-16T08:03:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47284.log 2024-09-16T08:03:52.468 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47101.log.gz 2024-09-16T08:03:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40172.log 2024-09-16T08:03:52.468 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35706.log.gz 2024-09-16T08:03:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47284.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47284.log.gz 2024-09-16T08:03:52.469 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.35924.log 2024-09-16T08:03:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40172.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40172.log.gz 2024-09-16T08:03:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42868.log 2024-09-16T08:03:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35924.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35924.log.gz 2024-09-16T08:03:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57583.log 2024-09-16T08:03:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42868.log: gzip -5 --verbose 49.6% -- /var/log/ceph/ceph-client.admin.49692.log 2024-09-16T08:03:52.469 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42868.log.gz 2024-09-16T08:03:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42777.log 49.6% 2024-09-16T08:03:52.469 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57583.log.gz 2024-09-16T08:03:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29050.log 2024-09-16T08:03:52.469 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49692.log.gz 2024-09-16T08:03:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33654.log 2024-09-16T08:03:52.469 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42777.log.gz 2024-09-16T08:03:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40637.log 2024-09-16T08:03:52.470 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29050.log.gz 2024-09-16T08:03:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49776.log 2024-09-16T08:03:52.470 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33654.log.gz 2024-09-16T08:03:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54458.log 2024-09-16T08:03:52.470 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40637.log.gz 2024-09-16T08:03:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51443.log 2024-09-16T08:03:52.470 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49776.log.gz 2024-09-16T08:03:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41979.log 2024-09-16T08:03:52.470 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54458.log.gz 2024-09-16T08:03:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45901.log 2024-09-16T08:03:52.470 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51443.log.gz 2024-09-16T08:03:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29192.log 2024-09-16T08:03:52.471 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41979.log.gz 2024-09-16T08:03:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38821.log 2024-09-16T08:03:52.471 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45901.log.gz 2024-09-16T08:03:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33472.log 2024-09-16T08:03:52.471 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29192.log.gz 2024-09-16T08:03:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39234.log 2024-09-16T08:03:52.471 INFO:teuthology.orchestra.run.smithi003.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.38821.log.gz 2024-09-16T08:03:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37280.log 2024-09-16T08:03:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33472.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33472.log.gz 2024-09-16T08:03:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39234.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39234.log.gz 2024-09-16T08:03:52.471 INFO:teuthology.orchestra.run.smithi003.stderr: -- /var/log/ceph/ceph-client.admin.47922.log 2024-09-16T08:03:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37280.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37280.log.gz 2024-09-16T08:03:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48720.log 2024-09-16T08:03:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47964.log 2024-09-16T08:03:52.472 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47922.log.gz 2024-09-16T08:03:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48720.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48720.log.gz 2024-09-16T08:03:52.472 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.53439.log 2024-09-16T08:03:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47964.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.47964.log.gz 2024-09-16T08:03:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48090.log 2024-09-16T08:03:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53439.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33787.log 2024-09-16T08:03:52.472 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53439.log.gz 2024-09-16T08:03:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46925.log 2024-09-16T08:03:52.472 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48090.log.gz 2024-09-16T08:03:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45014.log 2024-09-16T08:03:52.472 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33787.log.gz 2024-09-16T08:03:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56117.log 2024-09-16T08:03:52.473 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46925.log.gz 2024-09-16T08:03:52.473 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41999.log 2024-09-16T08:03:52.473 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45014.log.gz 2024-09-16T08:03:52.473 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42930.log 2024-09-16T08:03:52.473 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.56117.log: /var/log/ceph/ceph-client.admin.41999.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T08:03:52.473 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41999.log.gz 2024-09-16T08:03:52.473 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56117.log.gz 2024-09-16T08:03:52.473 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30317.log 2024-09-16T08:03:52.473 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42930.log.gz 2024-09-16T08:03:52.473 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44709.log 2024-09-16T08:03:52.473 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48853.log 2024-09-16T08:03:52.473 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30317.log.gz 2024-09-16T08:03:52.473 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44709.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44709.log.gz 2024-09-16T08:03:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34053.log 2024-09-16T08:03:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48853.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48853.log.gz 2024-09-16T08:03:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46492.log 2024-09-16T08:03:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34053.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34053.log.gz 2024-09-16T08:03:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39091.log 2024-09-16T08:03:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46492.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47054.log 2024-09-16T08:03:52.474 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46492.log.gz 2024-09-16T08:03:52.474 INFO:teuthology.orchestra.run.smithi003.stderr: 88.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T08:03:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37945.log 2024-09-16T08:03:52.474 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39091.log.gz 2024-09-16T08:03:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29554.log 2024-09-16T08:03:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47054.log: /var/log/ceph/ceph-client.admin.37945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29883.log 2024-09-16T08:03:52.474 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37945.log.gz 2024-09-16T08:03:52.474 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47054.log.gz 2024-09-16T08:03:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48229.log 2024-09-16T08:03:52.475 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29554.log.gz 2024-09-16T08:03:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52319.log 2024-09-16T08:03:52.475 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29883.log.gz 2024-09-16T08:03:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36860.log 2024-09-16T08:03:52.475 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48229.log.gz 2024-09-16T08:03:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36454.log 2024-09-16T08:03:52.475 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52319.log.gz 2024-09-16T08:03:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28826.log 2024-09-16T08:03:52.475 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36860.log.gz 2024-09-16T08:03:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50987.log 2024-09-16T08:03:52.475 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36454.log.gz/var/log/ceph/ceph-client.admin.28826.log: 2024-09-16T08:03:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30619.log 2024-09-16T08:03:52.475 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28826.log.gz 2024-09-16T08:03:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43419.log 2024-09-16T08:03:52.476 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50987.log.gz 2024-09-16T08:03:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58297.log 2024-09-16T08:03:52.476 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30619.log.gz 2024-09-16T08:03:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53745.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43419.log.gz 2024-09-16T08:03:52.476 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58297.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58297.log.gz 2024-09-16T08:03:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31504.log 2024-09-16T08:03:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53745.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53745.log.gz 2024-09-16T08:03:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50132.log 2024-09-16T08:03:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32168.log 2024-09-16T08:03:52.476 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31504.log.gz 2024-09-16T08:03:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55859.log 2024-09-16T08:03:52.476 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50132.log.gz 2024-09-16T08:03:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32168.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32168.log.gz 2024-09-16T08:03:52.477 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.42441.log 2024-09-16T08:03:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.55859.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55859.log.gz 2024-09-16T08:03:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33024.log 2024-09-16T08:03:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:gzip/var/log/ceph/ceph-client.admin.42441.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54552.log 2024-09-16T08:03:52.477 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42441.log.gz 2024-09-16T08:03:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33024.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33024.log.gz 2024-09-16T08:03:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52543.log 2024-09-16T08:03:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54552.log: gzip -5 --verbose 49.2% -- replaced with /var/log/ceph/ceph-client.admin.54552.log.gz 2024-09-16T08:03:52.477 INFO:teuthology.orchestra.run.smithi003.stderr: -- /var/log/ceph/ceph-client.admin.31280.log 2024-09-16T08:03:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52543.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52543.log.gz 2024-09-16T08:03:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57415.log 2024-09-16T08:03:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31280.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31280.log.gz 2024-09-16T08:03:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30839.log 2024-09-16T08:03:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57415.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57415.log.gz 2024-09-16T08:03:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29722.log 2024-09-16T08:03:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30839.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30839.log.gz 2024-09-16T08:03:52.478 INFO:teuthology.orchestra.run.smithi003.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54249.log 2024-09-16T08:03:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29722.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29722.log.gz 2024-09-16T08:03:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53705.log 2024-09-16T08:03:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54249.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.54249.log.gz 2024-09-16T08:03:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47472.log 2024-09-16T08:03:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53705.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53705.log.gz 2024-09-16T08:03:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33920.log 2024-09-16T08:03:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47472.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47472.log.gz 2024-09-16T08:03:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39996.log 2024-09-16T08:03:52.479 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35531.log 2024-09-16T08:03:52.479 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33920.log.gz 2024-09-16T08:03:52.479 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49734.log 2024-09-16T08:03:52.479 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39996.log.gz 2024-09-16T08:03:52.479 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35531.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35531.log.gz 2024-09-16T08:03:52.479 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.44441.log 2024-09-16T08:03:52.479 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49734.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49734.log.gz 2024-09-16T08:03:52.479 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57667.log 2024-09-16T08:03:52.479 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44441.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44441.log.gz 2024-09-16T08:03:52.479 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38601.log 2024-09-16T08:03:52.479 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59051.log 2024-09-16T08:03:52.479 INFO:teuthology.orchestra.run.smithi003.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.57667.log.gz 2024-09-16T08:03:52.479 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28333.log 2024-09-16T08:03:52.479 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38601.log.gz 2024-09-16T08:03:52.480 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.59051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53033.log 2024-09-16T08:03:52.480 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59051.log.gz 2024-09-16T08:03:52.480 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.28333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37672.log 2024-09-16T08:03:52.480 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28333.log.gz 2024-09-16T08:03:52.480 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29638.log 2024-09-16T08:03:52.480 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53033.log.gz 2024-09-16T08:03:52.480 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48138.log 2024-09-16T08:03:52.480 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37672.log.gz 2024-09-16T08:03:52.480 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48333.log 2024-09-16T08:03:52.480 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29638.log.gz 2024-09-16T08:03:52.480 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48138.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48138.log.gz 2024-09-16T08:03:52.480 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.33561.log 2024-09-16T08:03:52.480 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48333.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48333.log.gz 2024-09-16T08:03:52.481 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58507.log 2024-09-16T08:03:52.481 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33561.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33561.log.gz 2024-09-16T08:03:52.481 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.47331.log 2024-09-16T08:03:52.481 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58507.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58507.log.gz 2024-09-16T08:03:52.481 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53785.log 2024-09-16T08:03:52.481 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47331.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47331.log.gz 2024-09-16T08:03:52.481 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36944.log 2024-09-16T08:03:52.481 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53785.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.53785.log.gz 2024-09-16T08:03:52.481 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52634.log 2024-09-16T08:03:52.481 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36944.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36944.log.gz 2024-09-16T08:03:52.481 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36769.log 2024-09-16T08:03:52.481 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52634.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52634.log.gz 2024-09-16T08:03:52.481 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50000.log 2024-09-16T08:03:52.482 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51505.log 2024-09-16T08:03:52.482 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36769.log.gz 2024-09-16T08:03:52.482 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50000.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27269.log 2024-09-16T08:03:52.482 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50000.log.gz 2024-09-16T08:03:52.482 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51505.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51505.log.gz 2024-09-16T08:03:52.482 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.51121.log 2024-09-16T08:03:52.482 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.tmp-client.admin.27269.log: 66.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27269.log.gz 2024-09-16T08:03:52.482 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42553.log 2024-09-16T08:03:52.482 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51121.log: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.51121.log.gz 2024-09-16T08:03:52.482 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45329.log 2024-09-16T08:03:52.482 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52676.log 2024-09-16T08:03:52.482 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42553.log.gz 2024-09-16T08:03:52.482 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58801.log 2024-09-16T08:03:52.482 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45329.log.gz 2024-09-16T08:03:52.483 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34011.log 2024-09-16T08:03:52.483 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52676.log.gz 2024-09-16T08:03:52.483 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47378.log 2024-09-16T08:03:52.483 INFO:teuthology.orchestra.run.smithi003.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.58801.log.gz 2024-09-16T08:03:52.483 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47425.log 2024-09-16T08:03:52.483 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34011.log.gz 2024-09-16T08:03:52.483 INFO:teuthology.orchestra.run.smithi003.stderr:gzip/var/log/ceph/ceph-client.admin.47378.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53166.log 2024-09-16T08:03:52.483 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47378.log.gz 2024-09-16T08:03:52.483 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47425.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47425.log.gz 2024-09-16T08:03:52.483 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34726.log 2024-09-16T08:03:52.483 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53166.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48580.log 2024-09-16T08:03:52.483 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53166.log.gz 2024-09-16T08:03:52.483 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55908.log 2024-09-16T08:03:52.484 INFO:teuthology.orchestra.run.smithi003.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34726.log.gz 2024-09-16T08:03:52.484 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50670.log 2024-09-16T08:03:52.484 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48580.log.gz 2024-09-16T08:03:52.484 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.55908.log: gzip -5 --verbose 50.0% -- /var/log/ceph/ceph-client.admin.29194.log 2024-09-16T08:03:52.484 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55908.log.gz 2024-09-16T08:03:52.484 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50670.log: gzip -5 49.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.50670.log.gz /var/log/ceph/ceph-client.admin.48313.log 2024-09-16T08:03:52.484 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.484 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55297.log 2024-09-16T08:03:52.484 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29194.log.gz 2024-09-16T08:03:52.484 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58339.log 2024-09-16T08:03:52.484 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48313.log.gz 2024-09-16T08:03:52.484 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.55297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52186.log 2024-09-16T08:03:52.484 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55297.log.gz 2024-09-16T08:03:52.485 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58339.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58339.log.gz 2024-09-16T08:03:52.485 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.47568.log 2024-09-16T08:03:52.485 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52186.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52186.log.gz 2024-09-16T08:03:52.485 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55071.log 2024-09-16T08:03:52.485 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47568.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47568.log.gz 2024-09-16T08:03:52.485 INFO:teuthology.orchestra.run.smithi003.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51351.log 2024-09-16T08:03:52.485 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.55071.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55071.log.gz 2024-09-16T08:03:52.485 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56166.log 2024-09-16T08:03:52.485 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51351.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51351.log.gz 2024-09-16T08:03:52.485 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49430.log 2024-09-16T08:03:52.486 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.56166.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56166.log.gz 2024-09-16T08:03:52.486 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44667.log 2024-09-16T08:03:52.486 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49430.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49430.log.gz 2024-09-16T08:03:52.486 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38532.log 2024-09-16T08:03:52.486 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44667.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44667.log.gz 2024-09-16T08:03:52.486 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35616.log 2024-09-16T08:03:52.486 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38532.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38532.log.gz 2024-09-16T08:03:52.486 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35307.log 2024-09-16T08:03:52.486 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35616.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.35616.log.gz 2024-09-16T08:03:52.486 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56902.log 2024-09-16T08:03:52.486 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35307.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35307.log.gz 2024-09-16T08:03:52.486 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53215.log 2024-09-16T08:03:52.486 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.56902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46751.log 2024-09-16T08:03:52.487 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56902.log.gz 2024-09-16T08:03:52.487 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35440.log 2024-09-16T08:03:52.487 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53215.log.gz 2024-09-16T08:03:52.487 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46751.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46751.log.gz 2024-09-16T08:03:52.487 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.37484.log 2024-09-16T08:03:52.487 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35440.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35440.log.gz 2024-09-16T08:03:52.487 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51969.log 2024-09-16T08:03:52.487 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37484.log: gzip -5 --verbose 49.6% -- -- replaced with /var/log/ceph/ceph-client.admin.37484.log.gz /var/log/ceph/ceph-client.admin.37260.log 2024-09-16T08:03:52.487 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.487 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51969.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51969.log.gz 2024-09-16T08:03:52.487 INFO:teuthology.orchestra.run.smithi003.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36321.log 2024-09-16T08:03:52.487 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37260.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37260.log.gz 2024-09-16T08:03:52.487 INFO:teuthology.orchestra.run.smithi003.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45595.log 2024-09-16T08:03:52.487 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36321.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36321.log.gz 2024-09-16T08:03:52.488 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41797.log 2024-09-16T08:03:52.488 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45595.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45595.log.gz 2024-09-16T08:03:52.488 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.35882.log 2024-09-16T08:03:52.488 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41797.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34102.log 2024-09-16T08:03:52.488 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41797.log.gz 2024-09-16T08:03:52.488 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30015.log 2024-09-16T08:03:52.488 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35882.log.gz 2024-09-16T08:03:52.488 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34102.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34102.log.gz 2024-09-16T08:03:52.488 INFO:teuthology.orchestra.run.smithi003.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33745.log 2024-09-16T08:03:52.488 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30015.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30015.log.gz 2024-09-16T08:03:52.488 INFO:teuthology.orchestra.run.smithi003.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48804.log 2024-09-16T08:03:52.488 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33745.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33745.log.gz 2024-09-16T08:03:52.488 INFO:teuthology.orchestra.run.smithi003.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45238.log 2024-09-16T08:03:52.489 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48804.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.48804.log.gz 2024-09-16T08:03:52.489 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44133.log 2024-09-16T08:03:52.489 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49643.log 2024-09-16T08:03:52.489 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2024-09-16T08:03:52.489 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44133.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44133.log.gz 2024-09-16T08:03:52.489 INFO:teuthology.orchestra.run.smithi003.stderr: -- /var/log/ceph/ceph-client.admin.42070.log 2024-09-16T08:03:52.489 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49643.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49643.log.gz 2024-09-16T08:03:52.489 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51029.log 2024-09-16T08:03:52.489 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42070.log: 49.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55346.log 2024-09-16T08:03:52.489 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42070.log.gz 2024-09-16T08:03:52.489 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47190.log 2024-09-16T08:03:52.489 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51029.log.gz 2024-09-16T08:03:52.489 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.55346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57016.log 2024-09-16T08:03:52.490 INFO:teuthology.orchestra.run.smithi003.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.55346.log.gz 2024-09-16T08:03:52.490 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52830.log 2024-09-16T08:03:52.490 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47190.log.gz 2024-09-16T08:03:52.490 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57016.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57016.log.gz 2024-09-16T08:03:52.490 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.37218.log 2024-09-16T08:03:52.490 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52830.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52830.log.gz 2024-09-16T08:03:52.490 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42112.log 2024-09-16T08:03:52.490 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34642.log 2024-09-16T08:03:52.490 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37218.log.gz 2024-09-16T08:03:52.490 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29362.log 2024-09-16T08:03:52.490 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42112.log.gz 2024-09-16T08:03:52.490 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52011.log 2024-09-16T08:03:52.490 INFO:teuthology.orchestra.run.smithi003.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34642.log.gz 2024-09-16T08:03:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50714.log 2024-09-16T08:03:52.491 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29362.log.gz 2024-09-16T08:03:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52011.log: gzip -5 --verbose 49.6% -- /var/log/ceph/ceph-client.admin.58187.log 2024-09-16T08:03:52.491 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52011.log.gz 2024-09-16T08:03:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42684.log 2024-09-16T08:03:52.491 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50714.log.gz 2024-09-16T08:03:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44532.log 2024-09-16T08:03:52.491 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58187.log.gz 2024-09-16T08:03:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42602.log 2024-09-16T08:03:52.491 INFO:teuthology.orchestra.run.smithi003.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.42684.log.gz 2024-09-16T08:03:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44532.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44532.log.gz 2024-09-16T08:03:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47617.log 2024-09-16T08:03:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53297.log 2024-09-16T08:03:52.492 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42602.log.gz 2024-09-16T08:03:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47617.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47617.log.gz 2024-09-16T08:03:52.492 INFO:teuthology.orchestra.run.smithi003.stderr: -- /var/log/ceph/ceph-client.admin.45504.log 2024-09-16T08:03:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53297.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53297.log.gz 2024-09-16T08:03:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43948.log 2024-09-16T08:03:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44266.log 2024-09-16T08:03:52.492 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45504.log.gz 2024-09-16T08:03:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30661.log 2024-09-16T08:03:52.492 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43948.log.gz 2024-09-16T08:03:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39555.log 2024-09-16T08:03:52.492 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44266.log.gz 2024-09-16T08:03:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36594.log 2024-09-16T08:03:52.492 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30661.log.gz 2024-09-16T08:03:52.493 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45553.log 2024-09-16T08:03:52.493 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39555.log.gz 2024-09-16T08:03:52.493 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41937.log 2024-09-16T08:03:52.493 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36594.log.gz 2024-09-16T08:03:52.493 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58189.log 2024-09-16T08:03:52.493 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45553.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45553.log.gz 2024-09-16T08:03:52.493 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57330.log 2024-09-16T08:03:52.493 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41937.log.gz 2024-09-16T08:03:52.493 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44042.log 2024-09-16T08:03:52.493 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58189.log.gz 2024-09-16T08:03:52.493 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37033.log 2024-09-16T08:03:52.493 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57330.log.gz 2024-09-16T08:03:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43232.log 2024-09-16T08:03:52.494 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44042.log.gz 2024-09-16T08:03:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57107.log 2024-09-16T08:03:52.494 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37033.log.gz 2024-09-16T08:03:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43232.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43232.log.gz 2024-09-16T08:03:52.494 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph-client.admin.45861.log 2024-09-16T08:03:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57107.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57107.log.gz 2024-09-16T08:03:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30923.log 2024-09-16T08:03:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45861.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45861.log.gz 2024-09-16T08:03:52.494 INFO:teuthology.orchestra.run.smithi003.stderr: -- /var/log/ceph/ceph-client.admin.46225.log 2024-09-16T08:03:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30923.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30923.log.gz 2024-09-16T08:03:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38072.log 2024-09-16T08:03:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46225.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46225.log.gz 2024-09-16T08:03:52.494 INFO:teuthology.orchestra.run.smithi003.stderr: -- /var/log/ceph/ceph-client.admin.39189.log 2024-09-16T08:03:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38072.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38072.log.gz 2024-09-16T08:03:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38959.log 2024-09-16T08:03:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46845.log 2024-09-16T08:03:52.495 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39189.log.gz 2024-09-16T08:03:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46800.log 2024-09-16T08:03:52.495 INFO:teuthology.orchestra.run.smithi003.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38959.log.gz 2024-09-16T08:03:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:gzip/var/log/ceph/ceph-client.admin.46845.log: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T08:03:52.495 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46845.log.gz 2024-09-16T08:03:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46800.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46800.log.gz 2024-09-16T08:03:52.495 INFO:teuthology.orchestra.run.smithi003.stderr: -- /var/log/ceph/ceph-client.admin.40548.log 2024-09-16T08:03:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30769.log 2024-09-16T08:03:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40548.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.40548.log.gz 2024-09-16T08:03:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31994.log 2024-09-16T08:03:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30769.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30769.log.gz 2024-09-16T08:03:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40192.log 2024-09-16T08:03:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31994.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31994.log.gz 2024-09-16T08:03:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49335.log 2024-09-16T08:03:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40192.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40192.log.gz 2024-09-16T08:03:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35837.log 2024-09-16T08:03:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49335.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49335.log.gz 2024-09-16T08:03:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40127.log 2024-09-16T08:03:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35837.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35837.log.gz 2024-09-16T08:03:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31455.log 2024-09-16T08:03:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40127.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40127.log.gz 2024-09-16T08:03:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28966.log 2024-09-16T08:03:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31455.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31455.log.gz 2024-09-16T08:03:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36412.log 2024-09-16T08:03:52.497 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.28966.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28966.log.gz 2024-09-16T08:03:52.497 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58759.log 2024-09-16T08:03:52.497 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36412.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36412.log.gz 2024-09-16T08:03:52.497 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52410.log 2024-09-16T08:03:52.497 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58759.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58759.log.gz 2024-09-16T08:03:52.497 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43134.log 2024-09-16T08:03:52.497 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52410.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52410.log.gz 2024-09-16T08:03:52.497 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53865.log 2024-09-16T08:03:52.497 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43134.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43134.log.gz 2024-09-16T08:03:52.497 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31812.log 2024-09-16T08:03:52.497 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53865.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53865.log.gz 2024-09-16T08:03:52.497 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54364.log 2024-09-16T08:03:52.497 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31812.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31812.log.gz 2024-09-16T08:03:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52051.log 2024-09-16T08:03:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54364.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54364.log.gz 2024-09-16T08:03:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30965.log 2024-09-16T08:03:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52051.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52051.log.gz 2024-09-16T08:03:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46702.log 2024-09-16T08:03:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32590.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30965.log.gz 2024-09-16T08:03:52.499 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46702.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46702.log.gz 2024-09-16T08:03:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32765.log 2024-09-16T08:03:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32590.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32590.log.gz 2024-09-16T08:03:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49564.log 2024-09-16T08:03:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32765.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32765.log.gz 2024-09-16T08:03:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39140.log 2024-09-16T08:03:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.49564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57709.log 2024-09-16T08:03:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53481.log 2024-09-16T08:03:52.500 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39140.log.gz 2024-09-16T08:03:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33206.log 2024-09-16T08:03:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53481.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57709.log.gz 2024-09-16T08:03:52.500 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53481.log.gz 2024-09-16T08:03:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54840.log 2024-09-16T08:03:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37818.log 2024-09-16T08:03:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33206.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33206.log.gz 2024-09-16T08:03:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54840.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54840.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54296.log 2024-09-16T08:03:52.501 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48496.log 2024-09-16T08:03:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37818.log: /var/log/ceph/ceph-client.admin.54296.log: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37818.log.gz 2024-09-16T08:03:52.501 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54296.log.gz 2024-09-16T08:03:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46176.log 2024-09-16T08:03:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38248.log 2024-09-16T08:03:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48496.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48496.log.gz 2024-09-16T08:03:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46176.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46176.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49563.log 2024-09-16T08:03:52.501 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44399.log 2024-09-16T08:03:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38248.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38248.log.gz 2024-09-16T08:03:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35968.log 2024-09-16T08:03:52.502 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49563.log.gz 2024-09-16T08:03:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53390.log 2024-09-16T08:03:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35968.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44399.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35968.log.gz 2024-09-16T08:03:52.502 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36250.log 2024-09-16T08:03:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53390.log: gzip 50.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.45819.log 2024-09-16T08:03:52.502 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53390.log.gz 2024-09-16T08:03:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42511.log 2024-09-16T08:03:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36250.log: /var/log/ceph/ceph-client.admin.45819.log: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45819.log.gz 2024-09-16T08:03:52.502 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36250.log.gz 2024-09-16T08:03:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32807.log 2024-09-16T08:03:52.503 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51170.log 2024-09-16T08:03:52.503 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42511.log.gz 2024-09-16T08:03:52.503 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35551.log 2024-09-16T08:03:52.503 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51170.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32807.log.gz 2024-09-16T08:03:52.503 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51170.log.gz 2024-09-16T08:03:52.503 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53523.log 2024-09-16T08:03:52.503 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50182.log 2024-09-16T08:03:52.503 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35551.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35551.log.gz 2024-09-16T08:03:52.503 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53523.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29092.log 2024-09-16T08:03:52.503 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53523.log.gz 2024-09-16T08:03:52.503 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46127.log 2024-09-16T08:03:52.503 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29092.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29092.log.gz 2024-09-16T08:03:52.503 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50182.log.gz 2024-09-16T08:03:52.503 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39847.log 2024-09-16T08:03:52.504 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35216.log 2024-09-16T08:03:52.504 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46127.log.gz 2024-09-16T08:03:52.504 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43001.log 2024-09-16T08:03:52.504 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35216.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39847.log.gz 2024-09-16T08:03:52.504 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35216.log.gz 2024-09-16T08:03:52.504 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56473.log 2024-09-16T08:03:52.504 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58549.log 2024-09-16T08:03:52.504 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43001.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43001.log.gz 2024-09-16T08:03:52.504 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.56473.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56473.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32127.log 2024-09-16T08:03:52.504 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.504 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45105.log 2024-09-16T08:03:52.504 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32127.log: /var/log/ceph/ceph-client.admin.58549.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32127.log.gz 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58549.log.gz 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40995.log 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29680.log 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45105.log.gz 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43909.log 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40995.log: /var/log/ceph/ceph-client.admin.29680.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40995.log.gz 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29680.log.gz 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31546.log 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51399.log 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43909.log.gz 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35755.log 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51399.log: 47.2% -- replaced with /var/log/ceph/ceph-client.admin.31546.log.gz 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51399.log.gz 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43867.log 2024-09-16T08:03:52.505 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46966.log 2024-09-16T08:03:52.506 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35755.log.gz 2024-09-16T08:03:52.506 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57751.log 2024-09-16T08:03:52.506 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46966.log: 49.2% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46966.log.gz 2024-09-16T08:03:52.506 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43867.log.gz 2024-09-16T08:03:52.506 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58969.log 2024-09-16T08:03:52.506 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28569.log 2024-09-16T08:03:52.506 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57751.log.gz 2024-09-16T08:03:52.506 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45635.log 2024-09-16T08:03:52.506 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.28569.log: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28569.log.gz 2024-09-16T08:03:52.506 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58969.log.gz 2024-09-16T08:03:52.506 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56037.log 2024-09-16T08:03:52.506 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39361.log 2024-09-16T08:03:52.506 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45635.log.gz 2024-09-16T08:03:52.506 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.56037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34766.log 2024-09-16T08:03:52.507 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39361.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56037.log.gz 2024-09-16T08:03:52.507 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39361.log.gz 2024-09-16T08:03:52.507 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29881.log 2024-09-16T08:03:52.507 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52144.log 2024-09-16T08:03:52.507 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34766.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34766.log.gz 2024-09-16T08:03:52.507 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29881.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.29881.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.52807.log 2024-09-16T08:03:52.507 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.507 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49294.log 2024-09-16T08:03:52.507 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52144.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52144.log.gz 2024-09-16T08:03:52.507 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52807.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42287.log 2024-09-16T08:03:52.507 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52807.log.gz 2024-09-16T08:03:52.507 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29008.log 2024-09-16T08:03:52.507 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49294.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49294.log.gz 2024-09-16T08:03:52.508 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30226.log 2024-09-16T08:03:52.508 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42287.log.gz 2024-09-16T08:03:52.508 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50887.log 2024-09-16T08:03:52.508 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30226.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29008.log.gz 2024-09-16T08:03:52.508 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30226.log.gz 2024-09-16T08:03:52.508 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31056.log 2024-09-16T08:03:52.508 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33335.log 2024-09-16T08:03:52.508 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50887.log.gz 2024-09-16T08:03:52.508 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31056.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T08:03:52.508 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33335.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33335.log.gz 2024-09-16T08:03:52.508 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31056.log.gz 2024-09-16T08:03:52.508 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57850.log 2024-09-16T08:03:52.509 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58465.log 2024-09-16T08:03:52.509 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57850.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57850.log.gz 2024-09-16T08:03:52.509 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36230.log 2024-09-16T08:03:52.509 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58465.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58465.log.gz 2024-09-16T08:03:52.509 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48454.log 2024-09-16T08:03:52.509 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36230.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36230.log.gz 2024-09-16T08:03:52.509 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43733.log 2024-09-16T08:03:52.509 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48454.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48454.log.gz 2024-09-16T08:03:52.509 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59011.log 2024-09-16T08:03:52.509 INFO:teuthology.orchestra.run.smithi003.stderr: 89.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T08:03:52.509 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55451.log 2024-09-16T08:03:52.509 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.59011.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43733.log.gz 2024-09-16T08:03:52.509 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59011.log.gz 2024-09-16T08:03:52.510 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41608.log 2024-09-16T08:03:52.510 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50621.log 2024-09-16T08:03:52.510 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41608.log: /var/log/ceph/ceph-client.admin.55451.log: 50.4% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55451.log.gz 2024-09-16T08:03:52.510 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41608.log.gz 2024-09-16T08:03:52.510 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58843.log 2024-09-16T08:03:52.510 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43323.log 2024-09-16T08:03:52.510 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50621.log: /var/log/ceph/ceph-client.admin.58843.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50621.log.gz 2024-09-16T08:03:52.510 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58843.log.gz 2024-09-16T08:03:52.510 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52942.log 2024-09-16T08:03:52.510 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58927.log 2024-09-16T08:03:52.510 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43323.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43323.log.gz 2024-09-16T08:03:52.510 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52942.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52942.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49028.log 2024-09-16T08:03:52.510 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.510 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52102.log 2024-09-16T08:03:52.511 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58927.log: /var/log/ceph/ceph-client.admin.49028.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49028.log.gz 2024-09-16T08:03:52.511 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58927.log.gz 2024-09-16T08:03:52.511 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58018.log 2024-09-16T08:03:52.511 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49958.log 2024-09-16T08:03:52.511 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52102.log.gz 2024-09-16T08:03:52.511 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34376.log 2024-09-16T08:03:52.511 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49958.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58018.log.gz 2024-09-16T08:03:52.511 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49958.log.gz 2024-09-16T08:03:52.511 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36993.log 2024-09-16T08:03:52.511 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33073.log 2024-09-16T08:03:52.511 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34376.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34376.log.gz 2024-09-16T08:03:52.511 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48180.log 2024-09-16T08:03:52.511 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33073.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36993.log.gz 2024-09-16T08:03:52.511 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33073.log.gz 2024-09-16T08:03:52.512 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52900.log 2024-09-16T08:03:52.512 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35012.log 2024-09-16T08:03:52.512 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48180.log.gz 2024-09-16T08:03:52.512 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40677.log 2024-09-16T08:03:52.512 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52900.log.gz 2024-09-16T08:03:52.512 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37769.log 2024-09-16T08:03:52.512 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40677.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35012.log.gz 2024-09-16T08:03:52.512 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40677.log.gz 2024-09-16T08:03:52.512 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33164.log 2024-09-16T08:03:52.512 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46267.log 2024-09-16T08:03:52.512 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37769.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37769.log.gz 2024-09-16T08:03:52.512 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33164.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33164.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58188.log 2024-09-16T08:03:52.512 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.513 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43050.log 2024-09-16T08:03:52.513 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58188.log: /var/log/ceph/ceph-client.admin.46267.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.58188.log.gz 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46267.log.gz 2024-09-16T08:03:52.513 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.513 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30275.log 2024-09-16T08:03:52.513 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33696.log 2024-09-16T08:03:52.513 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43050.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43050.log.gz 2024-09-16T08:03:52.513 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30275.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.30275.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33583.log 2024-09-16T08:03:52.513 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.513 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50581.log 2024-09-16T08:03:52.513 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33696.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33696.log.gz 2024-09-16T08:03:52.513 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33583.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38861.log 2024-09-16T08:03:52.513 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33583.log.gz 2024-09-16T08:03:52.513 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41846.log 2024-09-16T08:03:52.513 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50581.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50581.log.gz 2024-09-16T08:03:52.514 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38861.log: gzip 50.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.47838.log 2024-09-16T08:03:52.514 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38861.log.gz 2024-09-16T08:03:52.514 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38465.log 2024-09-16T08:03:52.514 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41846.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41846.log.gz 2024-09-16T08:03:52.514 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39048.log 2024-09-16T08:03:52.514 INFO:teuthology.orchestra.run.smithi003.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47838.log.gz 2024-09-16T08:03:52.514 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39661.log 2024-09-16T08:03:52.514 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39048.log: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39048.log.gz 2024-09-16T08:03:52.514 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38465.log.gz 2024-09-16T08:03:52.514 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39827.log 2024-09-16T08:03:52.514 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39661.log: gzip 49.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.29191.log 2024-09-16T08:03:52.514 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39661.log.gz 2024-09-16T08:03:52.514 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34596.log 2024-09-16T08:03:52.515 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39827.log: /var/log/ceph/ceph-client.admin.29191.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29191.log.gz 2024-09-16T08:03:52.515 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39827.log.gz 2024-09-16T08:03:52.515 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42908.log 2024-09-16T08:03:52.515 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34596.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34596.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50448.log 2024-09-16T08:03:52.515 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:03:52.515 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40244.log 2024-09-16T08:03:52.515 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50448.log: /var/log/ceph/ceph-client.admin.42908.log: 49.2% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50448.log.gz 2024-09-16T08:03:52.515 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42908.log.gz 2024-09-16T08:03:52.515 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43372.log 2024-09-16T08:03:52.515 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36494.log 2024-09-16T08:03:52.515 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.40244.log: /var/log/ceph/ceph-client.admin.43372.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43372.log.gz 2024-09-16T08:03:52.515 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54693.log 2024-09-16T08:03:52.515 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36494.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36494.log.gz 2024-09-16T08:03:52.515 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32940.log 2024-09-16T08:03:52.516 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54693.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.54693.log.gz 2024-09-16T08:03:52.516 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43559.log 2024-09-16T08:03:52.516 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32940.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32940.log.gz 2024-09-16T08:03:52.516 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50224.log 2024-09-16T08:03:52.516 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43559.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43559.log.gz 2024-09-16T08:03:52.516 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45392.log 2024-09-16T08:03:52.516 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50224.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50224.log.gz 2024-09-16T08:03:52.516 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36370.log 2024-09-16T08:03:52.516 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45392.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45392.log.gz 2024-09-16T08:03:52.516 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40855.log 2024-09-16T08:03:52.516 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36370.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36370.log.gz 2024-09-16T08:03:52.516 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48006.log 2024-09-16T08:03:52.517 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40855.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40855.log.gz 2024-09-16T08:03:52.517 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57541.log 2024-09-16T08:03:52.517 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48006.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48006.log.gz 2024-09-16T08:03:52.517 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48405.log 2024-09-16T08:03:52.517 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57541.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57541.log.gz 2024-09-16T08:03:52.517 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44881.log 2024-09-16T08:03:52.517 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48405.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48405.log.gz 2024-09-16T08:03:52.517 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45728.log 2024-09-16T08:03:52.517 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44881.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44881.log.gz 2024-09-16T08:03:52.517 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40080.log 2024-09-16T08:03:52.517 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45728.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45728.log.gz 2024-09-16T08:03:52.517 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51212.log 2024-09-16T08:03:52.518 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40080.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40080.log.gz 2024-09-16T08:03:52.518 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49117.log 2024-09-16T08:03:52.518 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51212.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51212.log.gz 2024-09-16T08:03:52.518 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40697.log 2024-09-16T08:03:52.518 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49117.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49117.log.gz 2024-09-16T08:03:52.518 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35174.log 2024-09-16T08:03:52.518 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40697.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40697.log.gz 2024-09-16T08:03:52.518 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48986.log 2024-09-16T08:03:52.518 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35174.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35174.log.gz 2024-09-16T08:03:52.518 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55410.log 2024-09-16T08:03:52.518 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48986.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48986.log.gz 2024-09-16T08:03:52.518 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51618.log 2024-09-16T08:03:52.518 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.55410.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55410.log.gz 2024-09-16T08:03:52.519 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46611.log 2024-09-16T08:03:52.519 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51618.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.51618.log.gz 2024-09-16T08:03:52.519 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31189.log 2024-09-16T08:03:52.519 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46611.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46611.log.gz 2024-09-16T08:03:52.519 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32723.log 2024-09-16T08:03:52.519 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31189.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.31189.log.gz 2024-09-16T08:03:52.519 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56077.log 2024-09-16T08:03:52.519 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32723.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32723.log.gz 2024-09-16T08:03:52.519 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31770.log 2024-09-16T08:03:52.519 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.56077.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56077.log.gz 2024-09-16T08:03:52.519 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38025.log 2024-09-16T08:03:52.519 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31770.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31770.log.gz 2024-09-16T08:03:52.519 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31952.log 2024-09-16T08:03:52.519 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38025.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.38025.log.gz 2024-09-16T08:03:52.520 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29882.log 2024-09-16T08:03:52.520 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31952.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31952.log.gz 2024-09-16T08:03:52.520 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37985.log 2024-09-16T08:03:52.520 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29882.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29882.log.gz 2024-09-16T08:03:52.520 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50805.log 2024-09-16T08:03:52.520 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37985.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37985.log.gz 2024-09-16T08:03:52.520 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55768.log 2024-09-16T08:03:52.520 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50805.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50805.log.gz 2024-09-16T08:03:52.520 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52228.log 2024-09-16T08:03:52.520 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.55768.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.55768.log.gz 2024-09-16T08:03:52.520 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55997.log 2024-09-16T08:03:52.520 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52228.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52228.log.gz 2024-09-16T08:03:52.520 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53563.log 2024-09-16T08:03:52.521 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.55997.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55997.log.gz 2024-09-16T08:03:52.521 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34467.log 2024-09-16T08:03:52.521 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.53563.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53563.log.gz 2024-09-16T08:03:52.521 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55957.log 2024-09-16T08:03:52.521 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34467.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34467.log.gz 2024-09-16T08:03:52.521 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33093.log 2024-09-16T08:03:52.521 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.55957.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55957.log.gz 2024-09-16T08:03:52.521 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44091.log 2024-09-16T08:03:52.521 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33093.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33093.log.gz 2024-09-16T08:03:52.521 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58675.log 2024-09-16T08:03:52.521 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44091.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44091.log.gz 2024-09-16T08:03:52.521 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41887.log 2024-09-16T08:03:52.521 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58675.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58675.log.gz 2024-09-16T08:03:52.521 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33827.log 2024-09-16T08:03:52.522 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41887.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41887.log.gz 2024-09-16T08:03:52.522 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34550.log 2024-09-16T08:03:52.522 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33827.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33827.log.gz 2024-09-16T08:03:52.522 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33969.log 2024-09-16T08:03:52.522 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34550.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34550.log.gz 2024-09-16T08:03:52.522 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42644.log 2024-09-16T08:03:52.522 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33969.log: 48.8% -- replaced with /var/log/ceph/ceph-client.admin.33969.log.gz 2024-09-16T08:03:52.522 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49252.log 2024-09-16T08:03:52.522 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42644.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42644.log.gz 2024-09-16T08:03:52.522 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50315.log 2024-09-16T08:03:52.522 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49252.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49252.log.gz 2024-09-16T08:03:52.522 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45056.log 2024-09-16T08:03:52.522 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50315.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50315.log.gz 2024-09-16T08:03:52.522 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38741.log 2024-09-16T08:03:52.523 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45056.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45056.log.gz 2024-09-16T08:03:52.523 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29784.log 2024-09-16T08:03:52.523 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38741.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38741.log.gz 2024-09-16T08:03:52.523 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30415.log 2024-09-16T08:03:52.523 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29784.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29784.log.gz 2024-09-16T08:03:52.523 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30055.log 2024-09-16T08:03:52.523 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30415.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30415.log.gz 2024-09-16T08:03:52.523 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32982.log 2024-09-16T08:03:52.523 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30055.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30055.log.gz 2024-09-16T08:03:52.523 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34990.log 2024-09-16T08:03:52.523 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32982.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32982.log.gz 2024-09-16T08:03:52.523 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45196.log 2024-09-16T08:03:52.523 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34990.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34990.log.gz 2024-09-16T08:03:52.524 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32423.log 2024-09-16T08:03:52.524 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45196.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45196.log.gz 2024-09-16T08:03:52.524 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42733.log 2024-09-16T08:03:52.524 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32423.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32423.log.gz 2024-09-16T08:03:52.524 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41746.log 2024-09-16T08:03:52.524 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42733.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42733.log.gz 2024-09-16T08:03:52.524 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57373.log 2024-09-16T08:03:52.524 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41746.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.41746.log.gz 2024-09-16T08:03:52.524 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43599.log 2024-09-16T08:03:52.524 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57373.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57373.log.gz 2024-09-16T08:03:52.524 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30169.log 2024-09-16T08:03:52.524 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43599.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43599.log.gz 2024-09-16T08:03:52.524 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35482.log 2024-09-16T08:03:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.30169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48873.log 2024-09-16T08:03:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.35482.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35482.log.gz 2024-09-16T08:03:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51071.log 2024-09-16T08:03:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.48873.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.48873.log.gz 2024-09-16T08:03:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54931.log 2024-09-16T08:03:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51071.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51071.log.gz 2024-09-16T08:03:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39908.log 2024-09-16T08:03:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54931.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54931.log.gz 2024-09-16T08:03:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58129.log 2024-09-16T08:03:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39908.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39908.log.gz 2024-09-16T08:03:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56215.log 2024-09-16T08:03:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.58129.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58129.log.gz 2024-09-16T08:03:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30097.log 2024-09-16T08:03:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.56215.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56215.log.gz 2024-09-16T08:03:52.533 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31365.log 2024-09-16T08:03:52.533 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30097.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30097.log.gz 2024-09-16T08:03:52.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-16T08:03:52.550 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37580.log 2024-09-16T08:03:52.550 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31365.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31365.log.gz 2024-09-16T08:03:52.563 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50938.log 2024-09-16T08:03:52.563 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37580.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.37580.log.gz 2024-09-16T08:03:52.572 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56424.log 2024-09-16T08:03:52.575 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50938.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50938.log.gz 2024-09-16T08:03:52.581 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37126.log 2024-09-16T08:03:52.583 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.56424.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56424.log.gz 2024-09-16T08:03:52.595 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38163.log 2024-09-16T08:03:52.595 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37126.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37126.log.gz 2024-09-16T08:03:52.603 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44597.log 2024-09-16T08:03:52.613 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47237.log 2024-09-16T08:03:52.613 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44597.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44597.log.gz 2024-09-16T08:03:52.616 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38163.log.gz 2024-09-16T08:03:52.621 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42152.log 2024-09-16T08:03:52.634 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.47237.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47237.log.gz 2024-09-16T08:03:52.635 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33387.log 2024-09-16T08:03:52.636 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42152.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42152.log.gz 2024-09-16T08:03:52.644 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52248.log 2024-09-16T08:03:52.654 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42329.log 2024-09-16T08:03:52.654 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52248.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52248.log.gz 2024-09-16T08:03:52.657 INFO:teuthology.orchestra.run.smithi003.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.33387.log.gz 2024-09-16T08:03:52.662 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50042.log 2024-09-16T08:03:52.676 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.42329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34950.log 2024-09-16T08:03:52.677 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50042.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50042.log.gz 2024-09-16T08:03:52.679 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42329.log.gz 2024-09-16T08:03:52.683 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50091.log 2024-09-16T08:03:52.693 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.34950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57171.log 2024-09-16T08:03:52.693 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50091.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50091.log.gz 2024-09-16T08:03:52.696 INFO:teuthology.orchestra.run.smithi003.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34950.log.gz 2024-09-16T08:03:52.701 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32492.log 2024-09-16T08:03:52.711 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.57171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56969.log 2024-09-16T08:03:52.711 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32492.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32492.log.gz 2024-09-16T08:03:52.712 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57171.log.gz 2024-09-16T08:03:52.725 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44832.log 2024-09-16T08:03:52.726 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.56969.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56969.log.gz 2024-09-16T08:03:52.743 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51879.log 2024-09-16T08:03:52.743 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44832.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44832.log.gz 2024-09-16T08:03:52.751 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33297.log 2024-09-16T08:03:52.764 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51879.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51879.log.gz 2024-09-16T08:03:52.768 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36636.log 2024-09-16T08:03:52.769 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33297.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33297.log.gz 2024-09-16T08:03:52.777 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30985.log 2024-09-16T08:03:52.787 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.36636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39320.log 2024-09-16T08:03:52.787 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30985.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30985.log.gz 2024-09-16T08:03:52.790 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36636.log.gz 2024-09-16T08:03:52.797 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32541.log 2024-09-16T08:03:52.798 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39320.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39320.log.gz 2024-09-16T08:03:52.816 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38651.log 2024-09-16T08:03:52.816 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32541.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32541.log.gz 2024-09-16T08:03:52.826 INFO:teuthology.orchestra.run.smithi003.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.36040.log.gz 2024-09-16T08:03:52.826 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54646.log 2024-09-16T08:03:52.827 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38651.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38651.log.gz 2024-09-16T08:03:52.835 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30139.log 2024-09-16T08:03:52.835 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54646.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54646.log.gz 2024-09-16T08:03:52.836 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31728.log 2024-09-16T08:03:52.836 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30139.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30139.log.gz 2024-09-16T08:03:52.836 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33521.log 2024-09-16T08:03:52.836 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31728.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31728.log.gz 2024-09-16T08:03:52.836 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46562.log 2024-09-16T08:03:52.836 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33521.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33521.log.gz 2024-09-16T08:03:52.836 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37720.log 2024-09-16T08:03:52.836 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46562.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46562.log.gz 2024-09-16T08:03:52.836 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28890.log 2024-09-16T08:03:52.836 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37720.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37720.log.gz 2024-09-16T08:03:52.836 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40597.log 2024-09-16T08:03:52.836 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.28890.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28890.log.gz 2024-09-16T08:03:52.837 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37078.log 2024-09-16T08:03:52.837 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.40597.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.40597.log.gz 2024-09-16T08:03:52.837 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29967.log 2024-09-16T08:03:52.837 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37078.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37078.log.gz 2024-09-16T08:03:52.837 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31105.log 2024-09-16T08:03:52.844 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29967.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29967.log.gz 2024-09-16T08:03:52.844 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29470.log 2024-09-16T08:03:52.844 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31105.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31105.log.gz 2024-09-16T08:03:52.844 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32673.log 2024-09-16T08:03:52.844 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29470.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29470.log.gz 2024-09-16T08:03:52.844 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30705.log 2024-09-16T08:03:52.844 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32673.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32673.log.gz 2024-09-16T08:03:52.845 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38781.log 2024-09-16T08:03:52.845 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.30705.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30705.log.gz 2024-09-16T08:03:52.845 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44918.log 2024-09-16T08:03:52.845 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38781.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38781.log.gz 2024-09-16T08:03:52.845 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51922.log 2024-09-16T08:03:52.845 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44918.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44918.log.gz 2024-09-16T08:03:52.845 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49388.log 2024-09-16T08:03:52.845 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51922.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51922.log.gz 2024-09-16T08:03:52.854 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38379.log 2024-09-16T08:03:52.854 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49388.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49388.log.gz 2024-09-16T08:03:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45369.log 2024-09-16T08:03:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.38379.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38379.log.gz 2024-09-16T08:03:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46085.log 2024-09-16T08:03:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.45369.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.45369.log.gz 2024-09-16T08:03:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32218.log 2024-09-16T08:03:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.46085.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.46085.log.gz 2024-09-16T08:03:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37900.log 2024-09-16T08:03:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32218.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32218.log.gz 2024-09-16T08:03:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32827.log 2024-09-16T08:03:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37900.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37900.log.gz 2024-09-16T08:03:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39950.log 2024-09-16T08:03:52.855 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32827.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.32827.log.gz 2024-09-16T08:03:52.856 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54599.log 2024-09-16T08:03:52.856 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.39950.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39950.log.gz 2024-09-16T08:03:52.856 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51485.log 2024-09-16T08:03:52.856 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.54599.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54599.log.gz 2024-09-16T08:03:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44195.log 2024-09-16T08:03:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.51485.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51485.log.gz 2024-09-16T08:03:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46885.log 2024-09-16T08:03:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.44195.log: 92.9% -- replaced with /var/log/ceph/ceph-client.0.44775.log.gz 2024-09-16T08:03:52.862 INFO:teuthology.orchestra.run.smithi003.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44195.log.gz 2024-09-16T08:03:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49077.log 2024-09-16T08:03:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.46885.log: -- /var/log/ceph/ceph-client.admin.57851.log 2024-09-16T08:03:52.862 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46885.log.gz 2024-09-16T08:03:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41706.log 2024-09-16T08:03:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.49077.log: /var/log/ceph/ceph-client.admin.57851.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57851.log.gz 2024-09-16T08:03:52.863 INFO:teuthology.orchestra.run.smithi003.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49077.log.gz 2024-09-16T08:03:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43692.log 2024-09-16T08:03:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50378.log 2024-09-16T08:03:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.41706.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41706.log.gz 2024-09-16T08:03:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.43692.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43692.log.gz 2024-09-16T08:03:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37393.log 2024-09-16T08:03:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52563.log 2024-09-16T08:03:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.50378.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50378.log.gz 2024-09-16T08:03:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.37393.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37393.log.gz 2024-09-16T08:03:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.52563.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52563.log.gz 2024-09-16T08:03:53.032 INFO:teuthology.orchestra.run.smithi003.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.40244.log.gz 2024-09-16T08:03:53.099 INFO:teuthology.orchestra.run.smithi003.stderr: 89.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T08:03:53.141 INFO:teuthology.orchestra.run.smithi003.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.30169.log.gz 2024-09-16T08:03:53.159 INFO:teuthology.orchestra.run.smithi003.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.49564.log.gz 2024-09-16T08:04:11.248 INFO:teuthology.orchestra.run.smithi134.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T08:04:12.496 INFO:teuthology.orchestra.run.smithi134.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-16T08:04:12.498 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-16T08:04:12.498 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m20.300s 2024-09-16T08:04:12.498 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m38.015s 2024-09-16T08:04:12.498 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m1.348s 2024-09-16T08:04:14.984 INFO:teuthology.orchestra.run.smithi003.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T08:04:15.305 INFO:teuthology.orchestra.run.smithi003.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T08:04:15.307 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-16T08:04:15.307 INFO:teuthology.orchestra.run.smithi003.stderr:real 0m23.157s 2024-09-16T08:04:15.307 INFO:teuthology.orchestra.run.smithi003.stderr:user 0m48.789s 2024-09-16T08:04:15.307 INFO:teuthology.orchestra.run.smithi003.stderr:sys 0m1.951s 2024-09-16T08:04:15.308 INFO:tasks.ceph:Archiving logs... 2024-09-16T08:04:15.308 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906875/remote/smithi003/log 2024-09-16T08:04:15.309 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T08:04:23.188 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906875/remote/smithi134/log 2024-09-16T08:04:23.189 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T08:04:29.634 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T08:04:29.644 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T08:04:29.644 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T08:04:29.647 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T08:04:29.736 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T08:04:29.745 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T08:04:29.745 DEBUG:teuthology.orchestra.run.smithi003:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T08:04:29.748 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T08:04:29.764 INFO:teuthology.orchestra.run.smithi003.stderr:bash: line 1: ntpq: command not found 2024-09-16T08:04:29.768 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-16T08:04:29.769 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T08:04:29.769 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2024-09-16T08:04:29.769 INFO:teuthology.orchestra.run.smithi003.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 +1835us[+1814us] +/- 49ms 2024-09-16T08:04:29.769 INFO:teuthology.orchestra.run.smithi003.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 -4065us[-4085us] +/- 68ms 2024-09-16T08:04:29.769 INFO:teuthology.orchestra.run.smithi003.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +1842us[+1820us] +/- 70ms 2024-09-16T08:04:29.769 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T08:04:29.771 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T08:04:29.771 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-16T08:04:29.771 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 +1741us[+1689us] +/- 49ms 2024-09-16T08:04:29.772 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 -4184us[-4237us] +/- 68ms 2024-09-16T08:04:29.772 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +1740us[+1688us] +/- 70ms 2024-09-16T08:04:29.772 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T08:04:29.773 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T08:04:29.782 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T08:04:29.783 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T08:04:29.793 DEBUG:teuthology.orchestra.run.smithi003:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T08:04:29.894 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T08:04:29.962 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T08:04:29.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T08:04:29.994 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T08:04:30.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T08:04:30.024 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T08:04:30.035 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T08:04:30.044 INFO:teuthology.task.internal:Duration was 1596.009996 seconds 2024-09-16T08:04:30.045 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T08:04:30.055 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T08:04:30.055 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T08:04:30.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T08:04:30.098 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T08:04:30.104 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T08:04:30.507 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T08:04:30.507 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi003.front.sepia.ceph.com 2024-09-16T08:04:30.508 DEBUG:teuthology.orchestra.run.smithi003:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T08:04:30.572 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-09-16T08:04:30.573 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T08:04:30.606 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T08:04:30.606 DEBUG:teuthology.orchestra.run.smithi003:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T08:04:30.615 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T08:04:30.673 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T08:04:30.674 DEBUG:teuthology.orchestra.run.smithi003:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T08:04:30.686 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T08:04:30.817 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T08:04:30.829 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T08:04:30.829 DEBUG:teuthology.orchestra.run.smithi003:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T08:04:30.855 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T08:04:30.881 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T08:04:30.893 DEBUG:teuthology.orchestra.run.smithi003:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T08:04:30.898 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T08:04:30.920 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = core 2024-09-16T08:04:30.944 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-09-16T08:04:30.982 DEBUG:teuthology.orchestra.run.smithi003:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T08:04:31.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T08:04:31.020 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T08:04:31.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T08:04:31.038 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T08:04:31.053 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T08:04:31.054 DEBUG:teuthology.misc:Transferring archived files from smithi003:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906875/remote/smithi003 2024-09-16T08:04:31.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T08:04:31.096 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906875/remote/smithi134 2024-09-16T08:04:31.097 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T08:04:31.129 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T08:04:31.129 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T08:04:31.133 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T08:04:31.180 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T08:04:31.192 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T08:04:31.192 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T08:04:31.207 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T08:04:31.207 DEBUG:teuthology.orchestra.run.smithi003:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T08:04:31.209 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T08:04:31.222 INFO:teuthology.orchestra.run.smithi003.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 08:04 /home/ubuntu/cephtest 2024-09-16T08:04:31.236 INFO:teuthology.orchestra.run.smithi134.stdout: 265922 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 08:04 /home/ubuntu/cephtest 2024-09-16T08:04:31.237 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T08:04:31.249 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T08:04:31.288 INFO:teuthology.run:Summary data: description: crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/radosbench} duration: 1596.009996175766 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-16T08:04:31.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T08:04:31.384 INFO:teuthology.run:pass